Journal Home Online First Current Issue Archive For Authors Journal Information 中文版

Frontiers of Information Technology & Electronic Engineering >> 2024, Volume 25, Issue 7 doi: 10.1631/FITEE.2300312

Iris: a multi-constraint graphic layout generation system

College of Computer Science and Technology, Zhejiang University, Hangzhou 310030, China; Zhejiang-Singapore Innovation and AI Joint Research Lab, Hangzhou 310058, China; Alibaba Group, Hangzhou 310034, China; 

Received: 2023-04-30 Accepted: 2024-07-30 Available online: 2024-07-30

Next Previous

Abstract

In graphic design, layout is a result of the interaction between the design elements in the foreground and background images. However, prevalent research focuses on enhancing the quality of layout generation algorithms, overlooking the interaction and controllability that are essential for designers when applying these methods in real-world situations. This paper proposes a user-centered , Iris, which provides designers with an interactive environment to expedite the workflow, and this environment encompasses the features of user-constraint specification, layout generation, custom editing, and final rendering. To satisfy the multiple constraints specified by designers, we introduce a novel generation model, multi-constraint LayoutVQ-VAE, for advancing layout generation under intra- and inter-domain constraints. Qualitative and quantitative experiments on our proposed model indicate that it outperforms or is comparable to prevalent state-of-the-art models in multiple aspects. User studies on Iris further demonstrate that the system significantly enhances design efficiency while achieving human-like layout designs.

Related Research