arrow
Return

Wireframe-based UI Design Search through Image Autoencoder

delete2020-06-16
delete68
delete
OA
AI
J
Jieshan Chen
C
Chunyang Chen *
Z
Zhenchang Xing
X
Xin Xia
L
Liming Zhu
J
John Grundy
J
Jinshui Wang *
DOI:10.1145/3391613delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
UI design is an integral part of software development. For many developers who do not have much UI design experience, exposing them to a large database of real-application UI designs can help them quickly build up a realistic understanding of the design space for a software feature and get design inspirations from existing applications. However, existing keyword-based, image-similarity-based, and component-matching-based methods cannot reliably find relevant high-fidelity UI designs in a large database alike to the UI wireframe that the developers sketch, in face of the great variations in UI designs. In this article, we propose a deep-learningbased UI design search engine to fill in the gap. The key innovation of our search engine is to train a wireframe image autoencoder using a large database of real-application UI designs, without the need for labeling relevant UI designs. We implement our approach for Android UI design search, and conduct extensive experiments with artificially created relevant UI designs and human evaluation of UI design search results. Our experiments confirm the superior performance of our search engine over existing image-similarity or componentmatching-based methods and demonstrate the usefulness of our search engine in real-world UI design tasks.
Keywords:
Android
UI search
deep learning
auto-encoder
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

A
ACM Transactions on Software Engineering and Methodology
IF:
6.2
Papers:
1.2K
Citations:
3.4K

Organization

F
Fujian University of Technology
Scholars:
3.0K
Papers: 2.0K
Citations: 2.3K
M
Monash University
Scholars:
5.4W
Papers: 5.4W
Citations: 79
A
Australian National University
Scholars:
2.1W
Papers: 2.3W
Citations: 3.9W
researcher View more organizations