arrow
返回

Code generation from a graphical user interface via attention-based encoder-decoder model

delete2021-05-18
delete5
PRE
AI
W
Wen-Yin Chen
P
Pavol Podstreleny
Y
Yung-Yao Chen
K
Kai‐Lung Hua *
DOI:10.1007/s00530-021-00804-7delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Code generation from graphical user interface images is a promising area of research. Recent progress on machine learning methods made it possible to transform user interface into the code using several methods. The encoder-decoder framework represents one of the possible ways to tackle code generation tasks. Our model implements the encoder-decoder framework with an attention mechanism that helps the decoder to focus on a subset of salient image features when needed. Our attention mechanism also helps the decoder to generate token sequences with higher accuracy. Experimental results show that our model outperforms previously proposed models on the pix2code benchmark dataset.
Keyword:
Code generation
Encoder-decoder
Attention
Graphical user interface
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Multimedia Systems 封面图
Multimedia Systems
IF:
3.1
论文数:
2.8K
被引数:
2.7K

机构

N
National Yang Ming Chiao Tung University
学者数:
2.5W
论文数: 2.3W
被引数: 2.2W
N
national taiwan university of science & technology
学者数:
8.8K
论文数: 8.7K
被引数: 9
National Taipei University of Education 封面图
National Taipei University of Education
学者数:
203
论文数: 290
被引数: 307
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
ImageNet Large Scale Visual Recognition ChallengeImageNet大规模视觉识别挑战
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
err分享
err收藏
Acid catalysis in hydrolytic reactions水解反应中的酸催化
err1929-01-01
err0
PREAI
errJ. N. Brönsted; W. F. K. Wynne-Jones
err分享
err收藏
Intelligent deployment of UAVs in 5G heterogeneous communication environment for improved coverage
err2017-05-01
err99
PREAI
errSharma, Vishal; Srinivasan, Kathiravan; Chao, Han-Chieh; Hua, Kai-Lung; Cheng, Wen-Huang
err分享
err收藏
err分享
err收藏
A comparative study of data fusion for RGB-D based visual recognition
err2016-04-01
err56
PREAI
errSanchez-Riera, Jordi; Hua, Kai-Lung; Hsiao, Yuan-Sheng; Lim, Tekoing; Hidayati, Shintami C.; Cheng, Wen-Huang
err分享
err收藏
学者 查看更多内容