Recent Progress in Automated Code Generation from GUI Images Using Machine Learning Techniques

被引:1
|
作者
Baule, Daniel de Souza [1 ]
von Wangenheim, Christiane Gresse [1 ]
von Wangenheim, Aldo [1 ]
Hauck, Jean C. R. [1 ]
机构
[1] Univ Fed Santa Catarina, Florianopolis, SC, Brazil
关键词
user interface design; machine learning; systematic mapping;
D O I
暂无
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The manual transformation of a user interface design into code is a costly and time-consuming process. A solution can be the automation of the generation of code based on sketches or GUI design images. Recently, Machine Learning approaches have shown promising results in detecting GUI elements for such automation. Thus, to provide an overview of existing approaches, we performed a systematic mapping study. As a result, we identified and compared 20 approaches, that demonstrate good performance results being considered useful. These results can be used by researchers and practitioners in order to improve the efficiency of the GUI design process as well as continue to evolve and improve approaches for its support.
引用
收藏
页码:1095 / 1127
页数:33
相关论文
共 50 条
  • [1] Automatic HTML']HTML Code Generation from Mock-up Images Using Machine Learning Techniques
    Asiroglu, Batuhan
    Mate, Busra Rumeysa
    Yildiz, Eyyup
    Nalcakan, Yagiz
    Sezen, Alper
    Dagtekin, Mustafa
    Ensari, Tolga
    [J]. 2019 SCIENTIFIC MEETING ON ELECTRICAL-ELECTRONICS & BIOMEDICAL ENGINEERING AND COMPUTER SCIENCE (EBBT), 2019,
  • [2] A Survey on the Machine Learning Techniques for Automated Diagnosis from Ultrasound Images
    Mohit, Kumar
    Gupta, Rajeev
    Kumar, Basant
    [J]. CURRENT MEDICAL IMAGING, 2024, 20
  • [3] An automated brain tumor detection and classification from MRI images using machine learning techniques with IoT
    Anil Kumar Budati
    Rajesh Babu Katta
    [J]. Environment, Development and Sustainability, 2022, 24 : 10570 - 10584
  • [4] An automated brain tumor detection and classification from MRI images using machine learning techniques with IoT
    Budati, Anil Kumar
    Katta, Rajesh Babu
    [J]. ENVIRONMENT DEVELOPMENT AND SUSTAINABILITY, 2022, 24 (09) : 10570 - 10584
  • [5] An Approach to GUI Test Scenario Generation Using Machine Learning
    Gao, Jerry
    Tao, Chuanqi
    He, Yejun
    Anumalasetty, Amrutha Pavani
    Joseph, Erica Wilson
    Sripathi, Akshata Hatwar Kumbashi
    Nayani, Himabindu
    Li, Shi Ting
    [J]. 2022 FOURTH IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE TESTING (AITEST 2022), 2022, : 79 - 86
  • [6] DeeperCoder: Code Generation Using Machine Learning
    Shim, Simon
    Patil, Pradnyesh
    Yadav, Rajiv Ramesh
    Shinde, Anurag
    Devale, Venkatesh
    [J]. 2020 10TH ANNUAL COMPUTING AND COMMUNICATION WORKSHOP AND CONFERENCE (CCWC), 2020, : 194 - 199
  • [7] An automated eye disease recognition system from visual content of facial images using machine learning techniques
    Akram, Ashrafi
    Debnath, Rameswar
    [J]. TURKISH JOURNAL OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCES, 2020, 28 (02) : 917 - 932
  • [8] Construction of Convex Relaxations Using Automated Code Generation Techniques
    Edward P. Gatzke
    John E. Tolsma
    Paul I. Barton
    [J]. Optimization and Engineering, 2002, 3 : 305 - 326
  • [9] Construction of Convex Relaxations Using Automated Code Generation Techniques
    Gatzke, Edward P.
    Tolsma, John E.
    Barton, Paul I.
    [J]. OPTIMIZATION AND ENGINEERING, 2002, 3 (03) : 305 - 326
  • [10] Code Generation by Example Using Symbolic Machine Learning
    Lano K.
    Xue Q.
    [J]. SN Computer Science, 4 (2)