Recent Progress in Automated Code Generation from GUI Images Using Machine Learning Techniques

被引:2
|
作者
Baule, Daniel de Souza [1 ]
von Wangenheim, Christiane Gresse [1 ]
von Wangenheim, Aldo [1 ]
Hauck, Jean C. R. [1 ]
机构
[1] Univ Fed Santa Catarina, Florianopolis, SC, Brazil
关键词
user interface design; machine learning; systematic mapping;
D O I
暂无
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The manual transformation of a user interface design into code is a costly and time-consuming process. A solution can be the automation of the generation of code based on sketches or GUI design images. Recently, Machine Learning approaches have shown promising results in detecting GUI elements for such automation. Thus, to provide an overview of existing approaches, we performed a systematic mapping study. As a result, we identified and compared 20 approaches, that demonstrate good performance results being considered useful. These results can be used by researchers and practitioners in order to improve the efficiency of the GUI design process as well as continue to evolve and improve approaches for its support.
引用
下载
收藏
页码:1095 / 1127
页数:33
相关论文
共 50 条
  • [31] A Review on Automated Cancer Detection in Medical Images using Machine Learning and Deep Learning based Computational Techniques: Challenges and Opportunities
    Manhas, Jatinder
    Gupta, Rachit Kumar
    Roy, Partha Pratim
    ARCHIVES OF COMPUTATIONAL METHODS IN ENGINEERING, 2022, 29 (05) : 2893 - 2933
  • [32] Identifying Auto-Generated Code by Using Machine Learning Techniques
    Shimonaka, Kento
    Sumi, Soichi
    Higo, Yoshiki
    Kusumoto, Shinji
    PROCEEDINGS 7TH INTERNATIONAL WORKSHOP ON EMPIRICAL SOFTWARE ENGINEERING IN PRACTICE (IWESEP 2016), 2016, : 18 - 23
  • [33] Revisiting "code smell severity classification using machine learning techniques"
    Hu, Wenhua
    Liu, Lei
    Yang, Peixin
    Zou, Kuan
    Li, Jiajun
    Lin, Guancheng
    Xiang, Jianwen
    2023 IEEE 47TH ANNUAL COMPUTERS, SOFTWARE, AND APPLICATIONS CONFERENCE, COMPSAC, 2023, : 840 - 849
  • [34] Detecting Code Smells using Machine Learning Techniques: Are We There Yet?
    Di Nucci, Dario
    Palomba, Fabio
    Tamburri, Damian A.
    Serebrenik, Alexander
    De Lucia, Andrea
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON SOFTWARE ANALYSIS, EVOLUTION AND REENGINEERING (SANER 2018), 2018, : 612 - 621
  • [35] Code Review Analysis of Software System using Machine Learning Techniques
    Lal, Harsh
    Pahwa, Gaurav
    PROCEEDINGS OF 2017 11TH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS AND CONTROL (ISCO 2017), 2017, : 8 - 13
  • [36] Group technology for automated generation of machine controller code
    Hornyak, O.
    Safrany, G.
    SACI: 2009 5TH INTERNATIONAL SYMPOSIUM ON APPLIED COMPUTATIONAL INTELLIGENCE AND INFORMATICS, 2009, : 7 - +
  • [37] Training Data Generation for Machine Learning Using GPR Images
    Boldt, Markus
    Thiele, Antje
    Schulz, Karsten
    EARTH RESOURCES AND ENVIRONMENTAL REMOTE SENSING/GIS APPLICATIONS XIII, 2022, 12268
  • [38] GUI Code Generation for Android Applications Using a MDA Approach
    Sabraoui, Ayoub
    El Koutbi, Mohammed
    Khriss, Ismail
    PROCEEDINGS OF 2012 INTERNATIONAL CONFERENCE ON COMPLEX SYSTEMS (ICCS12), 2012, : 393 - 398
  • [39] Automated Segmentation of Brain Tumor MRI Images Using Machine Learning
    Meenakshidevi, P.
    Kalyanasundaram, P.
    Kumar, Nirmal S.
    2024 INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, COMMUNICATION AND APPLIED INFORMATICS, ACCAI 2024, 2024,
  • [40] Automated Detection of Cystitis in Ultrasound Images Using Deep Learning Techniques
    Sankari, V. M. Raja
    Raykar, Dattanand Arun
    Snekhalatha, U.
    Karthik, Varshini
    Shetty, Veerendra
    IEEE ACCESS, 2023, 11 : 104179 - 104190