Adapting RICO dataset for boosting Graphical User Interface component classification for automated Android testing

被引:0
|
作者
Lopez, Yadini Perez [1 ]
Albuquerque, Lais Dib [1 ]
de F. Costa Junior, Gilmar Joia [1 ]
Xavier, Daniel Lopes [1 ]
Ochoa, Juan David [2 ]
Camargo, Denizard Dimitri [2 ]
机构
[1] SIDIA Dev & Res Inst, SITA AIG Automat Innovat Grp, Manaus, Amazonas, Brazil
[2] SIDIA Dev & Res Inst, SITA AIG Automat Innovat Grp, Porto Velho, Brazil
关键词
Android; automated mobile testing; variational autoencoder; widget; graphical user interface; dataset;
D O I
10.1109/ISCMI59957.2023.10458576
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
User Interface testing is one of the most used routines for Android feature quality verification. Regarding this, several industrial and academic solutions are available for Graphical User Interface component identification. However, the state-of-art works are still limited respecting the variety of widgets that can recognize. Also, most solutions use application metadata that can vary across different releases and device models, affecting the portability of automations. Research that approach widget classification using Machine Learning based solutions commonly use a large Android screen capture dataset called RICO. However, several annotations problems have been recurrently pointed on this dataset. In this work, we propose a selection of data cleaning and balancing techniques for removing noisy samples and leveling the number of samples per class on RICO dataset. We used a custom dataset with an extended number of classes (106) when comparing with the state-of-art works that approach widget classification with 15 classes on average. Finally, we showed that using these techniques to improve the quality of data can improve the accuracy when training Machine Learning models like Convolutional Neural Networks and eXtreme Gradient Boosting.
引用
收藏
页码:118 / 123
页数:6
相关论文
共 50 条
  • [21] Graphical User Interface Testing Optimization for Water Monitoring Applications
    Latiu, Gentiana
    Cret, Octavian
    Vacariu, Lucia
    19TH INTERNATIONAL CONFERENCE ON CONTROL SYSTEMS AND COMPUTER SCIENCE (CSCS 2013), 2013, : 640 - 645
  • [22] Graphical user interface (GUI) testing: Systematic mapping and repository
    Banerjee, Ishan
    Nguyen, Bao
    Garousi, Vahid
    Memon, Atif
    INFORMATION AND SOFTWARE TECHNOLOGY, 2013, 55 (10) : 1679 - 1694
  • [23] PyPAn: An Automated Graphical User Interface for Protein Sequence and Structure Analyses
    Mathur, Yash
    Mohammad, Taj
    Anjum, Farah
    Shafie, Alaa
    Elasbali, Abdelbaset M.
    Uversky, Vladimir N.
    Hassan, Md. Imtaiyaz
    PROTEIN AND PEPTIDE LETTERS, 2022, 29 (04): : 306 - 312
  • [24] CuriousDroid: Automated User Interface Interaction for Android Application Analysis Sandboxes
    Carter, Patrick
    Mulliner, Collin
    Lindorfer, Martina
    Robertson, William
    Kirda, Engin
    FINANCIAL CRYPTOGRAPHY AND DATA SECURITY, FC 2016, 2017, 9603 : 231 - 249
  • [25] Towards Automated Load Testing Through the User Interface
    Teixeira, Bruno
    Campos, Jose Creissac
    HUMAN-COMPUTER INTERACTION - INTERACT 2023, PT II, 2023, 14143 : 514 - 522
  • [26] CATS - An automated user interface for software development and testing
    Heimann, DI
    ANNUAL RELIABILITY AND MAINTAINABILITY SYMPOSIUM, 1996 PROCEEDINGS, 1996, : 163 - 166
  • [27] Graphical User Interface for Classification of Diabetic Retinopathy using Image Processing
    Rajasekar, T.
    Albert Joshwa, A.
    Deepa, M.
    Kaaviya, A.I.
    4th International Conference on Inventive Research in Computing Applications, ICIRCA 2022 - Proceedings, 2022, : 1789 - 1796
  • [28] Advancement in Graphical User Interface Tailored Quality Classification of Sape Soundboard
    Wong, Tee Hao
    Soong, Ming Foong
    Saifizul, Ahmad
    Ramli, Rahizar
    BIORESOURCES, 2024, 19 (03): : 5523 - 5534
  • [29] A systematic mapping study for graphical user interface testing on mobile apps
    Nie, Liming
    Said, Kabir Sulaiman
    Ma, Lingfei
    Zheng, Yaowen
    Zhao, Yangyang
    IET Software, 2023, 17 (03): : 249 - 267
  • [30] A systematic mapping study for graphical user interface testing on mobile apps
    Nie, Liming
    Said, Kabir Sulaiman
    Ma, Lingfei
    Zheng, Yaowen
    Zhao, Yangyang
    IET SOFTWARE, 2023, 17 (03) : 249 - 267