Adapting RICO dataset for boosting Graphical User Interface component classification for automated Android testing

被引:0
|
作者
Lopez, Yadini Perez [1 ]
Albuquerque, Lais Dib [1 ]
de F. Costa Junior, Gilmar Joia [1 ]
Xavier, Daniel Lopes [1 ]
Ochoa, Juan David [2 ]
Camargo, Denizard Dimitri [2 ]
机构
[1] SIDIA Dev & Res Inst, SITA AIG Automat Innovat Grp, Manaus, Amazonas, Brazil
[2] SIDIA Dev & Res Inst, SITA AIG Automat Innovat Grp, Porto Velho, Brazil
关键词
Android; automated mobile testing; variational autoencoder; widget; graphical user interface; dataset;
D O I
10.1109/ISCMI59957.2023.10458576
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
User Interface testing is one of the most used routines for Android feature quality verification. Regarding this, several industrial and academic solutions are available for Graphical User Interface component identification. However, the state-of-art works are still limited respecting the variety of widgets that can recognize. Also, most solutions use application metadata that can vary across different releases and device models, affecting the portability of automations. Research that approach widget classification using Machine Learning based solutions commonly use a large Android screen capture dataset called RICO. However, several annotations problems have been recurrently pointed on this dataset. In this work, we propose a selection of data cleaning and balancing techniques for removing noisy samples and leveling the number of samples per class on RICO dataset. We used a custom dataset with an extended number of classes (106) when comparing with the state-of-art works that approach widget classification with 15 classes on average. Finally, we showed that using these techniques to improve the quality of data can improve the accuracy when training Machine Learning models like Convolutional Neural Networks and eXtreme Gradient Boosting.
引用
收藏
页码:118 / 123
页数:6
相关论文
共 50 条
  • [1] 333333 Automated Graphical User Interface Regression Testing
    Panda, Madhumita
    Mohapatra, Durga Prasad
    PROCEEDINGS OF INTERNATIONAL CONFERENCE ON INTERNET COMPUTING AND INFORMATION COMMUNICATIONS (ICICIC GLOBAL 2012), 2014, 216 : 325 - 341
  • [2] Challenges in Automated Testing through Graphical User Interface
    Aho, Pekka
    Vos, Tanja
    2018 IEEE 11TH INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION WORKSHOPS (ICSTW), 2018, : 118 - 121
  • [3] Design and Implementation of Graphical User Interface for Interface Board Component Testing
    Abd Mutalib, Nurliyana
    Hashim, Norlezah
    bin Mohamood, Nadzrie
    Mispan, Mohd Syafiq
    Abd Gani, Shamsul Fakhar
    Ruslan, Eliyana
    Hadi, Dayanasari Abdul
    Fatt, Lai Len
    Zahari, Madiha
    Basar, Mohd Farriz
    Seang, Wang Choon
    Kyan, Hau Yong
    bin Noordin, Aminurrashid
    6TH IEEE INTERNATIONAL CONFERENCE ON RECENT ADVANCES AND INNOVATIONS IN ENGINEERING (ICRAIE), 2021,
  • [4] FiTouch: Adapting Graphical User Interface for Touch Interaction
    Liu, Li
    Zhang, Jingyuan
    Yin, Xu
    2014 IEEE INTERNATIONAL SYMPOSIUM ON HAPTIC, AUDIO AND VISUAL ENVIRONMENTS AND GAMES (HAVE), 2014,
  • [5] AUTOMATION TESTING OF GRAPHICAL USER INTERFACE
    Miljkovic, Dorde
    Bojic, Sasa
    Dukic, Miodrag
    Jovanovic, Miladin
    2012 20TH TELECOMMUNICATIONS FORUM (TELFOR), 2012, : 1609 - 1612
  • [6] Method of Graphical User Interface Adaptation Using Reinforcement Learning and Automated Testing
    Fyodorov, Victor
    Karsakov, Andrey
    2021 5TH INTERNATIONAL CONFERENCE ON NATURAL LANGUAGE PROCESSING AND INFORMATION RETRIEVAL, NLPIR 2021, 2021, : 163 - 167
  • [7] Adapting the human plausible reasoning theory to a graphical user interface
    Virvou, M
    Kabassi, K
    IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART A-SYSTEMS AND HUMANS, 2004, 34 (04): : 546 - 563
  • [8] Automated Graphical User Interface Testing Framework-Evoguitest-Based on Evolutionary Algorithms
    Latiu, Gentiana Ioana
    Cret, Octavian Augustin
    Vacariu, Lucia
    COMPUTATIONAL INTELLIGENCE, IJCCI 2013, 2016, 613 : 39 - 63
  • [9] A Graphical User Interface (GUI) Testing Methodology
    Singhera, Zafar
    Horowitz, Ellis
    Shah, Abad
    INTERNATIONAL JOURNAL OF INFORMATION TECHNOLOGY AND WEB ENGINEERING, 2008, 3 (02) : 1 - 17
  • [10] Automatizing Android Unit and User Interface Testing
    Vanhatupa, Juha-Matti
    Heikkinen, Mikko
    AGILE PROCESSES, IN SOFTWARE ENGINEERING, AND EXTREME PROGRAMMING, XP 2015, 2015, 212 : 373 - 374