| Title: |
cvrip: A Visual GUI Ripping Framework. |
| Authors: |
Huang, Heji1 (AUTHOR), Qian, Ju1 (AUTHOR) jqian@nuaa.edu.cn, Jia, Wenduo1 (AUTHOR), Jin, Yiming1 (AUTHOR) |
| Source: |
Journal of Software: Evolution & Process. Feb2025, Vol. 37 Issue 2, p1-21. 21p. |
| Subject Terms: |
*GRAPHICAL user interfaces, *COMPUTER vision, *SOFTWARE engineering, *VISION testing, *RECOGNITION (Psychology) |
| Abstract: |
GUI ripping explores the graphical user interface of an application to build a model which can express the application behavior. The ripped GUI model is useful in various software engineering tasks. Traditional GUI ripping techniques depend on the underlying GUI frameworks to provide the GUI structure information. They are difficult to work across platforms or on nonnative applications where the GUI structure information cannot easily be obtained. This work introduces cvrip, a visual GUI ripping framework, to address the problem. cvrip visually analyzes the GUI screen for ripping and does not rely on the underlying GUI frameworks. We introduce many new techniques to enable efficient visual GUI ripping, for example, a YOLO v5‐based model to detect executable widgets, a state recognition acceleration method for fast model updating, and several GUI exploration strategies taking the characteristics of imperfect visual analysis into account. Experiments are conducted to evaluate many technique choices in visual GUI ripping and compare the solution with the traditional style ripping. The results show that cvrip can get competitive exploration coverage compared to traditional approaches. This suggests visual GUI ripping is a direction worthy of more future studies. [ABSTRACT FROM AUTHOR] |
|
Copyright of Journal of Software: Evolution & Process is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) |
| Database: |
Academic Search Complete |
