面向GUI代码自动生成的关键技术研究

来源 :浙江理工大学 | 被引量 : 0次 | 上传用户:tonghai0919
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
GUI code generation is a software engineering process that automates the generation of GUI code from GUI images(GUI designs and mockups).As one of the automatic code generation solutions,search-based methods have the advantage of being interpretable and not requiring large amounts of labelled data.These methods involve several sub-tasks such as data preparation,GUI widgets detection and classification,code synthesis and testing.Specifically,data preparation entails gathering and cleaning GUI images from multiple apps to build a dataset for detection and classification tasks.GUI widgets detection entails identifying the bounding boxes of atomic widgets of a user interface from GUI images.The widget classification is essentially an image classification task that entails classifying the identified widgets into their appropriate domain-specific types(e.g.,Button,Progress Bar).Furthermore,code synthesis entails creating a correct hierarchy of classified widgets and detected layouts and translating them into GUI code.GUI testing is important to ensure the quality of the generated GUI code and the complete functionality.Despite the recent development in the GUI code generation techniques,several problems hinder the performance of the existing techniques.These problems include(i)lack of review analysis for GUI code generation and GUI testing literature,(ii)poor dataset,and(iii)much manual effort required to design a widgets classification model.Specifically,for review analysis,several GUI code generation and GUI testing techniques have been proposed to generate GUI code from GUI images and assess the quality of GUI-based apps in the last few years.However,few efforts were made to characterize and understand the GUI code generation and GUI testing domains,particularly for mobile apps.This problem may be an obstacle to new researchers and more research in the area.Also,for the dataset,poor samples,noise and class imbalance are the problems of the existing widgets dataset.Similarly,for widget classification,existing works rely on handcrafted model architecture to classify the widgets.However,designing hand-crafted architecture involves much manual effort and is often prone to error and time-consuming.In order to solve these problems,this thesis proposes a whole set of research schemes.The scheme includes(i)presenting a systematic literature analysis to gain insight into the GUI code generation and GUI testing for mobile apps,(ii)constructing a standard benchmark dataset of labelled widgets,and(iii)proposing an automatic approach to design model architecture for widgets classification.Specifically,for solving review problems,first,a literature analysis is performed to give a review of the existing GUI code generation techniques and an overview of several tasks in the GUI code generation process.Second,a systematic literature analysis is performed again for the GUI testing studies published in the last decade.In this systematic review,an extensive search of relevant literature over seven popular digital libraries was conducted.Next,a careful selection of 86 primary studies published in the last decade from 3,420 candidate studies.Finally,an analysis of these primary studies from bibliometric and qualitative perspectives.For the bibliometric analysis,the popular research topics and their relationships are analyzed.Similarly,the authors’ communities are studied.Also,for the qualitative analysis,the main objective,approaches,and evaluation metrics employed in these primary studies are explicitly analyzed.Moreover,a standard widgets dataset is built with a clean sample and balance class distribution to solve the dataset problem.The standard dataset is built by inspecting and cleaning the large existing GUI widgets dataset.Also,an automated approach,Neural Architecture Search-based Widgets classification(NASW),is proposed to solve the widgets classification problem.NASW uses machine learning techniques to generate a model architecture based on a small prepared sample of labelled standard widgets dataset using Neural Architecture Search(NAS).The generated architecture is trained on a large widget dataset to generate the NASWm classification model.The model NASWm achieves a 5% improvement on multiple metrics.This approach greatly saves the timeconsuming and error-prone task of manually designing an optimal model architecture for GUI widgets classification and improves its performance.In summary,numerous significant findings are presented that might serve as guidance for new researchers and future studies in the domain of GUI testing for mobile apps.Besides,a standard dataset of widgets is built to mitigate the existing dataset problems.Also,for solving widgets classification problems,the thesis proposes an automated approach to generate model architecture automatically that addresses the manual design challenges.
其他文献
<正>一、案例实施背景本节课是2011—2012学年度九年级第一学期在德兴某中学上的一节公开课,授课班数学优生偏少,中等生及学困生较多.所用教材是人教版《数学》九年级上册.二、案例主题分析与设计本节课是人教版数学九年级上册第二十四章第二节直线与圆的关系的内容——切线的判定,是切线的图形特征和数量特征的进一步延续,是"空间与图形"的重要组成部分,是历年中考必考的知识点.
期刊
第二次世界大战以后的西方当代艺术家用直率的绘画方式推出了具象新表现主义艺术,这些作品关注的不再是绘画本身,而是现代生活中的各种图像。艺术家通过生活中目之所及的图像传达自己对人性以及人的生存处境的理解和反思。本文以比利时当代艺术家米歇尔·波利曼斯为研究对象,基于其对个体生活的真实记忆与经历创作出的作品以及他当下的立场和选择问题的角度,即关注绘画中的主题——身体、战争、生命政治等,探究图像背后的社会性
李娟在《遥远的向日葵地》中书写她独特的生命体验,在呈现生活真实面貌的同时也直抒情思。该书出版时以“非虚构写作”之名宣传,但却描写了李娟的心灵体验,心灵体验的个人化与虚构性却使“非虚构”的说法存疑。本文以文本分析的方式,从“非虚构写作”的定义与《遥远的向日葵地》内容上的“虚构”与“真实”出发,探寻李娟书写中的“真实”与“真诚”。
中共中央办公厅、国务院办公厅印发的《关于进一步深化税收征管改革的意见》明确提出,深入推进精确执法、精细服务、精准监管、精诚共治。为纳税人提供精细化、智能化、个性化的纳税服务不仅是进一步深化税收征管改革的核心内容之一,也是持续优化营商环境的应有之义。虽然我国纳税服务工作在近几年取得了长足发展,现代化纳税服务格局已初步形成,但现行税收征管模式仍然欠缺对纳税人维权意识的正确塑造和对纳税人维权机制的系统建
为明晰喀斯特流域土地利用变化对生态系统服务功能的影响,本研究以贵州省典型喀斯特流域——南明河流域为例,基于3S技术,分析南明河流域2000—2020年土地利用的时空动态变化特征,采用InVEST模型并结合气象、土壤和地形等数据评估流域不同土地利用类型的水源涵养功能和碳储存功能,探讨流域20年时间序列下的生态系统服务功能的时空分异特征。结果表明,南明河流域平均水源涵养量和涵养能力分别为1.01×10
文章阐述了天气雷达遮蔽角图及等射束高度图的制作原理和方法,通过说明原始数据的获取步骤,利用“多普勒雷达客观选址软件”绘制遮蔽角图、等射束高度图及等射束高度拼图,分析了此方法对五峰县X波段雷达周围的遮挡情况、探测能力以及对观测盲区的弥补作用,为天气雷达选址方法与雷达探测能力研究提供参考。
<正>数列的递推关系问题,是高中数学中一种十分常见的问题,其思想内涵丰富,具有一定的抽象性与综合性、很强的逻辑性和灵活性.在高考试题中,经常可以看到考查数列递推关系问题,这已成为近几年创新题型的新亮点[1].我们以2022年北京高考数学卷第15题为例来探究.
期刊
水中的砷被认为是最危险的有毒物质之一,处理含砷污水,实现清洁排放是迫切需要解决的环境问题之一。电絮凝法处理含砷污水工艺简单、适用性强、对水中的砷去除效率高,是一种高效除砷的先进技术。本文简述了电絮凝处理含砷污水的原理、优缺点及其适用范围,综述了电絮凝法处理含砷污水常用的电极材料、电极连接方式、反应器类型的技术现状,并对电絮凝法处理含砷污水的发展前景进行了展望。
涉案企业合规改革在企业规模、犯罪主体、罪刑轻重、犯罪类型等适用对象方面的持续扩张,进一步加剧了刑法教义学困境,由此产生了单位刑事归责原则的重构、合规从宽处罚的法定化、涉企犯罪中自然人刑事责任的单独规定等刑法修改方面的刚性需求。企业合规刑事实体法修改完善应确立实质激励立法观,坚持合规正反双向实体法激励、事前合规与事后合规并重、单位和自然人责任相分离的立法原则,采取兼顾制度创新与体系稳定、刑事一体化双
用木聚糖酶对檀皮纤维进行预处理。分析了纤维在处理前后的形貌变化,探究了预处理对檀皮纤维过氧化氢漂白效果的影响。结果表明,木聚糖酶预处理后可有效疏松纤维结构,提高漂剂可及性。在最优工艺条件下,檀皮纤维经过氧化氢漂白后,白度可达82.7%ISO,返黄值为0.22,纤维零距抗张强度为60 N·cm-1。最优工艺条件为:pH值5.0,浆浓10%,酶用量10~15 U·g-1,温度40~45℃,预处理时间为