Matches in SemOpenAlex for { <https://semopenalex.org/work/W4386811614> ?p ?o ?g. }
Showing items 1 to 91 of
91
with 100 items per page.
- W4386811614 endingPage "89" @default.
- W4386811614 startingPage "75" @default.
- W4386811614 abstract "AI models that can recognize and understand the semantics of graphical user interfaces (GUIs) enable a variety of use cases ranging from accessibility to automation. Recent efforts in this domain have pursued the development of a set of foundation models: generic GUI understanding models that can be used off-the-shelf to solve a variety of GUI-related tasks, including ones that they were not trained on. In order to develop such foundation models, meaningful downstream tasks and baselines for GUI-related use cases will be required. In this paper, we present interactive link prediction as a downstream task for GUI understanding models and provide baselines as well as testing tools to effectively and efficiently evaluate predictive GUI understanding models. In interactive link prediction, the task is to predict whether tapping on an element on one screen of a mobile application (source element) navigates the user to a second screen (target screen). If this task is solved sufficiently, it can demonstrate an understanding of the relationship between elements and components across screens and enable various applications in GUI design automation and assistance. To encourage and support research on interactive link prediction, this paper contributes (1) a pre-processed large-scale dataset of links in mobile applications (18,830 links from 5,362 applications) derived from the popular RICO dataset, (2) performance baselines from five heuristic-based and two learning-based GUI understanding models, (3) a small-scale dataset of links in mobile GUI prototypes including ratings from an online study with 36 end-users for out-of-sample testing, and (4) a Figma plugin that can leverage link prediction models to automate and assist mobile GUI prototyping." @default.
- W4386811614 created "2023-09-18" @default.
- W4386811614 creator A5037664911 @default.
- W4386811614 creator A5069432042 @default.
- W4386811614 creator A5086345654 @default.
- W4386811614 date "2023-01-01" @default.
- W4386811614 modified "2023-09-27" @default.
- W4386811614 title "Interactive Link Prediction as a Downstream Task for Foundational GUI Understanding Models" @default.
- W4386811614 cites W2104933073 @default.
- W4386811614 cites W2129874624 @default.
- W4386811614 cites W2148143831 @default.
- W4386811614 cites W2765874585 @default.
- W4386811614 cites W2916286502 @default.
- W4386811614 cites W2943691840 @default.
- W4386811614 cites W3101041928 @default.
- W4386811614 cites W3116323972 @default.
- W4386811614 cites W3120491054 @default.
- W4386811614 cites W3124240085 @default.
- W4386811614 cites W3134648203 @default.
- W4386811614 cites W3163374010 @default.
- W4386811614 cites W3206316161 @default.
- W4386811614 cites W3212872336 @default.
- W4386811614 cites W4200633014 @default.
- W4386811614 cites W4220747226 @default.
- W4386811614 cites W4224981985 @default.
- W4386811614 cites W4225089191 @default.
- W4386811614 cites W4298187317 @default.
- W4386811614 cites W4366549767 @default.
- W4386811614 cites W4366549916 @default.
- W4386811614 doi "https://doi.org/10.1007/978-3-031-42608-7_7" @default.
- W4386811614 hasPublicationYear "2023" @default.
- W4386811614 type Work @default.
- W4386811614 citedByCount "0" @default.
- W4386811614 crossrefType "book-chapter" @default.
- W4386811614 hasAuthorship W4386811614A5037664911 @default.
- W4386811614 hasAuthorship W4386811614A5069432042 @default.
- W4386811614 hasAuthorship W4386811614A5086345654 @default.
- W4386811614 hasConcept C107457646 @default.
- W4386811614 hasConcept C115901376 @default.
- W4386811614 hasConcept C127413603 @default.
- W4386811614 hasConcept C134306372 @default.
- W4386811614 hasConcept C136197465 @default.
- W4386811614 hasConcept C154945302 @default.
- W4386811614 hasConcept C162324750 @default.
- W4386811614 hasConcept C177264268 @default.
- W4386811614 hasConcept C199360897 @default.
- W4386811614 hasConcept C201995342 @default.
- W4386811614 hasConcept C21547014 @default.
- W4386811614 hasConcept C2776207758 @default.
- W4386811614 hasConcept C2780451532 @default.
- W4386811614 hasConcept C33923547 @default.
- W4386811614 hasConcept C36503486 @default.
- W4386811614 hasConcept C37789001 @default.
- W4386811614 hasConcept C41008148 @default.
- W4386811614 hasConcept C78519656 @default.
- W4386811614 hasConceptScore W4386811614C107457646 @default.
- W4386811614 hasConceptScore W4386811614C115901376 @default.
- W4386811614 hasConceptScore W4386811614C127413603 @default.
- W4386811614 hasConceptScore W4386811614C134306372 @default.
- W4386811614 hasConceptScore W4386811614C136197465 @default.
- W4386811614 hasConceptScore W4386811614C154945302 @default.
- W4386811614 hasConceptScore W4386811614C162324750 @default.
- W4386811614 hasConceptScore W4386811614C177264268 @default.
- W4386811614 hasConceptScore W4386811614C199360897 @default.
- W4386811614 hasConceptScore W4386811614C201995342 @default.
- W4386811614 hasConceptScore W4386811614C21547014 @default.
- W4386811614 hasConceptScore W4386811614C2776207758 @default.
- W4386811614 hasConceptScore W4386811614C2780451532 @default.
- W4386811614 hasConceptScore W4386811614C33923547 @default.
- W4386811614 hasConceptScore W4386811614C36503486 @default.
- W4386811614 hasConceptScore W4386811614C37789001 @default.
- W4386811614 hasConceptScore W4386811614C41008148 @default.
- W4386811614 hasConceptScore W4386811614C78519656 @default.
- W4386811614 hasLocation W43868116141 @default.
- W4386811614 hasOpenAccess W4386811614 @default.
- W4386811614 hasPrimaryLocation W43868116141 @default.
- W4386811614 hasRelatedWork W2008263938 @default.
- W4386811614 hasRelatedWork W2010777911 @default.
- W4386811614 hasRelatedWork W2031527081 @default.
- W4386811614 hasRelatedWork W2065717829 @default.
- W4386811614 hasRelatedWork W2081647779 @default.
- W4386811614 hasRelatedWork W2108259008 @default.
- W4386811614 hasRelatedWork W2155378790 @default.
- W4386811614 hasRelatedWork W2989714914 @default.
- W4386811614 hasRelatedWork W3213382954 @default.
- W4386811614 hasRelatedWork W4381247876 @default.
- W4386811614 isParatext "false" @default.
- W4386811614 isRetracted "false" @default.
- W4386811614 workType "book-chapter" @default.