FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W2954451301> ?p ?o ?g. }

• W2954451301 abstract "Code completion is commonly used by software developers and is integrated into all major IDE's. Good completion tools can not only save time and effort but may also help avoid incorrect API usage. Many proposed completion tools have shown promising results on synthetic benchmarks, but these benchmarks make no claims about the realism of the completions they test. This lack of grounding in real-world data could hinder our scientific understanding of developer needs and of the efficacy of completion models. This paper presents a case study on 15,000 code completions that were applied by 66 real developers, which we study and contrast with artificial completions to inform future research and tools in this area. We find that synthetic benchmarks misrepresent many aspects of real-world completions; tested completion tools were far less accurate on real-world data. Worse, on the few completions that consumed most of the developers' time, prediction accuracy was less than 20% -- an effect that is invisible in synthetic benchmarks. Our findings have ramifications for future benchmarks, tool design and real-world efficacy: Benchmarks must account for completions that developers use most, such as intra-project APIs; models should be designed to be amenable to intra-project data; and real-world developer trials are essential to quantifying performance on the least predictable completions, which are both most time-consuming and far more typical than artificial data suggests. We publicly release our preprint [https://doi.org/10.5281/zenodo.2565673] and replication data and materials [https://doi.org/10.5281/zenodo.2562249]." @default.
• W2954451301 created "2019-07-12" @default.
• W2954451301 creator A5003806730 @default.
• W2954451301 creator A5009436227 @default.
• W2954451301 creator A5009679905 @default.
• W2954451301 creator A5082720005 @default.
• W2954451301 date "2019-05-01" @default.
• W2954451301 modified "2023-10-05" @default.
• W2954451301 title "When Code Completion Fails: A Case Study on Real-World Completions" @default.
• W2954451301 cites W1771830246 @default.
• W2954451301 cites W1970607969 @default.
• W2954451301 cites W1994573369 @default.
• W2954451301 cites W2000897699 @default.
• W2954451301 cites W2007431958 @default.
• W2954451301 cites W2068050408 @default.
• W2954451301 cites W2145373440 @default.
• W2954451301 cites W2165747537 @default.
• W2954451301 cites W2166597811 @default.
• W2954451301 cites W2266912522 @default.
• W2954451301 cites W2405053756 @default.
• W2954451301 cites W2463375504 @default.
• W2954451301 cites W2509810107 @default.
• W2954451301 cites W2548165777 @default.
• W2954451301 cites W2602795167 @default.
• W2954451301 cites W2740130862 @default.
• W2954451301 cites W2741371834 @default.
• W2954451301 cites W2771971885 @default.
• W2954451301 cites W2884670025 @default.
• W2954451301 cites W2963324947 @default.
• W2954451301 cites W3005855585 @default.
• W2954451301 cites W3146720657 @default.
• W2954451301 cites W4213053623 @default.
• W2954451301 cites W4232728046 @default.
• W2954451301 cites W4245415816 @default.
• W2954451301 doi "https://doi.org/10.1109/icse.2019.00101" @default.
• W2954451301 hasPublicationYear "2019" @default.
• W2954451301 type Work @default.
• W2954451301 sameAs 2954451301 @default.
• W2954451301 citedByCount "44" @default.
• W2954451301 countsByYear W29544513012019 @default.
• W2954451301 countsByYear W29544513012020 @default.
• W2954451301 countsByYear W29544513012021 @default.
• W2954451301 countsByYear W29544513012022 @default.
• W2954451301 countsByYear W29544513012023 @default.
• W2954451301 crossrefType "proceedings-article" @default.
• W2954451301 hasAuthorship W2954451301A5003806730 @default.
• W2954451301 hasAuthorship W2954451301A5009436227 @default.
• W2954451301 hasAuthorship W2954451301A5009679905 @default.
• W2954451301 hasAuthorship W2954451301A5082720005 @default.
• W2954451301 hasBestOaLocation W29544513012 @default.
• W2954451301 hasConcept C115903868 @default.
• W2954451301 hasConcept C137287247 @default.
• W2954451301 hasConcept C150292731 @default.
• W2954451301 hasConcept C177264268 @default.
• W2954451301 hasConcept C199360897 @default.
• W2954451301 hasConcept C2522767166 @default.
• W2954451301 hasConcept C2776760102 @default.
• W2954451301 hasConcept C2777904410 @default.
• W2954451301 hasConcept C3020493868 @default.
• W2954451301 hasConcept C41008148 @default.
• W2954451301 hasConcept C529173508 @default.
• W2954451301 hasConceptScore W2954451301C115903868 @default.
• W2954451301 hasConceptScore W2954451301C137287247 @default.
• W2954451301 hasConceptScore W2954451301C150292731 @default.
• W2954451301 hasConceptScore W2954451301C177264268 @default.
• W2954451301 hasConceptScore W2954451301C199360897 @default.
• W2954451301 hasConceptScore W2954451301C2522767166 @default.
• W2954451301 hasConceptScore W2954451301C2776760102 @default.
• W2954451301 hasConceptScore W2954451301C2777904410 @default.
• W2954451301 hasConceptScore W2954451301C3020493868 @default.
• W2954451301 hasConceptScore W2954451301C41008148 @default.
• W2954451301 hasConceptScore W2954451301C529173508 @default.
• W2954451301 hasLocation W29544513011 @default.
• W2954451301 hasLocation W29544513012 @default.
• W2954451301 hasOpenAccess W2954451301 @default.
• W2954451301 hasPrimaryLocation W29544513011 @default.
• W2954451301 hasRelatedWork W2035851665 @default.
• W2954451301 hasRelatedWork W2036487649 @default.
• W2954451301 hasRelatedWork W2093432410 @default.
• W2954451301 hasRelatedWork W2241611286 @default.
• W2954451301 hasRelatedWork W2271843438 @default.
• W2954451301 hasRelatedWork W2587986437 @default.
• W2954451301 hasRelatedWork W2791928022 @default.
• W2954451301 hasRelatedWork W4295797354 @default.
• W2954451301 hasRelatedWork W4313330935 @default.
• W2954451301 hasRelatedWork W4385489206 @default.
• W2954451301 isParatext "false" @default.
• W2954451301 isRetracted "false" @default.
• W2954451301 magId "2954451301" @default.
• W2954451301 workType "article" @default.