Matches in SemOpenAlex for { <https://semopenalex.org/work/W2945408528> ?p ?o ?g. }
- W2945408528 endingPage "580" @default.
- W2945408528 startingPage "564" @default.
- W2945408528 abstract "Leveraging the depth and breadth of solutions generated through crowdsourcing can be a powerful accelerator to method development for high consequence problems. While data competitions have become quite popular and prevalent, particularly in supervised learning formats, their implementations by the host are highly variable. Without careful planning, a supervised learning competition is vulnerable to overfitting, where the winning solutions are so closely tuned to the particular set of provided data that they cannot generalize to the general underlying problem of interest to the host. This article outlines important considerations for strategically designing relevant and informative data sets to maximize the learning outcome from hosting a competition. These include: 1. precisely defining the scope of the problem, 2. encouraging participation by competitors from diverse technical backgrounds, 3. specifying the most interesting solution space in order to encourage improvement and distinguish between competitors, 4. strategically generating data sets that enable testing for interpolation and extrapolation to new scenarios of interest, 5. leveraging design of experiment principles for strategic data design while preventing unintentional artifacts in the competition data sets that competitors could exploit without addressing the real problem of interest, and 6. carefully designing the leaderboard scoring metric to select top solutions that closely match the overall competition goals. The methods are illustrated with a recently completed competition in the context of urban radiological search to evaluate algorithms capable of detecting, identifying, and locating radioactive materials. Simulated data were used in the urban search competition. Ideas for using measured real data in competitions are also suggested." @default.
- W2945408528 created "2019-05-29" @default.
- W2945408528 creator A5000860082 @default.
- W2945408528 creator A5030429211 @default.
- W2945408528 creator A5035506669 @default.
- W2945408528 creator A5062389706 @default.
- W2945408528 creator A5073731009 @default.
- W2945408528 date "2019-05-20" @default.
- W2945408528 modified "2023-10-16" @default.
- W2945408528 title "Improved learning from data competitions through strategic design of training and test data sets" @default.
- W2945408528 cites W1479807131 @default.
- W2945408528 cites W1968098666 @default.
- W2945408528 cites W1974904263 @default.
- W2945408528 cites W2007403273 @default.
- W2945408528 cites W2053500106 @default.
- W2945408528 cites W2068512877 @default.
- W2945408528 cites W2142922715 @default.
- W2945408528 cites W2608079528 @default.
- W2945408528 cites W4248606406 @default.
- W2945408528 cites W4249753629 @default.
- W2945408528 doi "https://doi.org/10.1080/08982112.2019.1572186" @default.
- W2945408528 hasPublicationYear "2019" @default.
- W2945408528 type Work @default.
- W2945408528 sameAs 2945408528 @default.
- W2945408528 citedByCount "6" @default.
- W2945408528 countsByYear W29454085282019 @default.
- W2945408528 countsByYear W29454085282020 @default.
- W2945408528 countsByYear W29454085282023 @default.
- W2945408528 crossrefType "journal-article" @default.
- W2945408528 hasAuthorship W2945408528A5000860082 @default.
- W2945408528 hasAuthorship W2945408528A5030429211 @default.
- W2945408528 hasAuthorship W2945408528A5035506669 @default.
- W2945408528 hasAuthorship W2945408528A5062389706 @default.
- W2945408528 hasAuthorship W2945408528A5073731009 @default.
- W2945408528 hasConcept C119857082 @default.
- W2945408528 hasConcept C127413603 @default.
- W2945408528 hasConcept C127576917 @default.
- W2945408528 hasConcept C136764020 @default.
- W2945408528 hasConcept C144133560 @default.
- W2945408528 hasConcept C151730666 @default.
- W2945408528 hasConcept C154945302 @default.
- W2945408528 hasConcept C162853370 @default.
- W2945408528 hasConcept C165696696 @default.
- W2945408528 hasConcept C176217482 @default.
- W2945408528 hasConcept C177264268 @default.
- W2945408528 hasConcept C18903297 @default.
- W2945408528 hasConcept C199360897 @default.
- W2945408528 hasConcept C21547014 @default.
- W2945408528 hasConcept C22019652 @default.
- W2945408528 hasConcept C2522767166 @default.
- W2945408528 hasConcept C2779343474 @default.
- W2945408528 hasConcept C38652104 @default.
- W2945408528 hasConcept C41008148 @default.
- W2945408528 hasConcept C50644808 @default.
- W2945408528 hasConcept C62230096 @default.
- W2945408528 hasConcept C86803240 @default.
- W2945408528 hasConcept C91306197 @default.
- W2945408528 hasConceptScore W2945408528C119857082 @default.
- W2945408528 hasConceptScore W2945408528C127413603 @default.
- W2945408528 hasConceptScore W2945408528C127576917 @default.
- W2945408528 hasConceptScore W2945408528C136764020 @default.
- W2945408528 hasConceptScore W2945408528C144133560 @default.
- W2945408528 hasConceptScore W2945408528C151730666 @default.
- W2945408528 hasConceptScore W2945408528C154945302 @default.
- W2945408528 hasConceptScore W2945408528C162853370 @default.
- W2945408528 hasConceptScore W2945408528C165696696 @default.
- W2945408528 hasConceptScore W2945408528C176217482 @default.
- W2945408528 hasConceptScore W2945408528C177264268 @default.
- W2945408528 hasConceptScore W2945408528C18903297 @default.
- W2945408528 hasConceptScore W2945408528C199360897 @default.
- W2945408528 hasConceptScore W2945408528C21547014 @default.
- W2945408528 hasConceptScore W2945408528C22019652 @default.
- W2945408528 hasConceptScore W2945408528C2522767166 @default.
- W2945408528 hasConceptScore W2945408528C2779343474 @default.
- W2945408528 hasConceptScore W2945408528C38652104 @default.
- W2945408528 hasConceptScore W2945408528C41008148 @default.
- W2945408528 hasConceptScore W2945408528C50644808 @default.
- W2945408528 hasConceptScore W2945408528C62230096 @default.
- W2945408528 hasConceptScore W2945408528C86803240 @default.
- W2945408528 hasConceptScore W2945408528C91306197 @default.
- W2945408528 hasIssue "4" @default.
- W2945408528 hasLocation W29454085281 @default.
- W2945408528 hasLocation W29454085282 @default.
- W2945408528 hasOpenAccess W2945408528 @default.
- W2945408528 hasPrimaryLocation W29454085281 @default.
- W2945408528 hasRelatedWork W1560943167 @default.
- W2945408528 hasRelatedWork W1996541855 @default.
- W2945408528 hasRelatedWork W2044507188 @default.
- W2945408528 hasRelatedWork W2940336242 @default.
- W2945408528 hasRelatedWork W2989932438 @default.
- W2945408528 hasRelatedWork W3099765033 @default.
- W2945408528 hasRelatedWork W3172334777 @default.
- W2945408528 hasRelatedWork W3210112450 @default.
- W2945408528 hasRelatedWork W4210794429 @default.
- W2945408528 hasRelatedWork W4283732135 @default.
- W2945408528 hasVolume "31" @default.
- W2945408528 isParatext "false" @default.
- W2945408528 isRetracted "false" @default.