Matches in SemOpenAlex for { <https://semopenalex.org/work/W4287330090> ?p ?o ?g. }
Showing items 1 to 64 of
64
with 100 items per page.
- W4287330090 abstract "There is a growing desire to create computer systems that can communicate effectively to collaborate with humans on complex, open-ended activities. Assessing these systems presents significant challenges. We describe a framework for evaluating systems engaged in open-ended complex scenarios where evaluators do not have the luxury of comparing performance to a single right answer. This framework has been used to evaluate human-machine creative collaborations across story and music generation, interactive block building, and exploration of molecular mechanisms in cancer. These activities are fundamentally different from the more constrained tasks performed by most contemporary personal assistants as they are generally open-ended, with no single correct solution, and often no obvious completion criteria. We identified the Key Properties that must be exhibited by successful systems. From there we identified Hallmarks of success -- capabilities and features that evaluators can observe that would be indicative of progress toward achieving a Key Property. In addition to being a framework for assessment, the Key Properties and Hallmarks are intended to serve as goals in guiding research direction." @default.
- W4287330090 created "2022-07-25" @default.
- W4287330090 creator A5013883572 @default.
- W4287330090 creator A5015172675 @default.
- W4287330090 creator A5019047051 @default.
- W4287330090 creator A5024312507 @default.
- W4287330090 creator A5033456240 @default.
- W4287330090 creator A5038133550 @default.
- W4287330090 creator A5039745802 @default.
- W4287330090 creator A5068115280 @default.
- W4287330090 creator A5086629705 @default.
- W4287330090 date "2021-02-09" @default.
- W4287330090 modified "2023-09-26" @default.
- W4287330090 title "Hallmarks of Human-Machine Collaboration: A framework for assessment in the DARPA Communicating with Computers Program" @default.
- W4287330090 doi "https://doi.org/10.48550/arxiv.2102.04958" @default.
- W4287330090 hasPublicationYear "2021" @default.
- W4287330090 type Work @default.
- W4287330090 citedByCount "1" @default.
- W4287330090 countsByYear W42873300902022 @default.
- W4287330090 crossrefType "posted-content" @default.
- W4287330090 hasAuthorship W4287330090A5013883572 @default.
- W4287330090 hasAuthorship W4287330090A5015172675 @default.
- W4287330090 hasAuthorship W4287330090A5019047051 @default.
- W4287330090 hasAuthorship W4287330090A5024312507 @default.
- W4287330090 hasAuthorship W4287330090A5033456240 @default.
- W4287330090 hasAuthorship W4287330090A5038133550 @default.
- W4287330090 hasAuthorship W4287330090A5039745802 @default.
- W4287330090 hasAuthorship W4287330090A5068115280 @default.
- W4287330090 hasAuthorship W4287330090A5086629705 @default.
- W4287330090 hasBestOaLocation W42873300901 @default.
- W4287330090 hasConcept C107457646 @default.
- W4287330090 hasConcept C2522767166 @default.
- W4287330090 hasConcept C2524010 @default.
- W4287330090 hasConcept C26517878 @default.
- W4287330090 hasConcept C2777210771 @default.
- W4287330090 hasConcept C33923547 @default.
- W4287330090 hasConcept C38652104 @default.
- W4287330090 hasConcept C41008148 @default.
- W4287330090 hasConcept C56739046 @default.
- W4287330090 hasConceptScore W4287330090C107457646 @default.
- W4287330090 hasConceptScore W4287330090C2522767166 @default.
- W4287330090 hasConceptScore W4287330090C2524010 @default.
- W4287330090 hasConceptScore W4287330090C26517878 @default.
- W4287330090 hasConceptScore W4287330090C2777210771 @default.
- W4287330090 hasConceptScore W4287330090C33923547 @default.
- W4287330090 hasConceptScore W4287330090C38652104 @default.
- W4287330090 hasConceptScore W4287330090C41008148 @default.
- W4287330090 hasConceptScore W4287330090C56739046 @default.
- W4287330090 hasLocation W42873300901 @default.
- W4287330090 hasOpenAccess W4287330090 @default.
- W4287330090 hasPrimaryLocation W42873300901 @default.
- W4287330090 hasRelatedWork W1573834753 @default.
- W4287330090 hasRelatedWork W2355862304 @default.
- W4287330090 hasRelatedWork W2356380379 @default.
- W4287330090 hasRelatedWork W2363925233 @default.
- W4287330090 hasRelatedWork W2364562957 @default.
- W4287330090 hasRelatedWork W2369051458 @default.
- W4287330090 hasRelatedWork W2379285345 @default.
- W4287330090 hasRelatedWork W2379418341 @default.
- W4287330090 hasRelatedWork W2381255005 @default.
- W4287330090 hasRelatedWork W3027915305 @default.
- W4287330090 isParatext "false" @default.
- W4287330090 isRetracted "false" @default.
- W4287330090 workType "article" @default.