Matches in SemOpenAlex for { <https://semopenalex.org/work/W4366999773> ?p ?o ?g. }
Showing items 1 to 95 of
95
with 100 items per page.
- W4366999773 abstract "The capability of Large Language Models (LLMs) like ChatGPT to comprehend user intent and provide reasonable responses has made them extremely popular lately. In this paper, we focus on assessing the overall ability of ChatGPT using 7 fine-grained information extraction (IE) tasks. Specially, we present the systematically analysis by measuring ChatGPT's performance, explainability, calibration, and faithfulness, and resulting in 15 keys from either the ChatGPT or domain experts. Our findings reveal that ChatGPT's performance in Standard-IE setting is poor, but it surprisingly exhibits excellent performance in the OpenIE setting, as evidenced by human evaluation. In addition, our research indicates that ChatGPT provides high-quality and trustworthy explanations for its decisions. However, there is an issue of ChatGPT being overconfident in its predictions, which resulting in low calibration. Furthermore, ChatGPT demonstrates a high level of faithfulness to the original text in the majority of cases. We manually annotate and release the test sets of 7 fine-grained IE tasks contains 14 datasets to further promote the research. The datasets and code are available at https://github.com/pkuserc/ChatGPT_for_IE." @default.
- W4366999773 created "2023-04-27" @default.
- W4366999773 creator A5005674481 @default.
- W4366999773 creator A5021257547 @default.
- W4366999773 creator A5034995105 @default.
- W4366999773 creator A5041407568 @default.
- W4366999773 creator A5049692788 @default.
- W4366999773 creator A5078949281 @default.
- W4366999773 creator A5081676218 @default.
- W4366999773 date "2023-04-23" @default.
- W4366999773 modified "2023-09-26" @default.
- W4366999773 title "Evaluating ChatGPT's Information Extraction Capabilities: An Assessment of Performance, Explainability, Calibration, and Faithfulness" @default.
- W4366999773 doi "https://doi.org/10.48550/arxiv.2304.11633" @default.
- W4366999773 hasPublicationYear "2023" @default.
- W4366999773 type Work @default.
- W4366999773 citedByCount "0" @default.
- W4366999773 crossrefType "posted-content" @default.
- W4366999773 hasAuthorship W4366999773A5005674481 @default.
- W4366999773 hasAuthorship W4366999773A5021257547 @default.
- W4366999773 hasAuthorship W4366999773A5034995105 @default.
- W4366999773 hasAuthorship W4366999773A5041407568 @default.
- W4366999773 hasAuthorship W4366999773A5049692788 @default.
- W4366999773 hasAuthorship W4366999773A5078949281 @default.
- W4366999773 hasAuthorship W4366999773A5081676218 @default.
- W4366999773 hasBestOaLocation W43669997731 @default.
- W4366999773 hasConcept C105795698 @default.
- W4366999773 hasConcept C111472728 @default.
- W4366999773 hasConcept C119857082 @default.
- W4366999773 hasConcept C120665830 @default.
- W4366999773 hasConcept C121332964 @default.
- W4366999773 hasConcept C124101348 @default.
- W4366999773 hasConcept C134306372 @default.
- W4366999773 hasConcept C138885662 @default.
- W4366999773 hasConcept C151730666 @default.
- W4366999773 hasConcept C153701036 @default.
- W4366999773 hasConcept C154945302 @default.
- W4366999773 hasConcept C165838908 @default.
- W4366999773 hasConcept C177264268 @default.
- W4366999773 hasConcept C192209626 @default.
- W4366999773 hasConcept C195807954 @default.
- W4366999773 hasConcept C199360897 @default.
- W4366999773 hasConcept C204321447 @default.
- W4366999773 hasConcept C23123220 @default.
- W4366999773 hasConcept C2522767166 @default.
- W4366999773 hasConcept C2776760102 @default.
- W4366999773 hasConcept C2777267654 @default.
- W4366999773 hasConcept C2779530757 @default.
- W4366999773 hasConcept C33923547 @default.
- W4366999773 hasConcept C36503486 @default.
- W4366999773 hasConcept C38652104 @default.
- W4366999773 hasConcept C41008148 @default.
- W4366999773 hasConcept C86803240 @default.
- W4366999773 hasConceptScore W4366999773C105795698 @default.
- W4366999773 hasConceptScore W4366999773C111472728 @default.
- W4366999773 hasConceptScore W4366999773C119857082 @default.
- W4366999773 hasConceptScore W4366999773C120665830 @default.
- W4366999773 hasConceptScore W4366999773C121332964 @default.
- W4366999773 hasConceptScore W4366999773C124101348 @default.
- W4366999773 hasConceptScore W4366999773C134306372 @default.
- W4366999773 hasConceptScore W4366999773C138885662 @default.
- W4366999773 hasConceptScore W4366999773C151730666 @default.
- W4366999773 hasConceptScore W4366999773C153701036 @default.
- W4366999773 hasConceptScore W4366999773C154945302 @default.
- W4366999773 hasConceptScore W4366999773C165838908 @default.
- W4366999773 hasConceptScore W4366999773C177264268 @default.
- W4366999773 hasConceptScore W4366999773C192209626 @default.
- W4366999773 hasConceptScore W4366999773C195807954 @default.
- W4366999773 hasConceptScore W4366999773C199360897 @default.
- W4366999773 hasConceptScore W4366999773C204321447 @default.
- W4366999773 hasConceptScore W4366999773C23123220 @default.
- W4366999773 hasConceptScore W4366999773C2522767166 @default.
- W4366999773 hasConceptScore W4366999773C2776760102 @default.
- W4366999773 hasConceptScore W4366999773C2777267654 @default.
- W4366999773 hasConceptScore W4366999773C2779530757 @default.
- W4366999773 hasConceptScore W4366999773C33923547 @default.
- W4366999773 hasConceptScore W4366999773C36503486 @default.
- W4366999773 hasConceptScore W4366999773C38652104 @default.
- W4366999773 hasConceptScore W4366999773C41008148 @default.
- W4366999773 hasConceptScore W4366999773C86803240 @default.
- W4366999773 hasLocation W43669997731 @default.
- W4366999773 hasOpenAccess W4366999773 @default.
- W4366999773 hasPrimaryLocation W43669997731 @default.
- W4366999773 hasRelatedWork W104581431 @default.
- W4366999773 hasRelatedWork W1488266984 @default.
- W4366999773 hasRelatedWork W1561729373 @default.
- W4366999773 hasRelatedWork W1788528807 @default.
- W4366999773 hasRelatedWork W1975174578 @default.
- W4366999773 hasRelatedWork W2368651715 @default.
- W4366999773 hasRelatedWork W2725657302 @default.
- W4366999773 hasRelatedWork W2916492174 @default.
- W4366999773 hasRelatedWork W3107474891 @default.
- W4366999773 hasRelatedWork W563404 @default.
- W4366999773 isParatext "false" @default.
- W4366999773 isRetracted "false" @default.
- W4366999773 workType "article" @default.