Matches in SemOpenAlex for { <https://semopenalex.org/work/W2604832008> ?p ?o ?g. }
- W2604832008 abstract "One of the main goals of natural language processing (NLP) is synthetic understanding of natural language documents, especially reading comprehension (RC). An obstacle to the further development of RC systems is the absence of a synthetic methodology to analyze their performance. It is difficult to examine the performance of systems based solely on their results for tasks because the process of natural language understanding is complex. In order to tackle this problem, we propose in this paper a methodology inspired by unit testing in software engineering that enables the examination of RC systems from multiple aspects. Our methodology consists of three steps. First, we define a set of prerequisite skills for RC based on existing NLP tasks. We assume that RC capability can be divided into these skills. Second, we manually annotate a dataset for an RC task with information regarding the skills needed to answer each question. Finally, we analyze the performance of RC systems for each skill based on the annotation. The last two steps highlight two aspects: the characteristics of the dataset, and the weaknesses in and differences among RC systems. We tested the effectiveness of our methodology by annotating the Machine Comprehension Test (MCTest) dataset and analyzing four existing systems (including a neural system) on it. The results of the annotations showed that answering questions requires a combination of skills, and clarified the kinds of capabilities that systems need to understand natural language. We conclude that the set of prerequisite skills we define are promising for the decomposition and analysis of RC." @default.
- W2604832008 created "2017-04-14" @default.
- W2604832008 creator A5036182502 @default.
- W2604832008 creator A5038103607 @default.
- W2604832008 creator A5041062417 @default.
- W2604832008 date "2017-02-12" @default.
- W2604832008 modified "2023-10-02" @default.
- W2604832008 title "Prerequisite Skills for Reading Comprehension: Multi-Perspective Analysis of MCTest Datasets and Systems" @default.
- W2604832008 cites W1525961042 @default.
- W2604832008 cites W1544827683 @default.
- W2604832008 cites W1574440611 @default.
- W2604832008 cites W1599016936 @default.
- W2604832008 cites W1603889988 @default.
- W2604832008 cites W1997897354 @default.
- W2604832008 cites W2013833248 @default.
- W2604832008 cites W2101268022 @default.
- W2604832008 cites W2121300346 @default.
- W2604832008 cites W2125436846 @default.
- W2604832008 cites W2145755360 @default.
- W2604832008 cites W2155069789 @default.
- W2604832008 cites W2161915178 @default.
- W2604832008 cites W2161951443 @default.
- W2604832008 cites W2169954261 @default.
- W2604832008 cites W2250201115 @default.
- W2604832008 cites W2252000379 @default.
- W2604832008 cites W2252016937 @default.
- W2604832008 cites W2293713060 @default.
- W2604832008 cites W2361488420 @default.
- W2604832008 cites W2473344385 @default.
- W2604832008 cites W2566862711 @default.
- W2604832008 cites W2952663767 @default.
- W2604832008 cites W2962809918 @default.
- W2604832008 cites W2963748441 @default.
- W2604832008 cites W2963900105 @default.
- W2604832008 cites W2964267515 @default.
- W2604832008 cites W806995027 @default.
- W2604832008 doi "https://doi.org/10.1609/aaai.v31i1.10957" @default.
- W2604832008 hasPublicationYear "2017" @default.
- W2604832008 type Work @default.
- W2604832008 sameAs 2604832008 @default.
- W2604832008 citedByCount "16" @default.
- W2604832008 countsByYear W26048320082017 @default.
- W2604832008 countsByYear W26048320082018 @default.
- W2604832008 countsByYear W26048320082019 @default.
- W2604832008 countsByYear W26048320082021 @default.
- W2604832008 countsByYear W26048320082022 @default.
- W2604832008 countsByYear W26048320082023 @default.
- W2604832008 crossrefType "journal-article" @default.
- W2604832008 hasAuthorship W2604832008A5036182502 @default.
- W2604832008 hasAuthorship W2604832008A5038103607 @default.
- W2604832008 hasAuthorship W2604832008A5041062417 @default.
- W2604832008 hasBestOaLocation W26048320081 @default.
- W2604832008 hasConcept C12713177 @default.
- W2604832008 hasConcept C127413603 @default.
- W2604832008 hasConcept C154945302 @default.
- W2604832008 hasConcept C177264268 @default.
- W2604832008 hasConcept C17744445 @default.
- W2604832008 hasConcept C195324797 @default.
- W2604832008 hasConcept C199360897 @default.
- W2604832008 hasConcept C199539241 @default.
- W2604832008 hasConcept C201995342 @default.
- W2604832008 hasConcept C204321447 @default.
- W2604832008 hasConcept C2776321320 @default.
- W2604832008 hasConcept C2778780117 @default.
- W2604832008 hasConcept C2780451532 @default.
- W2604832008 hasConcept C41008148 @default.
- W2604832008 hasConcept C44291984 @default.
- W2604832008 hasConcept C511192102 @default.
- W2604832008 hasConcept C554936623 @default.
- W2604832008 hasConcept C98045186 @default.
- W2604832008 hasConceptScore W2604832008C12713177 @default.
- W2604832008 hasConceptScore W2604832008C127413603 @default.
- W2604832008 hasConceptScore W2604832008C154945302 @default.
- W2604832008 hasConceptScore W2604832008C177264268 @default.
- W2604832008 hasConceptScore W2604832008C17744445 @default.
- W2604832008 hasConceptScore W2604832008C195324797 @default.
- W2604832008 hasConceptScore W2604832008C199360897 @default.
- W2604832008 hasConceptScore W2604832008C199539241 @default.
- W2604832008 hasConceptScore W2604832008C201995342 @default.
- W2604832008 hasConceptScore W2604832008C204321447 @default.
- W2604832008 hasConceptScore W2604832008C2776321320 @default.
- W2604832008 hasConceptScore W2604832008C2778780117 @default.
- W2604832008 hasConceptScore W2604832008C2780451532 @default.
- W2604832008 hasConceptScore W2604832008C41008148 @default.
- W2604832008 hasConceptScore W2604832008C44291984 @default.
- W2604832008 hasConceptScore W2604832008C511192102 @default.
- W2604832008 hasConceptScore W2604832008C554936623 @default.
- W2604832008 hasConceptScore W2604832008C98045186 @default.
- W2604832008 hasIssue "1" @default.
- W2604832008 hasLocation W26048320081 @default.
- W2604832008 hasOpenAccess W2604832008 @default.
- W2604832008 hasPrimaryLocation W26048320081 @default.
- W2604832008 hasRelatedWork W207304934 @default.
- W2604832008 hasRelatedWork W2123535355 @default.
- W2604832008 hasRelatedWork W2365088826 @default.
- W2604832008 hasRelatedWork W2381530540 @default.
- W2604832008 hasRelatedWork W2787098303 @default.
- W2604832008 hasRelatedWork W2805599431 @default.
- W2604832008 hasRelatedWork W2970044932 @default.
- W2604832008 hasRelatedWork W3186847946 @default.