Matches in SemOpenAlex for { <https://semopenalex.org/work/W4223627220> ?p ?o ?g. }
Showing items 1 to 81 of
81
with 100 items per page.
- W4223627220 endingPage "1276" @default.
- W4223627220 startingPage "1276" @default.
- W4223627220 abstract "A natural language processing system can realize effective communication between human and computer with natural language. Because its evaluation method relies on a large amount of labeled data and human judgment, the question of how to systematically evaluate its quality is still a challenging task. In this article, we use metamorphic testing technology to evaluate natural language processing systems from the user’s perspective to help users better understand the functionalities of these systems and then select the appropriate natural language processing system according to their specific needs. We have defined three metamorphic relation patterns. These metamorphic relation patterns respectively focus on some characteristics of different aspects of natural language processing. Moreover, on this basis, we defined seven metamorphic relations and chose three tasks (text similarity, text summarization, and text classification) to evaluate the quality of the system. Chinese is used as target language. We extended the defined abstract metamorphic relations to these tasks, and seven specific metamorphic relations were generated for each task. Then, we judged whether the metamorphic relations were satisfied for each task, and used them to evaluate the quality and robustness of the natural language processing system without reference output. We further applied the metamorphic test to three mainstream natural language processing systems (including BaiduCloud API, AliCloud API, and TencentCloud API), and on the PWAS-X datasets, LCSTS datasets, and THUCNews datasets. Experiments were carried out, revealing the advantages and disadvantages of each system. These results further show that the metamorphic test can effectively test the natural language processing system without annotated data." @default.
- W4223627220 created "2022-04-15" @default.
- W4223627220 creator A5007152671 @default.
- W4223627220 creator A5023468618 @default.
- W4223627220 creator A5077615805 @default.
- W4223627220 date "2022-04-12" @default.
- W4223627220 modified "2023-10-03" @default.
- W4223627220 title "Evaluation of Chinese Natural Language Processing System Based on Metamorphic Testing" @default.
- W4223627220 cites W2041713059 @default.
- W4223627220 cites W2045929671 @default.
- W4223627220 cites W2053463056 @default.
- W4223627220 cites W2278131208 @default.
- W4223627220 cites W2293505944 @default.
- W4223627220 cites W2317879529 @default.
- W4223627220 cites W2324595780 @default.
- W4223627220 cites W2782311202 @default.
- W4223627220 cites W2803483156 @default.
- W4223627220 cites W2896505116 @default.
- W4223627220 cites W2912327653 @default.
- W4223627220 cites W2955548841 @default.
- W4223627220 cites W3015001695 @default.
- W4223627220 cites W3016889634 @default.
- W4223627220 cites W3047189009 @default.
- W4223627220 cites W3080956857 @default.
- W4223627220 cites W3105625590 @default.
- W4223627220 cites W3126896034 @default.
- W4223627220 cites W3128630643 @default.
- W4223627220 cites W3140611135 @default.
- W4223627220 cites W3142064846 @default.
- W4223627220 cites W3201484072 @default.
- W4223627220 cites W3214162883 @default.
- W4223627220 cites W4200204829 @default.
- W4223627220 cites W4206390933 @default.
- W4223627220 cites W4244952642 @default.
- W4223627220 cites W4254332277 @default.
- W4223627220 doi "https://doi.org/10.3390/math10081276" @default.
- W4223627220 hasPublicationYear "2022" @default.
- W4223627220 type Work @default.
- W4223627220 citedByCount "0" @default.
- W4223627220 crossrefType "journal-article" @default.
- W4223627220 hasAuthorship W4223627220A5007152671 @default.
- W4223627220 hasAuthorship W4223627220A5023468618 @default.
- W4223627220 hasAuthorship W4223627220A5077615805 @default.
- W4223627220 hasBestOaLocation W42236272201 @default.
- W4223627220 hasConcept C127413603 @default.
- W4223627220 hasConcept C154945302 @default.
- W4223627220 hasConcept C170858558 @default.
- W4223627220 hasConcept C195324797 @default.
- W4223627220 hasConcept C201995342 @default.
- W4223627220 hasConcept C204321447 @default.
- W4223627220 hasConcept C2780451532 @default.
- W4223627220 hasConcept C41008148 @default.
- W4223627220 hasConceptScore W4223627220C127413603 @default.
- W4223627220 hasConceptScore W4223627220C154945302 @default.
- W4223627220 hasConceptScore W4223627220C170858558 @default.
- W4223627220 hasConceptScore W4223627220C195324797 @default.
- W4223627220 hasConceptScore W4223627220C201995342 @default.
- W4223627220 hasConceptScore W4223627220C204321447 @default.
- W4223627220 hasConceptScore W4223627220C2780451532 @default.
- W4223627220 hasConceptScore W4223627220C41008148 @default.
- W4223627220 hasIssue "8" @default.
- W4223627220 hasLocation W42236272201 @default.
- W4223627220 hasLocation W42236272202 @default.
- W4223627220 hasOpenAccess W4223627220 @default.
- W4223627220 hasPrimaryLocation W42236272201 @default.
- W4223627220 hasRelatedWork W159132833 @default.
- W4223627220 hasRelatedWork W2058609994 @default.
- W4223627220 hasRelatedWork W2293457016 @default.
- W4223627220 hasRelatedWork W2346234991 @default.
- W4223627220 hasRelatedWork W2977842567 @default.
- W4223627220 hasRelatedWork W3016100672 @default.
- W4223627220 hasRelatedWork W3105439152 @default.
- W4223627220 hasRelatedWork W3135053409 @default.
- W4223627220 hasRelatedWork W4381735088 @default.
- W4223627220 hasRelatedWork W1872130062 @default.
- W4223627220 hasVolume "10" @default.
- W4223627220 isParatext "false" @default.
- W4223627220 isRetracted "false" @default.
- W4223627220 workType "article" @default.