Matches in SemOpenAlex for { <https://semopenalex.org/work/W3105261549> ?p ?o ?g. }
Showing items 1 to 88 of
88
with 100 items per page.
- W3105261549 abstract "Has there been real progress in multi-hop question-answering? Models often exploit dataset artifacts to produce correct answers, without connecting information across multiple supporting facts. This limits our ability to measure true progress and defeats the purpose of building multi-hop QA datasets. We make three contributions towards addressing this. First, we formalize such undesirable behavior as disconnected reasoning across subsets of supporting facts. This allows developing a model-agnostic probe for measuring how much any model can cheat via disconnected reasoning. Second, using a notion of emph{contrastive support sufficiency}, we introduce an automatic transformation of existing datasets that reduces the amount of disconnected reasoning. Third, our experiments suggest that there hasn't been much progress in multi-hop QA in the reading comprehension setting. For a recent large-scale model (XLNet), we show that only 18 points out of its answer F1 score of 72 on HotpotQA are obtained through multifact reasoning, roughly the same as that of a simpler RNN baseline. Our transformation substantially reduces disconnected reasoning (19 points in answer F1). It is complementary to adversarial approaches, yielding further reductions in conjunction." @default.
- W3105261549 created "2020-11-23" @default.
- W3105261549 creator A5025500234 @default.
- W3105261549 creator A5033257344 @default.
- W3105261549 creator A5054069581 @default.
- W3105261549 creator A5077726785 @default.
- W3105261549 date "2020-01-01" @default.
- W3105261549 modified "2023-09-23" @default.
- W3105261549 title "Is Multihop QA in DiRe Condition? Measuring and Reducing Disconnected Reasoning" @default.
- W3105261549 cites W2793978524 @default.
- W3105261549 cites W2804897457 @default.
- W3105261549 cites W2889787757 @default.
- W3105261549 cites W2890894339 @default.
- W3105261549 cites W2942128719 @default.
- W3105261549 cites W2950618399 @default.
- W3105261549 cites W2951328433 @default.
- W3105261549 cites W2951862794 @default.
- W3105261549 cites W2953163841 @default.
- W3105261549 cites W2962736243 @default.
- W3105261549 cites W2962816513 @default.
- W3105261549 cites W2963323070 @default.
- W3105261549 cites W2963341956 @default.
- W3105261549 cites W2963383094 @default.
- W3105261549 cites W2963969878 @default.
- W3105261549 cites W2970597249 @default.
- W3105261549 cites W2974606281 @default.
- W3105261549 cites W2987553933 @default.
- W3105261549 cites W2994934025 @default.
- W3105261549 cites W2995638926 @default.
- W3105261549 cites W2996848635 @default.
- W3105261549 cites W2997759614 @default.
- W3105261549 cites W2998072062 @default.
- W3105261549 cites W3015468748 @default.
- W3105261549 cites W3099876468 @default.
- W3105261549 cites W3105055324 @default.
- W3105261549 doi "https://doi.org/10.18653/v1/2020.emnlp-main.712" @default.
- W3105261549 hasPublicationYear "2020" @default.
- W3105261549 type Work @default.
- W3105261549 sameAs 3105261549 @default.
- W3105261549 citedByCount "11" @default.
- W3105261549 countsByYear W31052615492020 @default.
- W3105261549 countsByYear W31052615492021 @default.
- W3105261549 countsByYear W31052615492022 @default.
- W3105261549 countsByYear W31052615492023 @default.
- W3105261549 crossrefType "proceedings-article" @default.
- W3105261549 hasAuthorship W3105261549A5025500234 @default.
- W3105261549 hasAuthorship W3105261549A5033257344 @default.
- W3105261549 hasAuthorship W3105261549A5054069581 @default.
- W3105261549 hasAuthorship W3105261549A5077726785 @default.
- W3105261549 hasBestOaLocation W31052615491 @default.
- W3105261549 hasConcept C111368507 @default.
- W3105261549 hasConcept C119857082 @default.
- W3105261549 hasConcept C12725497 @default.
- W3105261549 hasConcept C127313418 @default.
- W3105261549 hasConcept C154945302 @default.
- W3105261549 hasConcept C165696696 @default.
- W3105261549 hasConcept C37736160 @default.
- W3105261549 hasConcept C38652104 @default.
- W3105261549 hasConcept C41008148 @default.
- W3105261549 hasConcept C44291984 @default.
- W3105261549 hasConceptScore W3105261549C111368507 @default.
- W3105261549 hasConceptScore W3105261549C119857082 @default.
- W3105261549 hasConceptScore W3105261549C12725497 @default.
- W3105261549 hasConceptScore W3105261549C127313418 @default.
- W3105261549 hasConceptScore W3105261549C154945302 @default.
- W3105261549 hasConceptScore W3105261549C165696696 @default.
- W3105261549 hasConceptScore W3105261549C37736160 @default.
- W3105261549 hasConceptScore W3105261549C38652104 @default.
- W3105261549 hasConceptScore W3105261549C41008148 @default.
- W3105261549 hasConceptScore W3105261549C44291984 @default.
- W3105261549 hasLocation W31052615491 @default.
- W3105261549 hasLocation W31052615492 @default.
- W3105261549 hasOpenAccess W3105261549 @default.
- W3105261549 hasPrimaryLocation W31052615491 @default.
- W3105261549 hasRelatedWork W11155487 @default.
- W3105261549 hasRelatedWork W11196620 @default.
- W3105261549 hasRelatedWork W11658723 @default.
- W3105261549 hasRelatedWork W12052983 @default.
- W3105261549 hasRelatedWork W12196170 @default.
- W3105261549 hasRelatedWork W1365286 @default.
- W3105261549 hasRelatedWork W7407718 @default.
- W3105261549 hasRelatedWork W7585623 @default.
- W3105261549 hasRelatedWork W7598675 @default.
- W3105261549 hasRelatedWork W10255099 @default.
- W3105261549 isParatext "false" @default.
- W3105261549 isRetracted "false" @default.
- W3105261549 magId "3105261549" @default.
- W3105261549 workType "article" @default.