Matches in SemOpenAlex for { <https://semopenalex.org/work/W4379539596> ?p ?o ?g. }
Showing items 1 to 81 of
81
with 100 items per page.
- W4379539596 abstract "Dual encoders have been used for retrieval tasks and representation learning with good results. A standard way to train dual encoders is using a contrastive loss with in-batch negatives. In this work, we propose an improved contrastive learning objective by adding queries or documents from the same encoder towers to the negatives, for which we name it as contrastive loss with SAMe TOwer NEgatives (SamToNe). By evaluating on question answering retrieval benchmarks from MS MARCO and MultiReQA, and heterogenous zero-shot information retrieval benchmarks (BEIR), we demonstrate that SamToNe can effectively improve the retrieval quality for both symmetric and asymmetric dual encoders. By directly probing the embedding spaces of the two encoding towers via the t-SNE algorithm (van der Maaten and Hinton, 2008), we observe that SamToNe ensures the alignment between the embedding spaces from the two encoder towers. Based on the analysis of the embedding distance distributions of the top-$1$ retrieved results, we further explain the efficacy of the method from the perspective of regularisation." @default.
- W4379539596 created "2023-06-07" @default.
- W4379539596 creator A5010232702 @default.
- W4379539596 creator A5013110024 @default.
- W4379539596 creator A5042929783 @default.
- W4379539596 creator A5055241858 @default.
- W4379539596 creator A5064891137 @default.
- W4379539596 creator A5091708404 @default.
- W4379539596 date "2023-06-04" @default.
- W4379539596 modified "2023-10-18" @default.
- W4379539596 title "SamToNe: Improving Contrastive Loss for Dual Encoder Retrieval Models with Same Tower Negatives" @default.
- W4379539596 doi "https://doi.org/10.48550/arxiv.2306.02516" @default.
- W4379539596 hasPublicationYear "2023" @default.
- W4379539596 type Work @default.
- W4379539596 citedByCount "0" @default.
- W4379539596 crossrefType "posted-content" @default.
- W4379539596 hasAuthorship W4379539596A5010232702 @default.
- W4379539596 hasAuthorship W4379539596A5013110024 @default.
- W4379539596 hasAuthorship W4379539596A5042929783 @default.
- W4379539596 hasAuthorship W4379539596A5055241858 @default.
- W4379539596 hasAuthorship W4379539596A5064891137 @default.
- W4379539596 hasAuthorship W4379539596A5091708404 @default.
- W4379539596 hasBestOaLocation W43795395961 @default.
- W4379539596 hasConcept C111919701 @default.
- W4379539596 hasConcept C11413529 @default.
- W4379539596 hasConcept C118505674 @default.
- W4379539596 hasConcept C125411270 @default.
- W4379539596 hasConcept C127413603 @default.
- W4379539596 hasConcept C138885662 @default.
- W4379539596 hasConcept C147176958 @default.
- W4379539596 hasConcept C153180895 @default.
- W4379539596 hasConcept C154945302 @default.
- W4379539596 hasConcept C17744445 @default.
- W4379539596 hasConcept C199539241 @default.
- W4379539596 hasConcept C23123220 @default.
- W4379539596 hasConcept C2776359362 @default.
- W4379539596 hasConcept C2777212361 @default.
- W4379539596 hasConcept C2777831296 @default.
- W4379539596 hasConcept C2780980858 @default.
- W4379539596 hasConcept C41008148 @default.
- W4379539596 hasConcept C41608201 @default.
- W4379539596 hasConcept C41895202 @default.
- W4379539596 hasConcept C80444323 @default.
- W4379539596 hasConcept C94625758 @default.
- W4379539596 hasConceptScore W4379539596C111919701 @default.
- W4379539596 hasConceptScore W4379539596C11413529 @default.
- W4379539596 hasConceptScore W4379539596C118505674 @default.
- W4379539596 hasConceptScore W4379539596C125411270 @default.
- W4379539596 hasConceptScore W4379539596C127413603 @default.
- W4379539596 hasConceptScore W4379539596C138885662 @default.
- W4379539596 hasConceptScore W4379539596C147176958 @default.
- W4379539596 hasConceptScore W4379539596C153180895 @default.
- W4379539596 hasConceptScore W4379539596C154945302 @default.
- W4379539596 hasConceptScore W4379539596C17744445 @default.
- W4379539596 hasConceptScore W4379539596C199539241 @default.
- W4379539596 hasConceptScore W4379539596C23123220 @default.
- W4379539596 hasConceptScore W4379539596C2776359362 @default.
- W4379539596 hasConceptScore W4379539596C2777212361 @default.
- W4379539596 hasConceptScore W4379539596C2777831296 @default.
- W4379539596 hasConceptScore W4379539596C2780980858 @default.
- W4379539596 hasConceptScore W4379539596C41008148 @default.
- W4379539596 hasConceptScore W4379539596C41608201 @default.
- W4379539596 hasConceptScore W4379539596C41895202 @default.
- W4379539596 hasConceptScore W4379539596C80444323 @default.
- W4379539596 hasConceptScore W4379539596C94625758 @default.
- W4379539596 hasLocation W43795395961 @default.
- W4379539596 hasOpenAccess W4379539596 @default.
- W4379539596 hasPrimaryLocation W43795395961 @default.
- W4379539596 hasRelatedWork W2207021851 @default.
- W4379539596 hasRelatedWork W2358489738 @default.
- W4379539596 hasRelatedWork W2364375978 @default.
- W4379539596 hasRelatedWork W2368072106 @default.
- W4379539596 hasRelatedWork W2376805096 @default.
- W4379539596 hasRelatedWork W2394200797 @default.
- W4379539596 hasRelatedWork W2547835662 @default.
- W4379539596 hasRelatedWork W3042306599 @default.
- W4379539596 hasRelatedWork W3126201013 @default.
- W4379539596 hasRelatedWork W4366734021 @default.
- W4379539596 isParatext "false" @default.
- W4379539596 isRetracted "false" @default.
- W4379539596 workType "article" @default.