Matches in SemOpenAlex for { <https://semopenalex.org/work/W3095526172> ?p ?o ?g. }
- W3095526172 abstract "K-Nearest Neighbor (k-NN) search is one of the most commonly used approaches for similarity search. It finds extensive applications in machine learning and data mining. This era of big data warrants efficiently scaling k-NN search algorithms for billion-scale datasets with high dimensionality. In this paper, we propose a solution towards this end where we use vantage point trees for partitioning the dataset across multiple processes and exploit an existing graph-based sequential approximate k-NN search algorithm called HNSW (Hierarchical Navigable Small World) for searching locally within a process. Our hybrid MPI-OpenMP solution employs techniques including exploiting MPI one-sided communication for reducing communication times and partition replication for better load balancing across processes. We demonstrate computation of k-NN for 10,000 queries in the order of seconds using our approach on ~8000 cores on a dataset with billion points in an 128-dimensional space. We also show 10X speedup over a completely k-d tree-based solution for the same dataset, thus demonstrating better suitability of our solution for high dimensional datasets. Our solution shows almost linear strong scaling." @default.
- W3095526172 created "2020-11-09" @default.
- W3095526172 creator A5024084583 @default.
- W3095526172 creator A5078057384 @default.
- W3095526172 date "2020-09-01" @default.
- W3095526172 modified "2023-09-25" @default.
- W3095526172 title "Fast Scalable Approximate Nearest Neighbor Search for High-dimensional Data" @default.
- W3095526172 cites W2042486644 @default.
- W3095526172 cites W2070991879 @default.
- W3095526172 cites W2086179657 @default.
- W3095526172 cites W2114668036 @default.
- W3095526172 cites W2124509324 @default.
- W3095526172 cites W2132234208 @default.
- W3095526172 cites W2147717514 @default.
- W3095526172 cites W2506103507 @default.
- W3095526172 cites W2805874993 @default.
- W3095526172 cites W2941167638 @default.
- W3095526172 cites W2963213349 @default.
- W3095526172 cites W2984806015 @default.
- W3095526172 cites W3169291629 @default.
- W3095526172 doi "https://doi.org/10.1109/cluster49012.2020.00040" @default.
- W3095526172 hasPublicationYear "2020" @default.
- W3095526172 type Work @default.
- W3095526172 sameAs 3095526172 @default.
- W3095526172 citedByCount "2" @default.
- W3095526172 countsByYear W30955261722021 @default.
- W3095526172 countsByYear W30955261722023 @default.
- W3095526172 crossrefType "proceedings-article" @default.
- W3095526172 hasAuthorship W3095526172A5024084583 @default.
- W3095526172 hasAuthorship W3095526172A5078057384 @default.
- W3095526172 hasConcept C111030470 @default.
- W3095526172 hasConcept C113238511 @default.
- W3095526172 hasConcept C11413529 @default.
- W3095526172 hasConcept C114614502 @default.
- W3095526172 hasConcept C116738811 @default.
- W3095526172 hasConcept C124101348 @default.
- W3095526172 hasConcept C132525143 @default.
- W3095526172 hasConcept C13670688 @default.
- W3095526172 hasConcept C138959212 @default.
- W3095526172 hasConcept C154945302 @default.
- W3095526172 hasConcept C165696696 @default.
- W3095526172 hasConcept C173608175 @default.
- W3095526172 hasConcept C187691185 @default.
- W3095526172 hasConcept C2524010 @default.
- W3095526172 hasConcept C33923547 @default.
- W3095526172 hasConcept C38652104 @default.
- W3095526172 hasConcept C41008148 @default.
- W3095526172 hasConcept C42812 @default.
- W3095526172 hasConcept C45374587 @default.
- W3095526172 hasConcept C48044578 @default.
- W3095526172 hasConcept C48903430 @default.
- W3095526172 hasConcept C68339613 @default.
- W3095526172 hasConcept C70518039 @default.
- W3095526172 hasConcept C75684735 @default.
- W3095526172 hasConcept C77088390 @default.
- W3095526172 hasConcept C80444323 @default.
- W3095526172 hasConcept C99844830 @default.
- W3095526172 hasConceptScore W3095526172C111030470 @default.
- W3095526172 hasConceptScore W3095526172C113238511 @default.
- W3095526172 hasConceptScore W3095526172C11413529 @default.
- W3095526172 hasConceptScore W3095526172C114614502 @default.
- W3095526172 hasConceptScore W3095526172C116738811 @default.
- W3095526172 hasConceptScore W3095526172C124101348 @default.
- W3095526172 hasConceptScore W3095526172C132525143 @default.
- W3095526172 hasConceptScore W3095526172C13670688 @default.
- W3095526172 hasConceptScore W3095526172C138959212 @default.
- W3095526172 hasConceptScore W3095526172C154945302 @default.
- W3095526172 hasConceptScore W3095526172C165696696 @default.
- W3095526172 hasConceptScore W3095526172C173608175 @default.
- W3095526172 hasConceptScore W3095526172C187691185 @default.
- W3095526172 hasConceptScore W3095526172C2524010 @default.
- W3095526172 hasConceptScore W3095526172C33923547 @default.
- W3095526172 hasConceptScore W3095526172C38652104 @default.
- W3095526172 hasConceptScore W3095526172C41008148 @default.
- W3095526172 hasConceptScore W3095526172C42812 @default.
- W3095526172 hasConceptScore W3095526172C45374587 @default.
- W3095526172 hasConceptScore W3095526172C48044578 @default.
- W3095526172 hasConceptScore W3095526172C48903430 @default.
- W3095526172 hasConceptScore W3095526172C68339613 @default.
- W3095526172 hasConceptScore W3095526172C70518039 @default.
- W3095526172 hasConceptScore W3095526172C75684735 @default.
- W3095526172 hasConceptScore W3095526172C77088390 @default.
- W3095526172 hasConceptScore W3095526172C80444323 @default.
- W3095526172 hasConceptScore W3095526172C99844830 @default.
- W3095526172 hasLocation W30955261721 @default.
- W3095526172 hasOpenAccess W3095526172 @default.
- W3095526172 hasPrimaryLocation W30955261721 @default.
- W3095526172 hasRelatedWork W1517388762 @default.
- W3095526172 hasRelatedWork W1596527724 @default.
- W3095526172 hasRelatedWork W174302278 @default.
- W3095526172 hasRelatedWork W1768130544 @default.
- W3095526172 hasRelatedWork W185281047 @default.
- W3095526172 hasRelatedWork W2379229450 @default.
- W3095526172 hasRelatedWork W2614681923 @default.
- W3095526172 hasRelatedWork W3028475664 @default.
- W3095526172 hasRelatedWork W2522181209 @default.
- W3095526172 hasRelatedWork W2594787668 @default.
- W3095526172 isParatext "false" @default.
- W3095526172 isRetracted "false" @default.
- W3095526172 magId "3095526172" @default.