Matches in SemOpenAlex for { <https://semopenalex.org/work/W4300537360> ?p ?o ?g. }
Showing items 1 to 61 of
61
with 100 items per page.
- W4300537360 abstract "We study the problem of identifying correlations in multivariate data, under information constraints: Either on the amount of memory that can be used by the algorithm, or the amount of communication when the data is distributed across several machines. We prove a tight trade-off between the memory/communication complexity and the sample complexity, implying (for example) that to detect pairwise correlations with optimal sample complexity, the number of required memory/communication bits is at least quadratic in the dimension. Our results substantially improve those of Shamir [2014], which studied a similar question in a much more restricted setting. To the best of our knowledge, these are the first provable sample/memory/communication trade-offs for a practical estimation problem, using standard distributions, and in the natural regime where the memory/communication budget is larger than the size of a single data point. To derive our theorems, we prove a new information-theoretic result, which may be relevant for studying other information-constrained learning problems." @default.
- W4300537360 created "2022-10-03" @default.
- W4300537360 creator A5017753135 @default.
- W4300537360 creator A5036969610 @default.
- W4300537360 date "2018-03-04" @default.
- W4300537360 modified "2023-10-17" @default.
- W4300537360 title "Detecting Correlations with Little Memory and Communication" @default.
- W4300537360 doi "https://doi.org/10.48550/arxiv.1803.01420" @default.
- W4300537360 hasPublicationYear "2018" @default.
- W4300537360 type Work @default.
- W4300537360 citedByCount "0" @default.
- W4300537360 crossrefType "posted-content" @default.
- W4300537360 hasAuthorship W4300537360A5017753135 @default.
- W4300537360 hasAuthorship W4300537360A5036969610 @default.
- W4300537360 hasBestOaLocation W43005373601 @default.
- W4300537360 hasConcept C129844170 @default.
- W4300537360 hasConcept C154945302 @default.
- W4300537360 hasConcept C179145077 @default.
- W4300537360 hasConcept C184898388 @default.
- W4300537360 hasConcept C185592680 @default.
- W4300537360 hasConcept C198531522 @default.
- W4300537360 hasConcept C202444582 @default.
- W4300537360 hasConcept C2524010 @default.
- W4300537360 hasConcept C2778445095 @default.
- W4300537360 hasConcept C28719098 @default.
- W4300537360 hasConcept C33676613 @default.
- W4300537360 hasConcept C33923547 @default.
- W4300537360 hasConcept C41008148 @default.
- W4300537360 hasConcept C43617362 @default.
- W4300537360 hasConcept C80444323 @default.
- W4300537360 hasConceptScore W4300537360C129844170 @default.
- W4300537360 hasConceptScore W4300537360C154945302 @default.
- W4300537360 hasConceptScore W4300537360C179145077 @default.
- W4300537360 hasConceptScore W4300537360C184898388 @default.
- W4300537360 hasConceptScore W4300537360C185592680 @default.
- W4300537360 hasConceptScore W4300537360C198531522 @default.
- W4300537360 hasConceptScore W4300537360C202444582 @default.
- W4300537360 hasConceptScore W4300537360C2524010 @default.
- W4300537360 hasConceptScore W4300537360C2778445095 @default.
- W4300537360 hasConceptScore W4300537360C28719098 @default.
- W4300537360 hasConceptScore W4300537360C33676613 @default.
- W4300537360 hasConceptScore W4300537360C33923547 @default.
- W4300537360 hasConceptScore W4300537360C41008148 @default.
- W4300537360 hasConceptScore W4300537360C43617362 @default.
- W4300537360 hasConceptScore W4300537360C80444323 @default.
- W4300537360 hasLocation W43005373601 @default.
- W4300537360 hasOpenAccess W4300537360 @default.
- W4300537360 hasPrimaryLocation W43005373601 @default.
- W4300537360 hasRelatedWork W195393342 @default.
- W4300537360 hasRelatedWork W2082455413 @default.
- W4300537360 hasRelatedWork W2396728331 @default.
- W4300537360 hasRelatedWork W2465504090 @default.
- W4300537360 hasRelatedWork W2899993248 @default.
- W4300537360 hasRelatedWork W2963252158 @default.
- W4300537360 hasRelatedWork W2964016574 @default.
- W4300537360 hasRelatedWork W3105624231 @default.
- W4300537360 hasRelatedWork W3172735654 @default.
- W4300537360 hasRelatedWork W4292448171 @default.
- W4300537360 isParatext "false" @default.
- W4300537360 isRetracted "false" @default.
- W4300537360 workType "article" @default.