Matches in SemOpenAlex for { <https://semopenalex.org/work/W4320167916> ?p ?o ?g. }
Showing items 1 to 67 of
67
with 100 items per page.
- W4320167916 abstract "With the growing workload of inference tasks on mobile devices, state-of-the-art neural architectures (NAs) are typically designed through Neural Architecture Search (NAS) to identify NAs with good tradeoffs between accuracy and efficiency (e.g., latency). Since measuring the latency of a huge set of candidate architectures during NAS is not scalable, approaches are needed for predicting end-to-end inference latency on mobile devices. Such predictions are challenging due to hardware heterogeneity, optimizations applied by ML frameworks, and the diversity of neural architectures. Motivated by these challenges, in this paper, we first quantitatively assess characteristics of neural architectures and mobile devices that have significant effects on inference latency. Based on this assessment, we propose a latency prediction framework which addresses these challenges by developing operation-wise latency predictors, under a variety of settings and a number of hardware devices, with multi-core CPUs and GPUs, achieving high accuracy in end-to-end latency prediction, as shown by our comprehensive evaluations. To illustrate that our approach does not require expensive data collection, we also show that accurate predictions can be achieved on real-world NAs using only small amounts of profiling data." @default.
- W4320167916 created "2023-02-13" @default.
- W4320167916 creator A5013473165 @default.
- W4320167916 creator A5036380703 @default.
- W4320167916 creator A5081582862 @default.
- W4320167916 date "2022-10-05" @default.
- W4320167916 modified "2023-09-29" @default.
- W4320167916 title "Inference Latency Prediction at the Edge" @default.
- W4320167916 doi "https://doi.org/10.48550/arxiv.2210.02620" @default.
- W4320167916 hasPublicationYear "2022" @default.
- W4320167916 type Work @default.
- W4320167916 citedByCount "0" @default.
- W4320167916 crossrefType "posted-content" @default.
- W4320167916 hasAuthorship W4320167916A5013473165 @default.
- W4320167916 hasAuthorship W4320167916A5036380703 @default.
- W4320167916 hasAuthorship W4320167916A5081582862 @default.
- W4320167916 hasBestOaLocation W43201679161 @default.
- W4320167916 hasConcept C111919701 @default.
- W4320167916 hasConcept C113775141 @default.
- W4320167916 hasConcept C118524514 @default.
- W4320167916 hasConcept C119857082 @default.
- W4320167916 hasConcept C120314980 @default.
- W4320167916 hasConcept C154945302 @default.
- W4320167916 hasConcept C186967261 @default.
- W4320167916 hasConcept C187191949 @default.
- W4320167916 hasConcept C2776214188 @default.
- W4320167916 hasConcept C2778476105 @default.
- W4320167916 hasConcept C2984842247 @default.
- W4320167916 hasConcept C41008148 @default.
- W4320167916 hasConcept C48044578 @default.
- W4320167916 hasConcept C50644808 @default.
- W4320167916 hasConcept C76155785 @default.
- W4320167916 hasConcept C79403827 @default.
- W4320167916 hasConcept C82876162 @default.
- W4320167916 hasConceptScore W4320167916C111919701 @default.
- W4320167916 hasConceptScore W4320167916C113775141 @default.
- W4320167916 hasConceptScore W4320167916C118524514 @default.
- W4320167916 hasConceptScore W4320167916C119857082 @default.
- W4320167916 hasConceptScore W4320167916C120314980 @default.
- W4320167916 hasConceptScore W4320167916C154945302 @default.
- W4320167916 hasConceptScore W4320167916C186967261 @default.
- W4320167916 hasConceptScore W4320167916C187191949 @default.
- W4320167916 hasConceptScore W4320167916C2776214188 @default.
- W4320167916 hasConceptScore W4320167916C2778476105 @default.
- W4320167916 hasConceptScore W4320167916C2984842247 @default.
- W4320167916 hasConceptScore W4320167916C41008148 @default.
- W4320167916 hasConceptScore W4320167916C48044578 @default.
- W4320167916 hasConceptScore W4320167916C50644808 @default.
- W4320167916 hasConceptScore W4320167916C76155785 @default.
- W4320167916 hasConceptScore W4320167916C79403827 @default.
- W4320167916 hasConceptScore W4320167916C82876162 @default.
- W4320167916 hasLocation W43201679161 @default.
- W4320167916 hasOpenAccess W4320167916 @default.
- W4320167916 hasPrimaryLocation W43201679161 @default.
- W4320167916 hasRelatedWork W2143749118 @default.
- W4320167916 hasRelatedWork W2385763152 @default.
- W4320167916 hasRelatedWork W2784537340 @default.
- W4320167916 hasRelatedWork W2905887716 @default.
- W4320167916 hasRelatedWork W3026990304 @default.
- W4320167916 hasRelatedWork W3195610113 @default.
- W4320167916 hasRelatedWork W4213041209 @default.
- W4320167916 hasRelatedWork W4213343903 @default.
- W4320167916 hasRelatedWork W4297798330 @default.
- W4320167916 hasRelatedWork W4310419184 @default.
- W4320167916 isParatext "false" @default.
- W4320167916 isRetracted "false" @default.
- W4320167916 workType "article" @default.