Matches in SemOpenAlex for { <https://semopenalex.org/work/W4289389632> ?p ?o ?g. }
Showing items 1 to 71 of
71
with 100 items per page.
- W4289389632 abstract "Machine Learning models are often composed of pipelines of transformations. While this design allows to efficiently execute single model components at training time, prediction serving has different requirements such as low latency, high throughput and graceful performance degradation under heavy load. Current prediction serving systems consider models as black boxes, whereby prediction-time-specific optimizations are ignored in favor of ease of deployment. In this paper, we present PRETZEL, a prediction serving system introducing a novel white box architecture enabling both end-to-end and multi-model optimizations. Using production-like model pipelines, our experiments show that PRETZEL is able to introduce performance improvements over different dimensions; compared to state-of-the-art approaches PRETZEL is on average able to reduce 99th percentile latency by 5.5x while reducing memory footprint by 25x, and increasing throughput by 4.7x." @default.
- W4289389632 created "2022-08-02" @default.
- W4289389632 creator A5010543929 @default.
- W4289389632 creator A5023179995 @default.
- W4289389632 creator A5025756141 @default.
- W4289389632 creator A5063625592 @default.
- W4289389632 creator A5071206013 @default.
- W4289389632 creator A5083084972 @default.
- W4289389632 date "2018-10-14" @default.
- W4289389632 modified "2023-09-25" @default.
- W4289389632 title "PRETZEL: Opening the Black Box of Machine Learning Prediction Serving Systems" @default.
- W4289389632 doi "https://doi.org/10.48550/arxiv.1810.06115" @default.
- W4289389632 hasPublicationYear "2018" @default.
- W4289389632 type Work @default.
- W4289389632 citedByCount "0" @default.
- W4289389632 crossrefType "posted-content" @default.
- W4289389632 hasAuthorship W4289389632A5010543929 @default.
- W4289389632 hasAuthorship W4289389632A5023179995 @default.
- W4289389632 hasAuthorship W4289389632A5025756141 @default.
- W4289389632 hasAuthorship W4289389632A5063625592 @default.
- W4289389632 hasAuthorship W4289389632A5071206013 @default.
- W4289389632 hasAuthorship W4289389632A5083084972 @default.
- W4289389632 hasBestOaLocation W42893896321 @default.
- W4289389632 hasConcept C105339364 @default.
- W4289389632 hasConcept C111919701 @default.
- W4289389632 hasConcept C119857082 @default.
- W4289389632 hasConcept C127413603 @default.
- W4289389632 hasConcept C154945302 @default.
- W4289389632 hasConcept C157764524 @default.
- W4289389632 hasConcept C175309249 @default.
- W4289389632 hasConcept C180932941 @default.
- W4289389632 hasConcept C41008148 @default.
- W4289389632 hasConcept C555944384 @default.
- W4289389632 hasConcept C74912251 @default.
- W4289389632 hasConcept C76155785 @default.
- W4289389632 hasConcept C79403827 @default.
- W4289389632 hasConcept C82876162 @default.
- W4289389632 hasConcept C87717796 @default.
- W4289389632 hasConcept C94966114 @default.
- W4289389632 hasConceptScore W4289389632C105339364 @default.
- W4289389632 hasConceptScore W4289389632C111919701 @default.
- W4289389632 hasConceptScore W4289389632C119857082 @default.
- W4289389632 hasConceptScore W4289389632C127413603 @default.
- W4289389632 hasConceptScore W4289389632C154945302 @default.
- W4289389632 hasConceptScore W4289389632C157764524 @default.
- W4289389632 hasConceptScore W4289389632C175309249 @default.
- W4289389632 hasConceptScore W4289389632C180932941 @default.
- W4289389632 hasConceptScore W4289389632C41008148 @default.
- W4289389632 hasConceptScore W4289389632C555944384 @default.
- W4289389632 hasConceptScore W4289389632C74912251 @default.
- W4289389632 hasConceptScore W4289389632C76155785 @default.
- W4289389632 hasConceptScore W4289389632C79403827 @default.
- W4289389632 hasConceptScore W4289389632C82876162 @default.
- W4289389632 hasConceptScore W4289389632C87717796 @default.
- W4289389632 hasConceptScore W4289389632C94966114 @default.
- W4289389632 hasLocation W42893896321 @default.
- W4289389632 hasOpenAccess W4289389632 @default.
- W4289389632 hasPrimaryLocation W42893896321 @default.
- W4289389632 hasRelatedWork W2972660584 @default.
- W4289389632 hasRelatedWork W2998015774 @default.
- W4289389632 hasRelatedWork W3173182854 @default.
- W4289389632 hasRelatedWork W4213225422 @default.
- W4289389632 hasRelatedWork W4213432687 @default.
- W4289389632 hasRelatedWork W4252064337 @default.
- W4289389632 hasRelatedWork W4287390911 @default.
- W4289389632 hasRelatedWork W4296571897 @default.
- W4289389632 hasRelatedWork W4309263371 @default.
- W4289389632 hasRelatedWork W4321392959 @default.
- W4289389632 isParatext "false" @default.
- W4289389632 isRetracted "false" @default.
- W4289389632 workType "article" @default.