Matches in SemOpenAlex for { <https://semopenalex.org/work/W4364353412> ?p ?o ?g. }
- W4364353412 endingPage "5417" @default.
- W4364353412 startingPage "5403" @default.
- W4364353412 abstract "Modern large-scale online service providers typically deploy microservices into containers to achieve flexible service management. One critical problem in such container-based microservice architectures is to control the arrival rate of requests in the containers to avoid containers from being overloaded. In this article, we present our experience of rate limit for the containers in Alibaba, one of the largest e-commerce services in the world. Given the highly diverse characteristics of containers in Alibaba, we point out that the existing rate limit mechanisms cannot meet our demand. Thus, we design Noah, a dynamic rate limiter that can automatically adapt to the specific characteristic of each container without human efforts. The key idea of Noah is to use deep reinforcement learning (DRL) that automatically infers the most suitable configuration for each container. To fully embrace the advantages of DRL in our context, Noah addresses two technical challenges. First, Noah uses a lightweight system monitoring mechanism to collect container status. In this way, it minimizes the monitoring overhead while ensuring a timely reaction to system load changes. Second, Noah injects synthetic extreme data when training its models. Thus, its model gains knowledge on unseen special events and hence remains highly available in extreme scenarios. To guarantee model convergence with the injected training data, Noah adopts task-specific curriculum learning to train the model from normal data to extreme data gradually. Noah has been deployed in the production of Alibaba for two years, serving more than 50000 containers and around 300 types of microservice applications. Experimental results show that Noah can well adapt to three common scenarios in the production environment. It effectively achieves better system availability and shorter request response time compared with four state-of-the-art rate limiters." @default.
- W4364353412 created "2023-04-12" @default.
- W4364353412 creator A5005990103 @default.
- W4364353412 creator A5007236824 @default.
- W4364353412 creator A5008194128 @default.
- W4364353412 creator A5010590523 @default.
- W4364353412 creator A5014085860 @default.
- W4364353412 creator A5020065141 @default.
- W4364353412 creator A5028108437 @default.
- W4364353412 creator A5032277491 @default.
- W4364353412 creator A5070747454 @default.
- W4364353412 creator A5079777618 @default.
- W4364353412 creator A5082251778 @default.
- W4364353412 creator A5087439683 @default.
- W4364353412 date "2023-09-01" @default.
- W4364353412 modified "2023-09-29" @default.
- W4364353412 title "Noah: Reinforcement-Learning-Based Rate Limiter for Microservices in Large-Scale E-Commerce Services" @default.
- W4364353412 cites W147107651 @default.
- W4364353412 cites W1970477949 @default.
- W4364353412 cites W1978533437 @default.
- W4364353412 cites W1988115241 @default.
- W4364353412 cites W2000429806 @default.
- W4364353412 cites W2004244301 @default.
- W4364353412 cites W2008888174 @default.
- W4364353412 cites W2014485836 @default.
- W4364353412 cites W2103899804 @default.
- W4364353412 cites W2115250079 @default.
- W4364353412 cites W2116030291 @default.
- W4364353412 cites W2121862294 @default.
- W4364353412 cites W2143928465 @default.
- W4364353412 cites W2145339207 @default.
- W4364353412 cites W2156077332 @default.
- W4364353412 cites W2160436229 @default.
- W4364353412 cites W2170561623 @default.
- W4364353412 cites W2311027175 @default.
- W4364353412 cites W2522551977 @default.
- W4364353412 cites W2546571074 @default.
- W4364353412 cites W2602725622 @default.
- W4364353412 cites W2604168487 @default.
- W4364353412 cites W2746553466 @default.
- W4364353412 cites W2755181079 @default.
- W4364353412 cites W2760178975 @default.
- W4364353412 cites W2808227867 @default.
- W4364353412 cites W2911276762 @default.
- W4364353412 cites W2914137423 @default.
- W4364353412 cites W2963962154 @default.
- W4364353412 cites W2975654487 @default.
- W4364353412 cites W3114391123 @default.
- W4364353412 cites W3123868845 @default.
- W4364353412 cites W3183239424 @default.
- W4364353412 cites W3192114749 @default.
- W4364353412 cites W4244634541 @default.
- W4364353412 cites W4253993789 @default.
- W4364353412 doi "https://doi.org/10.1109/tnnls.2023.3264038" @default.
- W4364353412 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/37040246" @default.
- W4364353412 hasPublicationYear "2023" @default.
- W4364353412 type Work @default.
- W4364353412 citedByCount "1" @default.
- W4364353412 countsByYear W43643534122023 @default.
- W4364353412 crossrefType "journal-article" @default.
- W4364353412 hasAuthorship W4364353412A5005990103 @default.
- W4364353412 hasAuthorship W4364353412A5007236824 @default.
- W4364353412 hasAuthorship W4364353412A5008194128 @default.
- W4364353412 hasAuthorship W4364353412A5010590523 @default.
- W4364353412 hasAuthorship W4364353412A5014085860 @default.
- W4364353412 hasAuthorship W4364353412A5020065141 @default.
- W4364353412 hasAuthorship W4364353412A5028108437 @default.
- W4364353412 hasAuthorship W4364353412A5032277491 @default.
- W4364353412 hasAuthorship W4364353412A5070747454 @default.
- W4364353412 hasAuthorship W4364353412A5079777618 @default.
- W4364353412 hasAuthorship W4364353412A5082251778 @default.
- W4364353412 hasAuthorship W4364353412A5087439683 @default.
- W4364353412 hasConcept C111919701 @default.
- W4364353412 hasConcept C120314980 @default.
- W4364353412 hasConcept C121332964 @default.
- W4364353412 hasConcept C127413603 @default.
- W4364353412 hasConcept C136264566 @default.
- W4364353412 hasConcept C151730666 @default.
- W4364353412 hasConcept C154945302 @default.
- W4364353412 hasConcept C162324750 @default.
- W4364353412 hasConcept C2778505942 @default.
- W4364353412 hasConcept C2778755073 @default.
- W4364353412 hasConcept C2779343474 @default.
- W4364353412 hasConcept C2779960059 @default.
- W4364353412 hasConcept C2780378061 @default.
- W4364353412 hasConcept C2781018962 @default.
- W4364353412 hasConcept C41008148 @default.
- W4364353412 hasConcept C62520636 @default.
- W4364353412 hasConcept C78519656 @default.
- W4364353412 hasConcept C79974875 @default.
- W4364353412 hasConcept C86803240 @default.
- W4364353412 hasConcept C97541855 @default.
- W4364353412 hasConceptScore W4364353412C111919701 @default.
- W4364353412 hasConceptScore W4364353412C120314980 @default.
- W4364353412 hasConceptScore W4364353412C121332964 @default.
- W4364353412 hasConceptScore W4364353412C127413603 @default.
- W4364353412 hasConceptScore W4364353412C136264566 @default.
- W4364353412 hasConceptScore W4364353412C151730666 @default.