Matches in SemOpenAlex for { <https://semopenalex.org/work/W4376167329> ?p ?o ?g. }
- W4376167329 abstract "The BigCode community, an open-scientific collaboration working on the responsible development of Large Language Models for Code (Code LLMs), introduces StarCoder and StarCoderBase: 15.5B parameter models with 8K context length, infilling capabilities and fast large-batch inference enabled by multi-query attention. StarCoderBase is trained on 1 trillion tokens sourced from The Stack, a large collection of permissively licensed GitHub repositories with inspection tools and an opt-out process. We fine-tuned StarCoderBase on 35B Python tokens, resulting in the creation of StarCoder. We perform the most comprehensive evaluation of Code LLMs to date and show that StarCoderBase outperforms every open Code LLM that supports multiple programming languages and matches or outperforms the OpenAI code-cushman-001 model. Furthermore, StarCoder outperforms every model that is fine-tuned on Python, can be prompted to achieve 40% pass@1 on HumanEval, and still retains its performance on other programming languages. We take several important steps towards a safe open-access model release, including an improved PII redaction pipeline and a novel attribution tracing tool, and make the StarCoder models publicly available under a more commercially viable version of the Open Responsible AI Model license." @default.
- W4376167329 created "2023-05-12" @default.
- W4376167329 creator A5000043237 @default.
- W4376167329 creator A5000126238 @default.
- W4376167329 creator A5000510528 @default.
- W4376167329 creator A5001782949 @default.
- W4376167329 creator A5002251783 @default.
- W4376167329 creator A5003637850 @default.
- W4376167329 creator A5004239229 @default.
- W4376167329 creator A5007842855 @default.
- W4376167329 creator A5008355834 @default.
- W4376167329 creator A5009823475 @default.
- W4376167329 creator A5010465328 @default.
- W4376167329 creator A5011209038 @default.
- W4376167329 creator A5011374385 @default.
- W4376167329 creator A5012489417 @default.
- W4376167329 creator A5017474527 @default.
- W4376167329 creator A5018410563 @default.
- W4376167329 creator A5018646943 @default.
- W4376167329 creator A5018675797 @default.
- W4376167329 creator A5019808686 @default.
- W4376167329 creator A5020051221 @default.
- W4376167329 creator A5020526944 @default.
- W4376167329 creator A5025987694 @default.
- W4376167329 creator A5026469719 @default.
- W4376167329 creator A5028393429 @default.
- W4376167329 creator A5028691398 @default.
- W4376167329 creator A5029515956 @default.
- W4376167329 creator A5032686951 @default.
- W4376167329 creator A5033794353 @default.
- W4376167329 creator A5042599719 @default.
- W4376167329 creator A5044015545 @default.
- W4376167329 creator A5044042294 @default.
- W4376167329 creator A5044112424 @default.
- W4376167329 creator A5044947632 @default.
- W4376167329 creator A5051931700 @default.
- W4376167329 creator A5054634361 @default.
- W4376167329 creator A5055111969 @default.
- W4376167329 creator A5055115466 @default.
- W4376167329 creator A5056054051 @default.
- W4376167329 creator A5058072829 @default.
- W4376167329 creator A5058484299 @default.
- W4376167329 creator A5059929869 @default.
- W4376167329 creator A5060815601 @default.
- W4376167329 creator A5063189132 @default.
- W4376167329 creator A5065502511 @default.
- W4376167329 creator A5068788224 @default.
- W4376167329 creator A5070647299 @default.
- W4376167329 creator A5070994105 @default.
- W4376167329 creator A5072906919 @default.
- W4376167329 creator A5075492610 @default.
- W4376167329 creator A5076596867 @default.
- W4376167329 creator A5077190748 @default.
- W4376167329 creator A5078865608 @default.
- W4376167329 creator A5082114795 @default.
- W4376167329 creator A5082175038 @default.
- W4376167329 creator A5082624117 @default.
- W4376167329 creator A5083384339 @default.
- W4376167329 creator A5084438979 @default.
- W4376167329 creator A5085451281 @default.
- W4376167329 creator A5085873515 @default.
- W4376167329 creator A5089418361 @default.
- W4376167329 creator A5090893148 @default.
- W4376167329 creator A5091734792 @default.
- W4376167329 creator A5091926856 @default.
- W4376167329 creator A5091926857 @default.
- W4376167329 creator A5091926858 @default.
- W4376167329 creator A5091926859 @default.
- W4376167329 creator A5091926860 @default.
- W4376167329 date "2023-05-09" @default.
- W4376167329 modified "2023-10-14" @default.
- W4376167329 title "StarCoder: may the source be with you!" @default.
- W4376167329 doi "https://doi.org/10.48550/arxiv.2305.06161" @default.
- W4376167329 hasPublicationYear "2023" @default.
- W4376167329 type Work @default.
- W4376167329 citedByCount "0" @default.
- W4376167329 crossrefType "posted-content" @default.
- W4376167329 hasAuthorship W4376167329A5000043237 @default.
- W4376167329 hasAuthorship W4376167329A5000126238 @default.
- W4376167329 hasAuthorship W4376167329A5000510528 @default.
- W4376167329 hasAuthorship W4376167329A5001782949 @default.
- W4376167329 hasAuthorship W4376167329A5002251783 @default.
- W4376167329 hasAuthorship W4376167329A5003637850 @default.
- W4376167329 hasAuthorship W4376167329A5004239229 @default.
- W4376167329 hasAuthorship W4376167329A5007842855 @default.
- W4376167329 hasAuthorship W4376167329A5008355834 @default.
- W4376167329 hasAuthorship W4376167329A5009823475 @default.
- W4376167329 hasAuthorship W4376167329A5010465328 @default.
- W4376167329 hasAuthorship W4376167329A5011209038 @default.
- W4376167329 hasAuthorship W4376167329A5011374385 @default.
- W4376167329 hasAuthorship W4376167329A5012489417 @default.
- W4376167329 hasAuthorship W4376167329A5017474527 @default.
- W4376167329 hasAuthorship W4376167329A5018410563 @default.
- W4376167329 hasAuthorship W4376167329A5018646943 @default.
- W4376167329 hasAuthorship W4376167329A5018675797 @default.
- W4376167329 hasAuthorship W4376167329A5019808686 @default.
- W4376167329 hasAuthorship W4376167329A5020051221 @default.
- W4376167329 hasAuthorship W4376167329A5020526944 @default.
- W4376167329 hasAuthorship W4376167329A5025987694 @default.
- W4376167329 hasAuthorship W4376167329A5026469719 @default.