Matches in SemOpenAlex for { <https://semopenalex.org/work/W4384261711> ?p ?o ?g. }
- W4384261711 abstract "Large language models that exhibit instruction-following behaviour represent one of the biggest recent upheavals in conversational interfaces, a trend in large part fuelled by the release of OpenAI's ChatGPT, a proprietary large language model for text generation fine-tuned through reinforcement learning from human feedback (LLM+RLHF). We review the risks of relying on proprietary software and survey the first crop of open-source projects of comparable architecture and functionality. The main contribution of this paper is to show that openness is differentiated, and to offer scientific documentation of degrees of openness in this fast-moving field. We evaluate projects in terms of openness of code, training data, model weights, RLHF data, licensing, scientific documentation, and access methods. We find that while there is a fast-growing list of projects billing themselves as 'open source', many inherit undocumented data of dubious legality, few share the all-important instruction-tuning (a key site where human annotation labour is involved), and careful scientific documentation is exceedingly rare. Degrees of openness are relevant to fairness and accountability at all points, from data collection and curation to model architecture, and from training and fine-tuning to release and deployment." @default.
- W4384261711 created "2023-07-14" @default.
- W4384261711 creator A5025973741 @default.
- W4384261711 creator A5026975478 @default.
- W4384261711 creator A5052597754 @default.
- W4384261711 date "2023-07-19" @default.
- W4384261711 modified "2023-10-06" @default.
- W4384261711 title "Opening up ChatGPT: Tracking openness, transparency, and accountability in instruction-tuned text generators" @default.
- W4384261711 cites W1966041739 @default.
- W4384261711 cites W2108598243 @default.
- W4384261711 cites W2547532903 @default.
- W4384261711 cites W2618530766 @default.
- W4384261711 cites W2788572835 @default.
- W4384261711 cites W2890056718 @default.
- W4384261711 cites W2963489214 @default.
- W4384261711 cites W3100279624 @default.
- W4384261711 cites W3118813946 @default.
- W4384261711 cites W3119746452 @default.
- W4384261711 cites W3132771424 @default.
- W4384261711 cites W3133702157 @default.
- W4384261711 cites W3135371071 @default.
- W4384261711 cites W3174233822 @default.
- W4384261711 cites W3177173791 @default.
- W4384261711 cites W3193521099 @default.
- W4384261711 cites W3212464620 @default.
- W4384261711 cites W4225109361 @default.
- W4384261711 cites W4229447062 @default.
- W4384261711 cites W4247017378 @default.
- W4384261711 cites W4281763794 @default.
- W4384261711 cites W4284670548 @default.
- W4384261711 cites W4322763951 @default.
- W4384261711 cites W4380360954 @default.
- W4384261711 cites W4385571124 @default.
- W4384261711 cites W4385572634 @default.
- W4384261711 doi "https://doi.org/10.1145/3571884.3604316" @default.
- W4384261711 hasPublicationYear "2023" @default.
- W4384261711 type Work @default.
- W4384261711 citedByCount "2" @default.
- W4384261711 countsByYear W43842617112023 @default.
- W4384261711 crossrefType "proceedings-article" @default.
- W4384261711 hasAuthorship W4384261711A5025973741 @default.
- W4384261711 hasAuthorship W4384261711A5026975478 @default.
- W4384261711 hasAuthorship W4384261711A5052597754 @default.
- W4384261711 hasBestOaLocation W43842617112 @default.
- W4384261711 hasConcept C105339364 @default.
- W4384261711 hasConcept C115903868 @default.
- W4384261711 hasConcept C123657996 @default.
- W4384261711 hasConcept C136764020 @default.
- W4384261711 hasConcept C142362112 @default.
- W4384261711 hasConcept C153349607 @default.
- W4384261711 hasConcept C15744967 @default.
- W4384261711 hasConcept C17744445 @default.
- W4384261711 hasConcept C186846655 @default.
- W4384261711 hasConcept C199360897 @default.
- W4384261711 hasConcept C199539241 @default.
- W4384261711 hasConcept C202105479 @default.
- W4384261711 hasConcept C2776007630 @default.
- W4384261711 hasConcept C2777904410 @default.
- W4384261711 hasConcept C2780233690 @default.
- W4384261711 hasConcept C38652104 @default.
- W4384261711 hasConcept C41008148 @default.
- W4384261711 hasConcept C42027317 @default.
- W4384261711 hasConcept C529173508 @default.
- W4384261711 hasConcept C56666940 @default.
- W4384261711 hasConcept C77805123 @default.
- W4384261711 hasConcept C84976871 @default.
- W4384261711 hasConceptScore W4384261711C105339364 @default.
- W4384261711 hasConceptScore W4384261711C115903868 @default.
- W4384261711 hasConceptScore W4384261711C123657996 @default.
- W4384261711 hasConceptScore W4384261711C136764020 @default.
- W4384261711 hasConceptScore W4384261711C142362112 @default.
- W4384261711 hasConceptScore W4384261711C153349607 @default.
- W4384261711 hasConceptScore W4384261711C15744967 @default.
- W4384261711 hasConceptScore W4384261711C17744445 @default.
- W4384261711 hasConceptScore W4384261711C186846655 @default.
- W4384261711 hasConceptScore W4384261711C199360897 @default.
- W4384261711 hasConceptScore W4384261711C199539241 @default.
- W4384261711 hasConceptScore W4384261711C202105479 @default.
- W4384261711 hasConceptScore W4384261711C2776007630 @default.
- W4384261711 hasConceptScore W4384261711C2777904410 @default.
- W4384261711 hasConceptScore W4384261711C2780233690 @default.
- W4384261711 hasConceptScore W4384261711C38652104 @default.
- W4384261711 hasConceptScore W4384261711C41008148 @default.
- W4384261711 hasConceptScore W4384261711C42027317 @default.
- W4384261711 hasConceptScore W4384261711C529173508 @default.
- W4384261711 hasConceptScore W4384261711C56666940 @default.
- W4384261711 hasConceptScore W4384261711C77805123 @default.
- W4384261711 hasConceptScore W4384261711C84976871 @default.
- W4384261711 hasLocation W43842617111 @default.
- W4384261711 hasLocation W43842617112 @default.
- W4384261711 hasOpenAccess W4384261711 @default.
- W4384261711 hasPrimaryLocation W43842617111 @default.
- W4384261711 hasRelatedWork W1863951150 @default.
- W4384261711 hasRelatedWork W2564520406 @default.
- W4384261711 hasRelatedWork W2748952813 @default.
- W4384261711 hasRelatedWork W2801156266 @default.
- W4384261711 hasRelatedWork W2810478545 @default.
- W4384261711 hasRelatedWork W3037541636 @default.
- W4384261711 hasRelatedWork W3106344240 @default.
- W4384261711 hasRelatedWork W3122557281 @default.