Matches in SemOpenAlex for { <https://semopenalex.org/work/W4376320677> ?p ?o ?g. }
Showing items 1 to 84 of
84
with 100 items per page.
- W4376320677 abstract "In recent years, ML researchers have wrestled with defining and improving machine learning (ML) benchmarks and datasets. In parallel, some have trained a critical lens on the ethics of dataset creation and ML research. In this position paper, we highlight the entanglement of ethics with seemingly ``technical'' or ``scientific'' decisions about the design of ML benchmarks. Our starting point is the existence of multiple overlooked structural similarities between human intelligence benchmarks and ML benchmarks. Both types of benchmarks set standards for describing, evaluating, and comparing performance on tasks relevant to intelligence -- standards that many scholars of human intelligence have long recognized as value-laden. We use perspectives from feminist philosophy of science on IQ benchmarks and thick concepts in social science to argue that values need to be considered and documented when creating ML benchmarks. It is neither possible nor desirable to avoid this choice by creating value-neutral benchmarks. Finally, we outline practical recommendations for ML benchmark research ethics and ethics review." @default.
- W4376320677 created "2023-05-13" @default.
- W4376320677 creator A5017113404 @default.
- W4376320677 creator A5055973731 @default.
- W4376320677 date "2023-06-12" @default.
- W4376320677 modified "2023-09-27" @default.
- W4376320677 title "Making Intelligence: Ethical Values in IQ and ML Benchmarks" @default.
- W4376320677 cites W1962580118 @default.
- W4376320677 cites W2003665838 @default.
- W4376320677 cites W2013958209 @default.
- W4376320677 cites W2039261710 @default.
- W4376320677 cites W2115163516 @default.
- W4376320677 cites W2133487567 @default.
- W4376320677 cites W2363947341 @default.
- W4376320677 cites W2971476952 @default.
- W4376320677 cites W2982580298 @default.
- W4376320677 cites W3003809373 @default.
- W4376320677 cites W3133752603 @default.
- W4376320677 cites W3136025710 @default.
- W4376320677 cites W3161401854 @default.
- W4376320677 cites W3164854573 @default.
- W4376320677 cites W3204432444 @default.
- W4376320677 cites W3208557763 @default.
- W4376320677 cites W3213111742 @default.
- W4376320677 cites W4206834747 @default.
- W4376320677 cites W4210913687 @default.
- W4376320677 cites W4256396501 @default.
- W4376320677 cites W4280523315 @default.
- W4376320677 cites W4378966551 @default.
- W4376320677 doi "https://doi.org/10.1145/3593013.3593996" @default.
- W4376320677 hasPublicationYear "2023" @default.
- W4376320677 type Work @default.
- W4376320677 citedByCount "0" @default.
- W4376320677 crossrefType "proceedings-article" @default.
- W4376320677 hasAuthorship W4376320677A5017113404 @default.
- W4376320677 hasAuthorship W4376320677A5055973731 @default.
- W4376320677 hasBestOaLocation W43763206772 @default.
- W4376320677 hasConcept C119857082 @default.
- W4376320677 hasConcept C127413603 @default.
- W4376320677 hasConcept C13280743 @default.
- W4376320677 hasConcept C154945302 @default.
- W4376320677 hasConcept C177264268 @default.
- W4376320677 hasConcept C185798385 @default.
- W4376320677 hasConcept C199360897 @default.
- W4376320677 hasConcept C205649164 @default.
- W4376320677 hasConcept C2522767166 @default.
- W4376320677 hasConcept C2524010 @default.
- W4376320677 hasConcept C2776291640 @default.
- W4376320677 hasConcept C28719098 @default.
- W4376320677 hasConcept C33923547 @default.
- W4376320677 hasConcept C41008148 @default.
- W4376320677 hasConcept C55587333 @default.
- W4376320677 hasConceptScore W4376320677C119857082 @default.
- W4376320677 hasConceptScore W4376320677C127413603 @default.
- W4376320677 hasConceptScore W4376320677C13280743 @default.
- W4376320677 hasConceptScore W4376320677C154945302 @default.
- W4376320677 hasConceptScore W4376320677C177264268 @default.
- W4376320677 hasConceptScore W4376320677C185798385 @default.
- W4376320677 hasConceptScore W4376320677C199360897 @default.
- W4376320677 hasConceptScore W4376320677C205649164 @default.
- W4376320677 hasConceptScore W4376320677C2522767166 @default.
- W4376320677 hasConceptScore W4376320677C2524010 @default.
- W4376320677 hasConceptScore W4376320677C2776291640 @default.
- W4376320677 hasConceptScore W4376320677C28719098 @default.
- W4376320677 hasConceptScore W4376320677C33923547 @default.
- W4376320677 hasConceptScore W4376320677C41008148 @default.
- W4376320677 hasConceptScore W4376320677C55587333 @default.
- W4376320677 hasLocation W43763206771 @default.
- W4376320677 hasLocation W43763206772 @default.
- W4376320677 hasOpenAccess W4376320677 @default.
- W4376320677 hasPrimaryLocation W43763206771 @default.
- W4376320677 hasRelatedWork W112744582 @default.
- W4376320677 hasRelatedWork W1485630101 @default.
- W4376320677 hasRelatedWork W1537221325 @default.
- W4376320677 hasRelatedWork W2081245617 @default.
- W4376320677 hasRelatedWork W2164513229 @default.
- W4376320677 hasRelatedWork W2347389357 @default.
- W4376320677 hasRelatedWork W2498017833 @default.
- W4376320677 hasRelatedWork W2805452530 @default.
- W4376320677 hasRelatedWork W3033750096 @default.
- W4376320677 hasRelatedWork W4317738324 @default.
- W4376320677 isParatext "false" @default.
- W4376320677 isRetracted "false" @default.
- W4376320677 workType "article" @default.