FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W4308017781> ?p ?o ?g. }

• W4308017781 abstract "Maintaining data quality on Amazon Mechanical Turk (MTurk) has always been a concern for researchers. These concerns have grown recently due to the bot crisis of 2018 and observations that past safeguards of data quality (e.g., approval ratings of 95%) no longer work. To address data quality concerns, CloudResearch, a third-party website that interfaces with MTurk, has assessed ~165,000 MTurkers and categorized them into those that provide high- (~100,000, Approved) and low- (~65,000, Blocked) quality data. Here, we examined the predictive validity of CloudResearch's vetting. In a pre-registered study, participants (N = 900) from the Approved and Blocked groups, along with a Standard MTurk sample (95% HIT acceptance ratio, 100+ completed HITs), completed an array of data-quality measures. Across several indices, Approved participants (i) identified the content of images more accurately, (ii) answered more reading comprehension questions correctly, (iii) responded to reversed coded items more consistently, (iv) passed a greater number of attention checks, (v) self-reported less cheating and actually left the survey window less often on easily Googleable questions, (vi) replicated classic psychology experimental effects more reliably, and (vii) answered AI-stumping questions more accurately than Blocked participants, who performed at chance on multiple outcomes. Data quality of the Standard sample was generally in between the Approved and Blocked groups. We discuss how MTurk's Approval Rating system is no longer an effective data-quality control, and we discuss the advantages afforded by using the Approved group for scientific studies on MTurk." @default.
• W4308017781 created "2022-11-07" @default.
• W4308017781 creator A5035636943 @default.
• W4308017781 creator A5037020841 @default.
• W4308017781 creator A5054942243 @default.
• W4308017781 creator A5075633381 @default.
• W4308017781 creator A5082827301 @default.
• W4308017781 creator A5089969887 @default.
• W4308017781 date "2022-11-03" @default.
• W4308017781 modified "2023-10-14" @default.
• W4308017781 title "Evaluating CloudResearch’s Approved Group as a solution for problematic data quality on MTurk" @default.
• W4308017781 cites W1046275439 @default.
• W4308017781 cites W1807286188 @default.
• W4308017781 cites W2010398643 @default.
• W4308017781 cites W2022550861 @default.
• W4308017781 cites W2035782089 @default.
• W4308017781 cites W2076387137 @default.
• W4308017781 cites W2087484885 @default.
• W4308017781 cites W2105753174 @default.
• W4308017781 cites W2106568252 @default.
• W4308017781 cites W2126302787 @default.
• W4308017781 cites W2133707153 @default.
• W4308017781 cites W2141708418 @default.
• W4308017781 cites W2147091291 @default.
• W4308017781 cites W2342281051 @default.
• W4308017781 cites W2426479609 @default.
• W4308017781 cites W2464173335 @default.
• W4308017781 cites W2472432751 @default.
• W4308017781 cites W2513634853 @default.
• W4308017781 cites W2513712743 @default.
• W4308017781 cites W2566682840 @default.
• W4308017781 cites W2585292421 @default.
• W4308017781 cites W2794871313 @default.
• W4308017781 cites W2900420874 @default.
• W4308017781 cites W2935892750 @default.
• W4308017781 cites W2979864122 @default.
• W4308017781 cites W2981364051 @default.
• W4308017781 cites W2996509273 @default.
• W4308017781 cites W3088399774 @default.
• W4308017781 cites W3092797861 @default.
• W4308017781 cites W3115100653 @default.
• W4308017781 cites W3123404044 @default.
• W4308017781 cites W3124580540 @default.
• W4308017781 cites W3125283999 @default.
• W4308017781 cites W3160751818 @default.
• W4308017781 cites W3167556887 @default.
• W4308017781 cites W3209468839 @default.
• W4308017781 doi "https://doi.org/10.3758/s13428-022-01999-x" @default.
• W4308017781 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/36326997" @default.
• W4308017781 hasPublicationYear "2022" @default.
• W4308017781 type Work @default.
• W4308017781 citedByCount "13" @default.
• W4308017781 countsByYear W43080177812022 @default.
• W4308017781 countsByYear W43080177812023 @default.
• W4308017781 crossrefType "journal-article" @default.
• W4308017781 hasAuthorship W4308017781A5035636943 @default.
• W4308017781 hasAuthorship W4308017781A5037020841 @default.
• W4308017781 hasAuthorship W4308017781A5054942243 @default.
• W4308017781 hasAuthorship W4308017781A5075633381 @default.
• W4308017781 hasAuthorship W4308017781A5082827301 @default.
• W4308017781 hasAuthorship W4308017781A5089969887 @default.
• W4308017781 hasBestOaLocation W43080177811 @default.
• W4308017781 hasConcept C111472728 @default.
• W4308017781 hasConcept C138885662 @default.
• W4308017781 hasConcept C15744967 @default.
• W4308017781 hasConcept C162324750 @default.
• W4308017781 hasConcept C176217482 @default.
• W4308017781 hasConcept C185592680 @default.
• W4308017781 hasConcept C198531522 @default.
• W4308017781 hasConcept C21547014 @default.
• W4308017781 hasConcept C24756922 @default.
• W4308017781 hasConcept C2777230681 @default.
• W4308017781 hasConcept C2779530757 @default.
• W4308017781 hasConcept C38652104 @default.
• W4308017781 hasConcept C41008148 @default.
• W4308017781 hasConcept C43617362 @default.
• W4308017781 hasConcept C75630572 @default.
• W4308017781 hasConceptScore W4308017781C111472728 @default.
• W4308017781 hasConceptScore W4308017781C138885662 @default.
• W4308017781 hasConceptScore W4308017781C15744967 @default.
• W4308017781 hasConceptScore W4308017781C162324750 @default.
• W4308017781 hasConceptScore W4308017781C176217482 @default.
• W4308017781 hasConceptScore W4308017781C185592680 @default.
• W4308017781 hasConceptScore W4308017781C198531522 @default.
• W4308017781 hasConceptScore W4308017781C21547014 @default.
• W4308017781 hasConceptScore W4308017781C24756922 @default.
• W4308017781 hasConceptScore W4308017781C2777230681 @default.
• W4308017781 hasConceptScore W4308017781C2779530757 @default.
• W4308017781 hasConceptScore W4308017781C38652104 @default.
• W4308017781 hasConceptScore W4308017781C41008148 @default.
• W4308017781 hasConceptScore W4308017781C43617362 @default.
• W4308017781 hasConceptScore W4308017781C75630572 @default.
• W4308017781 hasLocation W43080177811 @default.
• W4308017781 hasLocation W43080177812 @default.
• W4308017781 hasLocation W43080177813 @default.
• W4308017781 hasLocation W43080177814 @default.
• W4308017781 hasOpenAccess W4308017781 @default.
• W4308017781 hasPrimaryLocation W43080177811 @default.
• W4308017781 hasRelatedWork W2030902865 @default.
• W4308017781 hasRelatedWork W2116911522 @default.

• next