FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W2903779218> ?p ?o ?g. }

• W2903779218 abstract "Online crowdsourcing provides a scalable and inexpensive means to collect knowledge (e.g. labels) about various types of data items (e.g. text, audio, video). However, it is also known to result in large variance in the quality of recorded responses which often cannot be directly used for training machine learning systems. To resolve this issue, a lot of work has been conducted to control the response quality such that low-quality responses cannot adversely affect the performance of the machine learning systems. Such work is referred to as the quality control for crowdsourcing. Past quality control research can be divided into two major branches: quality control mechanism design and statistical models. The first branch focuses on designing measures, thresholds, interfaces and workflows for payment, gamification, question assignment and other mechanisms that influence workers' behaviour. The second branch focuses on developing statistical models to perform effective aggregation of responses to infer correct responses. The two branches are connected as statistical models (i) provide parameter estimates to support the measure and threshold calculation, and (ii) encode modelling assumptions used to derive (theoretical) performance guarantees for the mechanisms. There are surveys regarding each branch but they lack technical details about the other branch. Our survey is the first to bridge the two branches by providing technical details on how they work together under frameworks that systematically unify crowdsourcing aspects modelled by both of them to determine the response quality. We are also the first to provide taxonomies of quality control papers based on the proposed frameworks. Finally, we specify the current limitations and the corresponding future directions for the quality control research." @default.
• W2903779218 created "2018-12-22" @default.
• W2903779218 creator A5032216555 @default.
• W2903779218 creator A5051297830 @default.
• W2903779218 creator A5069487278 @default.
• W2903779218 creator A5086734254 @default.
• W2903779218 date "2018-12-05" @default.
• W2903779218 modified "2023-09-25" @default.
• W2903779218 title "A Technical Survey on Statistical Modelling and Design Methods for Crowdsourcing Quality Control" @default.
• W2903779218 cites W108763474 @default.
• W2903779218 cites W118259468 @default.
• W2903779218 cites W122626481 @default.
• W2903779218 cites W135177976 @default.
• W2903779218 cites W1482468045 @default.
• W2903779218 cites W1522318289 @default.
• W2903779218 cites W1539473175 @default.
• W2903779218 cites W1541280084 @default.
• W2903779218 cites W1541505110 @default.
• W2903779218 cites W1558395318 @default.
• W2903779218 cites W1693667 @default.
• W2903779218 cites W1782953462 @default.
• W2903779218 cites W1786164014 @default.
• W2903779218 cites W1807825527 @default.
• W2903779218 cites W1814633089 @default.
• W2903779218 cites W1818395637 @default.
• W2903779218 cites W1880262756 @default.
• W2903779218 cites W18965224 @default.
• W2903779218 cites W1902046146 @default.
• W2903779218 cites W191327111 @default.
• W2903779218 cites W1959608418 @default.
• W2903779218 cites W1967687583 @default.
• W2903779218 cites W1968072657 @default.
• W2903779218 cites W1968545881 @default.
• W2903779218 cites W1970381522 @default.
• W2903779218 cites W1975787960 @default.
• W2903779218 cites W1977861231 @default.
• W2903779218 cites W1988560072 @default.
• W2903779218 cites W1994050137 @default.
• W2903779218 cites W1996336855 @default.
• W2903779218 cites W1999489314 @default.
• W2903779218 cites W2006471615 @default.
• W2903779218 cites W2009592498 @default.
• W2903779218 cites W2012638909 @default.
• W2903779218 cites W2012900288 @default.
• W2903779218 cites W2014100104 @default.
• W2903779218 cites W2016365843 @default.
• W2903779218 cites W2024166834 @default.
• W2903779218 cites W2030793160 @default.
• W2903779218 cites W2034771068 @default.
• W2903779218 cites W2035683813 @default.
• W2903779218 cites W2045028206 @default.
• W2903779218 cites W2045114813 @default.
• W2903779218 cites W2051752522 @default.
• W2903779218 cites W2056997037 @default.
• W2903779218 cites W2058738785 @default.
• W2903779218 cites W2058892254 @default.
• W2903779218 cites W2064677871 @default.
• W2903779218 cites W2069074793 @default.
• W2903779218 cites W2077119967 @default.
• W2903779218 cites W2108598243 @default.
• W2903779218 cites W2109304399 @default.
• W2903779218 cites W2125943921 @default.
• W2903779218 cites W2127970560 @default.
• W2903779218 cites W2128475742 @default.
• W2903779218 cites W2129345386 @default.
• W2903779218 cites W2134305421 @default.
• W2903779218 cites W2138621811 @default.
• W2903779218 cites W2140890285 @default.
• W2903779218 cites W2141649520 @default.
• W2903779218 cites W2142518823 @default.
• W2903779218 cites W2147687736 @default.
• W2903779218 cites W2152009989 @default.
• W2903779218 cites W2153209865 @default.
• W2903779218 cites W2161816739 @default.
• W2903779218 cites W2162815002 @default.
• W2903779218 cites W2163522723 @default.
• W2903779218 cites W2165698076 @default.
• W2903779218 cites W2168359464 @default.
• W2903779218 cites W2168396085 @default.
• W2903779218 cites W2175199219 @default.
• W2903779218 cites W2177390197 @default.
• W2903779218 cites W2180771322 @default.
• W2903779218 cites W2181558882 @default.
• W2903779218 cites W2271188064 @default.
• W2903779218 cites W2273171220 @default.
• W2903779218 cites W2288846786 @default.
• W2903779218 cites W2303476400 @default.
• W2903779218 cites W2307292283 @default.
• W2903779218 cites W2338952248 @default.
• W2903779218 cites W2340432473 @default.
• W2903779218 cites W2395183479 @default.
• W2903779218 cites W2400382365 @default.
• W2903779218 cites W2402617095 @default.
• W2903779218 cites W2475282416 @default.
• W2903779218 cites W2483632691 @default.
• W2903779218 cites W2511082080 @default.
• W2903779218 cites W2522186013 @default.
• W2903779218 cites W2523478734 @default.
• W2903779218 cites W2550444944 @default.
• W2903779218 cites W2554839354 @default.

• next