FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W62982523> ?p ?o ?g. }

• W62982523 abstract "Previous usability evaluation method (UEM) comparison studies have noted an evaluator effect on problem detection in heuristic evaluation, with evaluators differing in problems found and problem severity judgments. There have been few studies of the evaluator effect in usability testing (UT), task-based testing with end-users. UEM comparison studies focus on counting usability problems detected, but we also need to assess the content of usability problem descriptions (UPDs) to more fully measure evaluation effectiveness. The goals of this research were to develop UPD guidelines, explore the evaluator effect in UT, and evaluate the usefulness of the guidelines for grading UPD content. Ten guidelines for writing UPDs were developed by consulting usability practitioners through two questionnaires and a card sort. These guidelines are (briefly): be clear and avoid jargon, describe problem severity, provide backing data, describe problem causes, describe user actions, provide a solution, consider politics and diplomacy, be professional and scientific, describe your methodology, and help the reader sympathize with the user. A fourth study compared usability reports collected from 44 evaluators, both practitioners and graduate students, watching the same 10-minute UT session recording. Three judges measured problem detection for each evaluator and graded the reports for following 6 of the UPD guidelines. There was support for existence of an evaluator effect, even when watching prerecorded sessions, with low to moderate individual thoroughness of problem detection across all/severe problems (22%/34%), reliability of problem detection (37%/50%) and reliability of severity judgments (57% for severe ratings). Practitioners received higher grades averaged across the 6 guidelines than students did, suggesting that the guidelines may be useful for grading reports. The grades for the guidelines were not correlated with thoroughness, suggesting that the guideline grades complement measures of problem detection. A simulation of evaluators working in groups found a 34% increase in severe problems found by adding a second evaluator. The simulation also found that thoroughness of individual evaluators would have been overestimated if the study had included a small number of evaluators. The final recommendations are to use multiple evaluators in UT, and to assess both problem detection and description when measuring evaluation effectiveness." @default.
• W62982523 created "2016-06-24" @default.
• W62982523 creator A5017460095 @default.
• W62982523 creator A5028424802 @default.
• W62982523 date "2006-01-01" @default.
• W62982523 modified "2023-09-28" @default.
• W62982523 title "Usability problem description and the evaluator effect in usability testing" @default.
• W62982523 cites W121704291 @default.
• W62982523 cites W13775403 @default.
• W62982523 cites W1491233988 @default.
• W62982523 cites W1505395986 @default.
• W62982523 cites W1510747555 @default.
• W62982523 cites W1526630818 @default.
• W62982523 cites W1544407491 @default.
• W62982523 cites W1551257840 @default.
• W62982523 cites W1554531572 @default.
• W62982523 cites W1558663422 @default.
• W62982523 cites W1563601066 @default.
• W62982523 cites W158727920 @default.
• W62982523 cites W1596133221 @default.
• W62982523 cites W1596953637 @default.
• W62982523 cites W1607841960 @default.
• W62982523 cites W1665484771 @default.
• W62982523 cites W1732718895 @default.
• W62982523 cites W1857205173 @default.
• W62982523 cites W1863041405 @default.
• W62982523 cites W1881100630 @default.
• W62982523 cites W1881569770 @default.
• W62982523 cites W1927925500 @default.
• W62982523 cites W1967291734 @default.
• W62982523 cites W1967677164 @default.
• W62982523 cites W1972940641 @default.
• W62982523 cites W1977953443 @default.
• W62982523 cites W1978964594 @default.
• W62982523 cites W1981148746 @default.
• W62982523 cites W1981393348 @default.
• W62982523 cites W1981610984 @default.
• W62982523 cites W1982511384 @default.
• W62982523 cites W1997320786 @default.
• W62982523 cites W2003328301 @default.
• W62982523 cites W2004067246 @default.
• W62982523 cites W2004643557 @default.
• W62982523 cites W2005229107 @default.
• W62982523 cites W2007285919 @default.
• W62982523 cites W2007878105 @default.
• W62982523 cites W2008522363 @default.
• W62982523 cites W2008691114 @default.
• W62982523 cites W2009105768 @default.
• W62982523 cites W2009823019 @default.
• W62982523 cites W2009978384 @default.
• W62982523 cites W2013743083 @default.
• W62982523 cites W2018194659 @default.
• W62982523 cites W2027707363 @default.
• W62982523 cites W2029540050 @default.
• W62982523 cites W2030874315 @default.
• W62982523 cites W2035686085 @default.
• W62982523 cites W2037057633 @default.
• W62982523 cites W2039237691 @default.
• W62982523 cites W2042601191 @default.
• W62982523 cites W2042658016 @default.
• W62982523 cites W2049671505 @default.
• W62982523 cites W2050229001 @default.
• W62982523 cites W2053154970 @default.
• W62982523 cites W2054570239 @default.
• W62982523 cites W2058760785 @default.
• W62982523 cites W2064717403 @default.
• W62982523 cites W2064823137 @default.
• W62982523 cites W2065359884 @default.
• W62982523 cites W2066746339 @default.
• W62982523 cites W2068142427 @default.
• W62982523 cites W2069736034 @default.
• W62982523 cites W2070307271 @default.
• W62982523 cites W2076672138 @default.
• W62982523 cites W2077622300 @default.
• W62982523 cites W2078504914 @default.
• W62982523 cites W2081526793 @default.
• W62982523 cites W2083557443 @default.
• W62982523 cites W2083939386 @default.
• W62982523 cites W2087692971 @default.
• W62982523 cites W2088028234 @default.
• W62982523 cites W2089420500 @default.
• W62982523 cites W2090949534 @default.
• W62982523 cites W2098483964 @default.
• W62982523 cites W2099631688 @default.
• W62982523 cites W2101257593 @default.
• W62982523 cites W2101451656 @default.
• W62982523 cites W2101512165 @default.
• W62982523 cites W2109428365 @default.
• W62982523 cites W2116450410 @default.
• W62982523 cites W2124696116 @default.
• W62982523 cites W2126985755 @default.
• W62982523 cites W2129963397 @default.
• W62982523 cites W2131790480 @default.
• W62982523 cites W2133097426 @default.
• W62982523 cites W2136053441 @default.
• W62982523 cites W2147705375 @default.
• W62982523 cites W2148334620 @default.
• W62982523 cites W2151854647 @default.
• W62982523 cites W2155490532 @default.
• W62982523 cites W2162598207 @default.

• next