Matches in SemOpenAlex for { <https://semopenalex.org/work/W3120402391> ?p ?o ?g. }
- W3120402391 abstract "Rating scales are widely used to rate working dog behavior and performance. Whilst behaviour scales have been extensively validated, instruments used to rate ability have usually been designed by training and practitioner organizations, and often little consideration has been given to how seemingly insignificant aspects of the scale design might alter the validity of the results obtained. Here we illustrate how manipulating one aspect of rating scale design, the provision of verbal benchmarks or labels (as opposed to just a numerical scale), can affect the ability of observers to distinguish between differing levels of search dog performance in an operational environment. Previous studies have found evidence for range restriction (using only part of the scale) in raters' use of the scales and variability between raters in their understanding of the traits used to measures performance. As provision of verbal benchmarks has been shown to help raters in a variety of disciplines to select appropriate scale categories (or scores), it may be predicted that inclusion of verbal benchmarks will bring raters' conceptualization of the traits closer together, increasing agreement between raters, as well as improving the ability of observers to distinguish between differing levels of search dog performance and reduce range restriction. To test the value of verbal benchmarking we compared inter-rater reliability, raters' ability to discriminate between different levels of search dog performance, and their use of the whole scale before and after being presented with benchmarked scales for the same traits. Raters scored the performance of two separate types of explosives search dog (High Assurance Search (HAS) and Vehicle Search (VS) dogs), from short (~30 s) video clips, using 11 previously validated traits. Taking each trait in turn, for the first five clips raters were asked to give a score from 1, representing the lowest amount of the trait evident to 5, representing the highest. Raters were given a list of adjective-based benchmarks (e.g., very low, low, intermediate, high, very high) and scored a further five clips for each trait. For certain traits, the reliability of scoring improved when benchmarks were provided (e.g., Motivation and Independence), indicating that their inclusion may potentially reduce ambivalence in scoring, ambiguity of meanings, and cognitive difficulty for raters. However, this effect was not universal, with the ratings of some traits remaining unchanged (e.g., Control), or even reducing in reliability (e.g., Distraction). There were also some differences between VS and HAS (e.g., Confidence reliability increased for VS raters and decreased for HAS raters). There were few improvements in the spread of scores across the range, but some indication of more favorable scoring. This was a small study of operational handlers and trainers utilizing training video footage from realistic operational environments, and there are potential cofounding effects. We discuss possible causal factors, including issues specific to raters and possible deficiencies in the chosen benchmarks, and suggest ways to further improve the effectiveness of rating scales. This study illustrates why it is vitally important to validate all aspects of rating scale design, even if they may seem inconsequential, as relatively small changes to the amount and type of information provided to raters can have both positive and negative impacts on the data obtained." @default.
- W3120402391 created "2021-01-18" @default.
- W3120402391 creator A5008042856 @default.
- W3120402391 creator A5024214256 @default.
- W3120402391 date "2021-02-02" @default.
- W3120402391 modified "2023-10-15" @default.
- W3120402391 title "Does Benchmarking of Rating Scales Improve Ratings of Search Performance Given by Specialist Search Dog Handlers?" @default.
- W3120402391 cites W1594189264 @default.
- W3120402391 cites W1965962130 @default.
- W3120402391 cites W1966336822 @default.
- W3120402391 cites W1968605622 @default.
- W3120402391 cites W1977555871 @default.
- W3120402391 cites W1985364402 @default.
- W3120402391 cites W1995845338 @default.
- W3120402391 cites W2002168559 @default.
- W3120402391 cites W2004336967 @default.
- W3120402391 cites W2004396417 @default.
- W3120402391 cites W2016972388 @default.
- W3120402391 cites W2017489436 @default.
- W3120402391 cites W2032951610 @default.
- W3120402391 cites W2033701875 @default.
- W3120402391 cites W2034983699 @default.
- W3120402391 cites W2036205579 @default.
- W3120402391 cites W2047432127 @default.
- W3120402391 cites W2048370658 @default.
- W3120402391 cites W2053792585 @default.
- W3120402391 cites W2080630662 @default.
- W3120402391 cites W2084057771 @default.
- W3120402391 cites W2089927577 @default.
- W3120402391 cites W2091231730 @default.
- W3120402391 cites W2096419106 @default.
- W3120402391 cites W2103309386 @default.
- W3120402391 cites W2104665510 @default.
- W3120402391 cites W2114772172 @default.
- W3120402391 cites W2115389369 @default.
- W3120402391 cites W2117126243 @default.
- W3120402391 cites W2121168102 @default.
- W3120402391 cites W2124814135 @default.
- W3120402391 cites W2126488987 @default.
- W3120402391 cites W2128355832 @default.
- W3120402391 cites W2131052661 @default.
- W3120402391 cites W2137071805 @default.
- W3120402391 cites W2141403362 @default.
- W3120402391 cites W2142428509 @default.
- W3120402391 cites W2146066738 @default.
- W3120402391 cites W2149941633 @default.
- W3120402391 cites W2152988415 @default.
- W3120402391 cites W2153881322 @default.
- W3120402391 cites W2154283129 @default.
- W3120402391 cites W2163935009 @default.
- W3120402391 cites W2169508195 @default.
- W3120402391 cites W2298303368 @default.
- W3120402391 cites W2908891017 @default.
- W3120402391 cites W2922982447 @default.
- W3120402391 cites W3023605499 @default.
- W3120402391 cites W3085239123 @default.
- W3120402391 cites W3122519107 @default.
- W3120402391 cites W3176805996 @default.
- W3120402391 cites W4213388807 @default.
- W3120402391 cites W4234180827 @default.
- W3120402391 cites W4241246521 @default.
- W3120402391 doi "https://doi.org/10.3389/fvets.2021.545398" @default.
- W3120402391 hasPubMedCentralId "https://www.ncbi.nlm.nih.gov/pmc/articles/7884446" @default.
- W3120402391 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/33604364" @default.
- W3120402391 hasPublicationYear "2021" @default.
- W3120402391 type Work @default.
- W3120402391 sameAs 3120402391 @default.
- W3120402391 citedByCount "3" @default.
- W3120402391 countsByYear W31204023912021 @default.
- W3120402391 countsByYear W31204023912022 @default.
- W3120402391 crossrefType "journal-article" @default.
- W3120402391 hasAuthorship W3120402391A5008042856 @default.
- W3120402391 hasAuthorship W3120402391A5024214256 @default.
- W3120402391 hasBestOaLocation W31204023911 @default.
- W3120402391 hasConcept C121332964 @default.
- W3120402391 hasConcept C136197465 @default.
- W3120402391 hasConcept C138496976 @default.
- W3120402391 hasConcept C144133560 @default.
- W3120402391 hasConcept C154945302 @default.
- W3120402391 hasConcept C15744967 @default.
- W3120402391 hasConcept C162853370 @default.
- W3120402391 hasConcept C163258240 @default.
- W3120402391 hasConcept C180747234 @default.
- W3120402391 hasConcept C2776035688 @default.
- W3120402391 hasConcept C2778755073 @default.
- W3120402391 hasConcept C41008148 @default.
- W3120402391 hasConcept C43214815 @default.
- W3120402391 hasConcept C46312422 @default.
- W3120402391 hasConcept C62520636 @default.
- W3120402391 hasConcept C75630572 @default.
- W3120402391 hasConcept C77805123 @default.
- W3120402391 hasConcept C83849319 @default.
- W3120402391 hasConcept C86251818 @default.
- W3120402391 hasConcept C90734943 @default.
- W3120402391 hasConceptScore W3120402391C121332964 @default.
- W3120402391 hasConceptScore W3120402391C136197465 @default.
- W3120402391 hasConceptScore W3120402391C138496976 @default.
- W3120402391 hasConceptScore W3120402391C144133560 @default.
- W3120402391 hasConceptScore W3120402391C154945302 @default.
- W3120402391 hasConceptScore W3120402391C15744967 @default.