Title
Optimal detection of certain forms of inappropriate test scores
Abstract
Optimal appropriateness indices, recently introduced
by Levine and Drasgow (1984), provide the highest
rates of detection of aberrant response patterns that
can be obtained from item responses. In this article
they are used to study three important problems in appropriateness
measurement. First, the maximum detection
rates of two particular forms of aberrance are determined
for a long unidimensional test. These
detection rates are shown to be moderately high. Second,
two versions of the standardized l0 appropriateness
index are compared to optimal indices. At low
false alarm rates, one standardized l0 index has detection
rates that are about 65% as large as optimal for
spuriously high (cheating) test scores. However, for
the spuriously low scores expected from persons with
ill-advised testing strategies or reading problems, both
standardized l0 indices are far from optimal. Finally,
detection rates for polychotomous and dichotomous
scorings of the item responses are compared. It is
shown that dichotomous scoring causes serious decreases
in the detectability of some aberrant response
patterns. Consequently, appropriateness measurement
constitutes one practical testing problem in which significant
gains result from the use of a polychotomous
item response model.
Identifiers
other: doi:10.1177/014662168601000105
Previously Published Citation
Drasgow, Fritz & Levine, Michael V. (1986). Optimal detection of certain forms of inappropriate test scores. Applied Psychological Measurement, 10, 59-67. doi:10.1177/014662168601000105
Suggested Citation
Drasgow, Fritz; Levine, Michael V..
(1986).
Optimal detection of certain forms of inappropriate test scores.
Retrieved from the University of Minnesota Digital Conservancy,
https://hdl.handle.net/11299/102260.