Due to scheduled system maintenance, LSAC customer service representatives will be available only from 8:30 a.m. to 5 p.m. ET on Thursday, March 27. We will return to our normal schedule, 8:30 a.m. to 8 p.m. ET, on Friday, March 28.

Test Security

Detection of Invalid Test Scores on Admission Tests: A Simulation Study Using Person-Fit Statistics (RR 15-03)

by Jorge N. Tendeiro, Rob R. Meijer, and Casper J. Albers, University of Groningen, Groningen, the Netherlands

While an admission test may strongly predict success in university or law school programs for most test takers, there may be some test takers who are mismeasured. To address this issue, a class of statistics called person-fit statistics is used to check the validity of individual test scores. However, most person-fit statistics are designed for a single test, and not much is known about the performance of these statistics for admission tests consisting of multiple highly correlated subtests. In this study, the performance of a number of person-fit statistics was evaluated based on data that simulated aberrant responding on highly correlated subtests. The results indicated that two of the statistics outperformed the others.

Back to report gallery

Request the full report

Additional reports in this collection

Detecting Groups of Test Takers Involved in Test...

Test collusion (TC) is the sharing of test materials or answers to test questions (items) before or during a test. Because of the potentially large advantages for the test takers involved, TC poses a serious threat to the validity of score interpretations. The proposed approach applies graph theory methodology to response similarity analyses to identify groups involved in TC while minimizing the false-positive detection rate. The new approach is illustrated and compared with a recently published method using real and simulated data.

Read More

A New Approach to Detecting Cluster Aberrancy (RR 16-05)

This report addresses a general type of cluster aberrancy in which a subgroup of test takers has an unfair advantage on some subset of administered items. Examples of cluster aberrancy include item preknowledge and test collusion. In general, cluster aberrancy is hard to detect due to the multiple unknowns involved: Unknown subgroups of test takers have an unfair advantage on unknown subsets of items. The issue of multiple unknowns makes the detection of cluster aberrancy a challenging problem from the standpoint of applied mathematics.

Read More