Computerized adaptive test item response times for correct and incorrect pretest and operational items: Testing fairness and test -taking strategies

2007 2007

Other formats: Order a copy

Abstract (summary)

This study examined the amount of time spent on pretest and operational items that are answered correctly and incorrectly by different ability examinees when taking a computerized adaptive test (CAT). Consistent with other research, the results indicate that higher ability examinees spend more time than lower ability examinees on all items, regardless of whether the items are tailored to their ability level (operational items) or not (pretest items). It was expected, based on the literature, that examinees would spend more time on test questions they answered incorrectly than correctly. This was the case for most of the items, but not the ones near the end of the CAT, suggesting that examinees may not have sufficient time or motivation to devote to these items.

Seven testing fairness issues related to a CAT were addressed along with recommendations. Five test-taking strategies derived from the results were provided to help ensure testing fairness. The presence of pretesting was found either to benefit or hinder examinees depending on their ability levels due to disproportionate amounts of time and effort used by these examinees with different ability levels on these items. Generally, examinees with lower ability levels have more time remaining after they finish the test than do examinees with higher ability levels.

A design feature for a CAT that uses a time management wizard, time reminder, and pacing guidance to help examines to move through a test was proposed for future development. Finally, several recommendations to ensure testing fairness were provided for the future examiners’ manual.

Indexing (details)

Educational evaluation;
Psychological tests;
Educational software
0288: Educational evaluation
0632: Psychological tests
0710: Educational software
Identifier / keyword
Education; Psychology; Computerized adaptive test; Fairness; Item response; Operational items; Pretest; Test-taking strategies
Computerized adaptive test item response times for correct and incorrect pretest and operational items: Testing fairness and test -taking strategies
Chang, Shu-Ren
Number of pages
Publication year
Degree date
School code
DAI-A 67/10, Dissertation Abstracts International
Place of publication
Ann Arbor
Country of publication
United States
Plake, Barbara S.
The University of Nebraska - Lincoln
University location
United States -- Nebraska
Source type
Dissertations & Theses
Document type
Dissertation/thesis number
ProQuest document ID
Database copyright ProQuest LLC; ProQuest does not claim copyright in the individual underlying works.
Document URL
Access the complete full text

You can get the full text of this document if it is part of your institution's ProQuest subscription.

Try one of the following:

  • Connect to ProQuest through your library network and search for the document from there.
  • Request the document from your library.
  • Go to the ProQuest login page and enter a ProQuest or My Research username / password.