Abstract/Details

An alternative examinee-centered standard setting strategy


2007 2007

Other formats: Order a copy

Abstract (summary)

This study examined an alternative examinee-centered standard setting method that is a modification of the Contrasting Groups method called the Modified Contrasting Groups method (MCGM). The alternative method was designed to be affordable, not too complex computationally, and done in a reasonable amount of time. The study investigated how well the alternative method produced results that are approximately equivalent to other standard setting methods. The results generated by the MCGM were compared to the results produced by the Angoff method, Contrasting Groups method, and the Borderline Group method.

Two variations of the alternative method (MCGM 1 and MCGM 2) were explored in the study. MCGM 1 and MCGM 2 are based on having teacher predictions of student performance and the students' actual performance or scores on an assessment. The MCGM 1 and MCGM 2 follow different but standard mathematical procedures that are easy to follow. The calculation for the MCGM 1 requires finding the median score for each performance category, then calculating the average of the two adjacent performance categories. MCGM 2 is based on combining the adjacent performance categories and calculating a median value of the scores in the two adjacent categories.

This study found that MCGM 1 and MCGM 2 produced cut scores higher than the Angoff and Contrasting Groups method on average, but lower than the Borderline Group method. The study also found the MCGM 1 and MCGM 2 consistently produced different cut scores using the same data sets.

The MCGM 1 and MCGM 2 appear to be viable standard setting methods for many school districts in Nebraska to use to meet state and federal reporting requirements. For some districts, either or both of these variations could be added to what is currently in place to provide a range of plausible cut scores. For other districts, this method could be adopted as the sole cut score method.

Indexing (details)


Subject
Educational evaluation;
Psychological tests
Classification
0288: Educational evaluation
0632: Psychological tests
Identifier / keyword
Education; Psychology; Angoff method; Contrasting groups; Examinee-centered; Standard-setting
Title
An alternative examinee-centered standard setting strategy
Author
Irwin, Patrick M.
Number of pages
145
Publication year
2007
Degree date
2007
School code
0138
Source
DAI-B 67/12, Dissertation Abstracts International
Place of publication
Ann Arbor
Country of publication
United States
Advisor
Impara, James C.
University/institution
The University of Nebraska - Lincoln
University location
United States -- Nebraska
Degree
Ph.D.
Source type
Dissertations & Theses
Language
English
Document type
Dissertation/Thesis
Dissertation/thesis number
3245357
ProQuest document ID
304826952
Copyright
Database copyright ProQuest LLC; ProQuest does not claim copyright in the individual underlying works.
Document URL
http://search.proquest.com/docview/304826952
Access the complete full text

You can get the full text of this document if it is part of your institution's ProQuest subscription.

Try one of the following:

  • Connect to ProQuest through your library network and search for the document from there.
  • Request the document from your library.
  • Go to the ProQuest login page and enter a ProQuest or My Research username / password.