Workshop 5
Establishing the ITC Guidelines on quality control in scoring, analysis and reporting of test scores
Avi Allalouf
National Institute for Testing and Evaluation, Israel
Abstract
In scoring, test analysis and the reporting of test scores, accuracy is essential. An inaccurate score resulting from wrong judgment, incorrect conversion of raw scores to standard scores, or accidental reporting of scores to the wrong client, are all examples of mistakes that should not occur.
Since 2008, the ITC has been developing a new set of Quality Control (QC) Guidelines for all types of measurement – psychological, educational and occupational. A draft of the Guidelines, constructed by Avi Allalouf with the help of Marise Born was distributed to eleven experts from various disciplines and different countries. They did tremendous work and their comments were of great value in revising the draft.
In the workshop the current version of the QC Guidelines will be presented and explained. Then, errors that might occur at each stage will be discussed, as well as examples and QC procedures for avoiding, detecting or correcting these mistakes. Models that deal with the causes of human error and ways to predict and reduce error will also be presented. Participants will be given hands-on practice in detecting various types of errors.
|