A professor comes up with an exam to measure learning in students. The exam is given two separate times in six different classes. The professor finds that for ALL classes students showed a consistent (similar magnitude) improvement in performance from time 1 to time 2. When comparing the performance of each class at time 1 the professor found that the results were not consistent (large variability in scores).
True or False: In the above scenario the exam most likely had problems with test-retest reliability rather than inter-rater reliability.
Answer: True
Explanation
Test-retest reliability indicates the repeatability of test scores with the passage of time. This estimate also reflects the stability of the characteristic or construct being measured by the test. In this case, learning in students is measured at two separate times.
Inter-rater reliability indicates how consistent test scores are likely to be if the test is scored by two or more raters. In this case, test is scored by same professor both the time so inter rater reliability is not applicable.
Get Answers For Free
Most questions answered within 1 hours.