Question

Describe at least three effective methods for improving reliability of a classroom test?

What does interrater reliability measure? In what types of cases or assessments is it important?

Describe the factors that influence reliability. Provide an example of each.

A reliability coefficient (r) and a standard error of measurement(SEM) were computed on a test with 10 items. What would happen to those statistics if the test was increased to forty items?

Answer 1

1)

The methods for improving reliability of classroom tests are as follows:

1. Write longer tests.
2. Pay more attention to the careful construction of the test questions.
3. Write clear directions and use standard administrative procedures.

2)

Inter-rater reliability is the level of agreement between raters or judges. If all are believes, IRR is 1 (or 100%) and if all are not believes, IRR is 0 (0%).

There are several methods exists for assessing the inter-ratee reliability.

They are as follows:

a. Percent Agreement

b. Cohen's Kappa

c. Interclass correlation

d. Flies Kappa

The above mentioned methods are used to depends on the number of data values and number of raters available.