Question

Third scenario( all three scenarios needs an answer)

An HR professional has designed a test her organization can use as part of the selection process for maintenance staff. The test requires applicants to perform maintenance activities and be rated by two experts. How may the raters scores be checked for reliability?

What method (test-retest method, alternative-form method, or internai consistency method)can be used, why this particular method is appropriate, and what steps should be taken to assess reliability for the method used in this scenario?

Answer 1

In this case, the HR professional should use the internal consistency method to assess reliability. This is because two different types of evaluations are used and internal consistency can help measure whether several items that propose to measure the same general construct produce similar scores. It is also more practical compared to the other techniques as the reliability can be obtained through a single administration of the same test. Cronbach’s alpha is one of the most widely reported measures of internal consistency.