0543163 - ÚI 2022 RIV GB eng J - Journal Article
Goldhaber, D. - Grout, C. - Wolff, M. - Martinková, Patrícia
Evidence on the Dimensionality and Reliability of Professional References’ Ratings of Teacher Applicants.
Economics of Education Review. Roč. 83, August 2021 (2021), č. článku 102130. ISSN 0272-7757. E-ISSN 1873-7382
R&D Projects: GA ČR(CZ) GA21-03658S
Institutional support: RVO:67985807
Keywords : Educational economics * Human capital * Teacher hiring
OECD category: Statistics and probability
Impact factor: 2.083, year: 2021 ; AIS: 1.754, rok: 2021
Method of publishing: Limited access
Result website:
http://dx.doi.org/10.1016/j.econedurev.2021.102130DOI: https://doi.org/10.1016/j.econedurev.2021.102130

There is growing interest in using measures of teacher applicant quality to improve hiring decisions, but the statistical properties of such measures are not well understood. We use unique data on structured ratings solicited from the references of teacher applicants to explore the dimensionality of measures of teacher applicant quality and the inter-rater reliability of the reference ratings. Despite questions about applicants designed to capture multiple dimensions of quality, factor analysis suggests that the reference ratings only capture one underlying dimension. Point estimates of inter-rater reliability range between 0.23 and 0.31 and are significantly lower for novice applicants. It is difficult to judge whether these levels of reliability are high or low in the current context given so little evidence on applicant assessment tools.
Permanent Link: http://hdl.handle.net/11104/0320440