Same Test, Better Scores: Boosting the ...
Document type :
Compte-rendu et recension critique d'ouvrage
Title :
Same Test, Better Scores: Boosting the Reliability of Short Online Intelligence Recruitment Tests with Nested Logit Item Response Theory Models
Author(s) :
Storme, Martin [Auteur]
Lille économie management - UMR 9221 [LEM]
Myszkowski, Nils [Auteur]
Baron, Simon [Auteur]
Bernard, David [Auteur]
Lille économie management - UMR 9221 [LEM]
Myszkowski, Nils [Auteur]
Baron, Simon [Auteur]
Bernard, David [Auteur]
Journal title :
Journal of Intelligence
Pages :
17
Publisher :
MDPI
Publication date :
2019-09
ISSN :
2079-3200
English keyword(s) :
E-assessment
general mental ability
nested logit models
item-response theory
ability-based guessing
general mental ability
nested logit models
item-response theory
ability-based guessing
HAL domain(s) :
Sciences de l'Homme et Société/Gestion et management
English abstract : [en]
Assessing job applicants’ general mental ability online poses psychometric challenges due to the necessity of having brief but accurate tests. Recent research (Myszkowski & Storme, 2018) suggests that recovering distractor ...
Show more >Assessing job applicants’ general mental ability online poses psychometric challenges due to the necessity of having brief but accurate tests. Recent research (Myszkowski & Storme, 2018) suggests that recovering distractor information through Nested Logit Models (NLM; Suh & Bolt, 2010) increases the reliability of ability estimates in reasoning matrix-type tests. In the present research, we extended this result to a different context (online intelligence testing for recruitment) and in a larger sample ( N=2949 job applicants). We found that the NLMs outperformed the Nominal Response Model (Bock, 1970) and provided significant reliability gains compared with their binary logistic counterparts. In line with previous research, the gain in reliability was especially obtained at low ability levels. Implications and practical recommendations are discussed.Show less >
Show more >Assessing job applicants’ general mental ability online poses psychometric challenges due to the necessity of having brief but accurate tests. Recent research (Myszkowski & Storme, 2018) suggests that recovering distractor information through Nested Logit Models (NLM; Suh & Bolt, 2010) increases the reliability of ability estimates in reasoning matrix-type tests. In the present research, we extended this result to a different context (online intelligence testing for recruitment) and in a larger sample ( N=2949 job applicants). We found that the NLMs outperformed the Nominal Response Model (Bock, 1970) and provided significant reliability gains compared with their binary logistic counterparts. In line with previous research, the gain in reliability was especially obtained at low ability levels. Implications and practical recommendations are discussed.Show less >
Language :
Anglais
Popular science :
Non
Collections :
Source :
Files
- https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6789760/pdf
- Open access
- Access the document
- Open access
- Access the document