ERIC Number: EJ1356010
Record Type: Journal
Publication Date: 2019
Pages: 22
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: EISSN-2079-3200
Available Date: N/A
Same Test, Better Scores: Boosting the Reliability of Short Online Intelligence Recruitment Tests with Nested Logit Item Response Theory Models
Storme, Martin; Myszkowski, Nils; Baron, Simon; Bernard, David
Journal of Intelligence, v7 Article 17 2019
Assessing job applicants' general mental ability online poses psychometric challenges due to the necessity of having brief but accurate tests. Recent research (Myszkowski & Storme, 2018) suggests that recovering distractor information through Nested Logit Models (NLM; Suh & Bolt, 2010) increases the reliability of ability estimates in reasoning matrix-type tests. In the present research, we extended this result to a different context (online intelligence testing for recruitment) and in a larger sample (N=2949 job applicants). We found that the NLMs outperformed the Nominal Response Model (Bock, 1970) and provided significant reliability gains compared with their binary logistic counterparts. In line with previous research, the gain in reliability was especially obtained at low ability levels. Implications and practical recommendations are discussed.
Descriptors: Intelligence Tests, Item Response Theory, Comparative Analysis, Test Reliability, Job Applicants, Cognitive Ability, Psychometrics, Models, Test Format, Computer Assisted Testing, Recruitment, Item Analysis, Guessing (Tests), Test Items, Foreign Countries
MDPI AG. Klybeckstrasse 64, 4057 Basel, Switzerland. e-mail: indexing@mdpi.com; e-mail: jintelligence@mdpi.com; Web site: https://www.mdpi.com/journal/jintelligence
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: N/A
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: France
Grant or Contract Numbers: N/A
Author Affiliations: N/A