ERIC Number: EJ1317021
Record Type: Journal
Publication Date: 2021-Dec
Pages: 15
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0734-2829
EISSN: N/A
Available Date: N/A
Evaluating a Computerized Adaptive Testing Version of a Cognitive Ability Test Using a Simulation Study
Tsaousis, Ioannis; Sideridis, Georgios D.; AlGhamdi, Hannan M.
Journal of Psychoeducational Assessment, v39 n8 p954-968 Dec 2021
This study evaluated the psychometric quality of a computerized adaptive testing (CAT) version of the general cognitive ability test (GCAT), using a simulation study protocol put forth by Han, K. T. (2018a). For the needs of the analysis, three different sets of items were generated, providing an item pool of 165 items. Before evaluating the efficiency of the GCAT, all items in the final item pool were linked (equated), following a sequential approach. Data were generated using a standard normal for 10,000 virtual individuals (M = 0 and SD = 1). Using the measure's 165-item bank, the ability value ([theta]) for each participant was estimated. Maximum Fisher information (MFI) and maximum likelihood estimation with fences (MLEF) were used as item selection and score estimation methods, respectively. For item exposure control, the fade away method (FAM) was preferred. The termination criterion involved a minimum SE [less than or equal to]0.33. The study revealed that the average number of items administered for 10,000 participants was 15. Moreover, the precision level in estimating the participant's ability score was very high, as demonstrated by the CBIAS, CMAE, and CRMSE). It is concluded that the CAT version of the test is a promising alternative to administering the corresponding full-length measure since it reduces the number of administered items, prevents high rates of item exposure, and provides accurate scores with minimum measurement error.
Descriptors: Computer Assisted Testing, Adaptive Testing, Cognitive Tests, Cognitive Ability, Simulation, Psychometrics, Test Items, Item Banks, Monte Carlo Methods, Foreign Countries, Error of Measurement, Accuracy, Scores, High Stakes Tests
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com.bibliotheek.ehb.be
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Saudi Arabia
Identifiers - Assessments and Surveys: Cognitive Abilities Test
Grant or Contract Numbers: N/A
Author Affiliations: N/A