ERIC Number: ED625305
Record Type: Non-Journal
Publication Date: 2020-Apr-19
Pages: 12
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: N/A
Ill-Defined but Well-Measured? Validating Measures of Noncognitive Skills in Large-Scale Assessments
Borgonovi, Francesca; Ferrara, Alessandro; Piacentini, Mario
AERA Online Paper Repository, Paper prepared for the Annual Meeting of the American Educational Research Association (Online, Apr 17-21, 2020)
Non-cognitive skills are routinely measured using self-reports in the context of large-scale international assessments. However questions remain on the adequacy of self-reports to conduct comparisons. Measures that exploit test-taker's behaviour during the completion of questionnaires or of the cognitive tests have been proposed in the literature but little is known about their properties. We evaluate these measures using PISA data. High correlation with self-reported questionnaires and with test performance suggest that behavioural indicators measure what they are supposed to measure. Differences by gender and socio-economic status are in line with expectations. However, some measures are sensitive to the design of the test and questionnaire, and some predict better than others life outcomes of students ten years after the PISA test.
Descriptors: Evaluation Methods, Measures (Individuals), Student Evaluation, Validity, Achievement Tests, Foreign Countries, Secondary School Students, International Assessment, Student Behavior, Prediction
AERA Online Paper Repository. Available from: American Educational Research Association. 1430 K Street NW Suite 1200, Washington, DC 20005. Tel: 202-238-3200; Fax: 202-238-3250; e-mail: subscriptions@aera.net; Web site: http://www.aera.net
Publication Type: Speeches/Meeting Papers; Reports - Research
Education Level: Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Program for International Student Assessment
Grant or Contract Numbers: N/A
Author Affiliations: N/A