ERIC Number: EJ1270898
Record Type: Journal
Publication Date: 2020-Nov
Pages: 30
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0022-4308
EISSN: N/A
Available Date: N/A
Identifying Patterns of Students' Performance on Simulated Inquiry Tasks Using PISA 2015 Log-File Data
Teig, Nani; Scherer, Ronny; Kjaernsli, Marit
Journal of Research in Science Teaching, v57 n9 p1400-1429 Nov 2020
Previous research has demonstrated the potential of examining log-file data from computer-based assessments to understand student interactions with complex inquiry tasks. Rather than solely providing information about what has been achieved or the accuracy of student responses ("product data"), students' log files offer additional insights into how the responses were produced ("process data"). In this study, we examined students' log files to detect patterns of students' interactions with computer-based assessment and to determine whether unique characteristics of these interactions emerge as distinct profiles of inquiry performance. Knowledge about the characteristics of these profiles can shed light on why some students are more successful at solving simulated inquiry tasks than others and how to support student understanding of scientific inquiry through computer-based environments. We analyzed the Norwegian PISA 2015 log-file data, science performance as well as background questionnaire (N = 1,222 students) by focusing on two inquiry tasks, which required scientific reasoning skills: coordinating the effects of multiple variables and coordinating theory and evidence. Using a mixture modeling approach, we identified three distinct profiles of students' inquiry performance: "strategic," "emergent," and "disengaged." These profiles revealed different characteristics of students' exploration behavior, inquiry strategy, time-on-task, and item accuracy. Further analyses showed that students' assignment to these profiles varied according to their demographic characteristics (gender, socio-economic status, and language at home), attitudes (enjoyment in science, self-efficacy, and test anxiety), and science achievement. Although students' profiles on the two inquiry tasks were significantly related, we also found some variations in the proportion of students' transitions between profiles. Our study contributes to understanding how students interact with complex simulated inquiry tasks and showcases how log-file data from PISA 2015 can aid this understanding.
Descriptors: Science Process Skills, Thinking Skills, Inquiry, Simulation, Achievement Tests, Foreign Countries, Secondary School Students, International Assessment, Problem Solving, Computer Assisted Testing, Time on Task, Demography, Profiles, Science Achievement, Data Analysis
Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www-wiley-com.bibliotheek.ehb.be/en-us
Publication Type: Journal Articles; Reports - Research
Education Level: Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Norway
Identifiers - Assessments and Surveys: Program for International Student Assessment
Grant or Contract Numbers: N/A
Author Affiliations: N/A