NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
PDF on ERIC Download full text
ERIC Number: EJ1331572
Record Type: Journal
Publication Date: 2022
Pages: 25
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-1562-0506
EISSN: N/A
Available Date: N/A
Reliability Analysis of PISA 2018 Reading Literacy Student Questionnaire Based on Item Response Theory (IRT): Turkey Sample
Polat, Murat; Toraman, Çetin; Turhan, Nihan Sölpük
International Journal of Curriculum and Instruction, v14 n1 p1004-1028 2022
PISA (Program for International Student Assessment) tests have enabled the OECD countries to see not only the success of their students in gaining the ability to solve some daily problems they may encounter in their lives but also the place in the world rankings as a result of an objective evaluation comparing the achievement results of participant countries. Therefore, it is very important for the reliability and prestige of the program that the PISA exams and related student survey results are as unbiassed and error-free as possible. In this paper, validity and reliability study of the PISA 2018 Reading Literacy Student Survey (RLSS) Turkey sample was conducted including the analysis of survey items within the framework of Item Response Theory (IRT). The item fit indexes, item parameters according to the GPCM (Generalized Partial Credit Model), standard error values and item characteristics' reliability of the survey were determined via IRT, respectively. The data set included the answers of 6111 15-year-old Turkish students participated in PISA 2018. In the data analysis, through using the local independence assumption, Q3 statistics; IRT calibrations were tested with the help of the "Mirt v.1.30" program within the scope of "R v.4.0.5". In the study, each set of questions in the PISA student survey was examined independently from each other and each question set was considered as a separate attitude scale. The results showed that, although some of the items in PISA 2018 (RLSS) gave low level information, all the question sets in the test provided an acceptable model fit according to the GPCM. Upon examining the item characteristic curves, it was understood that the survey items showed valid and reliable results for testing different ability levels.
World Council for Curriculum and Instruction. California School of Education, Alliant International University, 10455 Pomerado Road, San Diego, CA 92131. Web site: http://ijci.wcci-international.org/index.php/IJCI/about
Publication Type: Journal Articles; Reports - Research
Education Level: Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Turkey
Identifiers - Assessments and Surveys: Program for International Student Assessment
Grant or Contract Numbers: N/A
Author Affiliations: N/A