ERIC Number: EJ1445583
Record Type: Journal
Publication Date: 2024
Pages: 11
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-2518-0169
EISSN: EISSN-2410-9991
Available Date: N/A
Reliability and Separation Index Analysis of Mathematics Questions Integrated with the Cultural Architecture Framework Using the Rasch Model
Journal of Education and e-Learning Research, v11 n3 p499-509 2024
This research uses Rasch model analysis to identify the reliability and separation index of an integrated mathematics test instrument with a cultural architecture structure in measuring students' mathematical thinking abilities. The study involved 357 students from six eighth-grade public junior high schools in Bima. The selection of schools was based on average school exam scores and considered the effectiveness of the learning process that used cultural settings to explore mathematical content. Data analysis was conducted using Microsoft Excel to calculate the content validity of Aiken's index with four experts and the jMetrik software to measure reliability and the separation index. The research results indicate that the mathematics test instrument passed validation by mathematics experts and measurements with a valid content validity level. Rasch model calibration shows a very high level of instrument reliability. Separation analysis on the logit scale indicates the instrument's ability to differentiate students with different ability levels with good homogeneity in the distribution of test items and individual abilities. Scale quality statistics show good item response variability, low error rates and a high separation index. This study has limitations because it focuses solely on multiple-choice questions. Similar research must be conducted using other types of questions (such as those used in PISA, namely openconstructed and closed-constructed questions) and integrating other mathematical materials within relevant cultural architectural structures.
Descriptors: Mathematics Tests, Item Response Theory, Test Reliability, Indexes, Thinking Skills, Junior High School Students, Grade 8, Foreign Countries, Learning Processes, Culture Fair Tests, Test Items, Multiple Choice Tests, Mathematics Achievement, Learner Engagement
Asian Online Journal Publishing Group. 244 Fifth Avenue Suite D42, New York, NY 10001. Fax: 212-591-6094; e-mail: info@asianonlinejournals.com; Web site: http://www.asianonlinejournals.com
Publication Type: Journal Articles; Reports - Research
Education Level: Junior High Schools; Middle Schools; Secondary Education; Elementary Education; Grade 8
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Indonesia
Grant or Contract Numbers: N/A
Author Affiliations: N/A