Even though guessing biases difficulty estimates as a function of item difficulty in the dichotomous Rasch model, assessment programs with tests which include multiple-choice items often construct scales using this model. Research has shown that when all items are multiple-choice, this bias can largely be eliminated. However, many assessments have…

In this study, we propose aggregating test scores with unidimensional within-test structure and multidimensional across-test structure based on a 2-level, 1-factor model. In particular, we compare 6 score aggregation methods: average of standardized test raw scores (M1), regression factor score estimate of the 1-factor model based on the…

Background: A critical issue in International English Language Testing System (IELTS) lies in the significance of the validity of IELTS listening comprehension test (hereafter IELTS LCM). However IELTS listening validity has been investigated, it has not been investigated with reference to multiple sources of evidence regarding item internal…

In science, technology, engineering, and mathematics education there has been increased emphasis on teaching goals that include not only the learning of content knowledge but also the development of scientific reasoning skills. The Lawson classroom test of scientific reasoning (LCTSR) is a popular assessment instrument for scientific reasoning.…

This study was conducted with the aim of developing "The Text Evaluation Scale for Child Rights." There are four different sample chosen for the face validity, content validity and construct validity (for pilot scheme and main study) of the study. For face validity, a sample group of 3 experts chosen with the method of purposeful…

Frequently, empirical studies are plagued with missing data. When the data are missing not at random, the parameter of interest is not identifiable in general. Without additional assumptions, we can derive bounds of the parameters of interest, which, unfortunately, are often too wide to be informative. Therefore, it is of great importance to…

The Nebraska Student-Centered Assessment System (NSCAS) is a statewide assessment system that embodies Nebraska's holistic view of students and helps them prepare for success in postsecondary education, career, and civic life. It uses multiple measures throughout the year to provide educators and decision-makers at all levels with the insights…

Focus on form (FonF) studies have predominantly addressed its effectiveness in improving learners' syntactic, lexical, orthographic, and phonological knowledge. Extending the scope of this line of research to formulaic FonF practices, this study investigates the relative effectiveness of incidental FonF targeting formulaic versus nonformulaic…

The main purpose of this article is to present a Differential Item Functioning method of item analysis. It is designed to minimize the discriminatory effect of individual items in the accreditation of graduates of medical universities with different training programs. The one-parameter Item Response Theory model is used to align graduates' rights…

Teacher-developed test, in the form of multiple-choice questions has widely used for measuring the students' final learning process. Content validity and items analysis is used to evaluate the quality of the test that is developed by the teacher. The study focused on content validity that analyzed the content of the test and basic competency which…

This study examined whether there is a developmental difference in the emergence of an item-position effect in intelligence testing. The item-position effect describes the dependency of the item's characteristics on the positions of the items and is explained by learning. Data on fluid intelligence measured by Raven's Standard Progressive Matrices…

Validated screening and diagnostic tools for autism spectrum disorder for use in Arabic-speaking individuals are scarce. This study validated the Arabic version of the Social Communication Questionnaire. The total study sample included 206 children with autism spectrum disorder and 206 typically developing children (73.8% male; mean age: 8.5…

Online surveys are increasingly used to investigate health conditions, especially among young people. However, this methodology presents some limitations including item nonresponse concerning sensitive and knowledge-related questions. This study aimed to suggest latent class analysis as the methodology to statistically deal with item nonresponse…

In this study, we investigated the challenges and opportunities in developing a computer-delivered English language arts (ELA) task intended to improve the accessibility of the task for middle school English learners (ELs). Data from cognitive labs with 8 ELs with varying language proficiency levels provided rich insight to student-- task…

It is important for self-report scales and measures used by educators and health care professionals (such as the Physical Self-Description Questionnaire-Short Form [PSDQ-S]) to have documented reliability and validity. The aim of this study is to investigate the structural validity of the full PSDQ-S composite scale and 11 subscales using the…