In this study, we aimed to develop an instrument that could be used to measure students' achievement in modern physics at high school level in a valid and reliable manner. The study was carried out in fall 2013-2014 with a total of 304 students. In this study, expert opinions were obtained to determine the test's content validity. The reliability…

For assessment contexts where both a paper-based test and an on-screen assessment are available as alternatives, it is still common for the paper-based test to be prepared first with questions later transferred into an on-screen testing platform. One challenge with this is that some questions cannot be transferred. One solution might be for…

This study compares automated methods to develop short forms of psychometric scales. Obtaining a short form that has both adequate internal structure and strong validity with respect to relationships with other variables is difficult with traditional methods of short-form development. Metaheuristic algorithms can select items for short forms while…

This study introduces a novel differential item functioning (DIF) method based on propensity score matching that tackles two challenges in analyzing performance assessment data, that is, continuous task scores and lack of a reliable internal variable as a proxy for ability or aptitude. The proposed DIF method consists of two main stages. First,…

The present study tries to investigate the fairness of an English reading comprehension test employing Kunnan's (2004) test fairness framework (TFF) as the most comprehensive model available for test fairness. The participants of this study comprised 300 freshman students taking general English course chosen based on the availability sampling,…

There is significant overlap between reading and writing, but no known standardized measure assesses these jointly. The goal of the present study is to evaluate the properties of a novel measure, the Assessment of Writing, Self-Monitoring, and Reading (AWSM Reader), that simultaneously evaluates both reading comprehension and writing. In doing so,…

Research in self-determination has expanded in recent years, especially in the special education field. Instruments to measure self-determination in students with disabilities are not available in the Romanian language, and this issue has led to the development of the current study, a cultural adaptation , and validation of "The ARC's…

The present study sought to examine the psychometric properties of the French and German versions of the Physical Self-Concept Questionnaire for Elementary School Children-Revised (PSCQ-C-R). A sample of 519 children participated in this study. Of those, 197 were French-Canadian and 322 were German. Results support the factor validity and…

Researchers frequently evaluate rater judgments in performance assessments for evidence of differential rater functioning (DRF), which occurs when rater severity is systematically related to construct-irrelevant student characteristics after controlling for student achievement levels. However, researchers have observed that methods for detecting…

Purpose: The paper reports a study that was intended to develop a self-assessment instrument to measure high school students' readiness for pursuing independent online learning. Design/methodology/approach: The instrument was developed through the following steps--(1) developing the draft, (2) checking the instrument's face validity, and (3)…

This article presents the psychometric properties of the evidence-based practice (EBP) instrument (School Version), a new interdisciplinary measure for understanding and measuring EBP use that can be understood and used across the three professions who provide the most mental health services in schools. The instrument was developed based on…

The aim of this study was to verify the dimensions of Internet addiction in Albanian. This study employed "Internet Addiction Scale for Adolescents" to determine internet addiction. The verification of language equivalence, the scale form was administered to 164 university students studying at AAB College Faculty of Psychology and 61…

Writing assessments often consist of students responding to multiple prompts, which are judged by more than one rater. To establish the reliability of these assessments, there exist different methods to disentangle variation due to prompts and raters, including classical test theory, Many Facet Rasch Measurement (MFRM), and Generalizability Theory…

The Mindset Assessment Profile is a popular questionnaire purportedly designed to measure mindset--an individual's belief in whether intelligence is malleable or stable. Despite its widespread use, the questionnaire appears to assess an individual's need for cognition and goal orientation more than mindset. We assessed the reliability, construct…

The Woodcock-Johnson IV Tests of Cognitive Abilities (WJ IV COG) is a comprehensive assessment battery designed to assess broad and narrow cognitive abilities, as defined by the Cattell-Horn-Carroll (CHC) theory of intelligence. Previous studies examined the invariance of the WJ assessments across sex and age groups using factor analytic methods.…