While numerous studies have analyzed the conceptions probed by the Force Concept Inventory (FCI), assessments dedicated to electricity and magnetism lack similar analyses. This paper investigated the conceptions explored by the Brief Electricity and Magnetism Assessment (BEMA) and the Conceptual Survey of Electricity and Magnetism (CSEM) using…

Most of the existing classification accuracy indices of attribute patterns lose effectiveness when the response data is absent in diagnostic testing. To handle this issue, this article proposes new indices to predict the correct classification rate of a diagnostic test before administering the test under the deterministic noise input…

This study investigates the effect of several design and administration choices on item exposure and person/item parameter recovery under a multistage test (MST) design. In a simulation study, we examine whether number-correct (NC) or item response theory (IRT) methods are differentially effective at routing students to the correct next stage(s)…

Scores estimated from multidimensional item response theory (IRT) models are not necessarily comparable across dimensions. In this article, the concept of aligned dimensions is formalized in the context of Rasch models, and two methods are described--delta dimensional alignment (DDA) and logistic regression alignment (LRA)--to transform estimated…

Research has shown that cross-sectional mediation analysis cannot accurately reflect a true longitudinal mediated effect. To investigate longitudinal mediated effects, different longitudinal mediation models have been proposed and these models focus on different research questions related to longitudinal mediation. When fitting mediation models to…

The goal of this study is to examine which word order is dominant in colloquial Buginese-Indonesian, 1) to find out which word-order pattern is more acceptable between SVO and VSO, 2) to find out which word-order pattern is more acceptable between VO and OV, and 3) to find out what internal linguistic characteristics and social factors motivate…

Researchers frequently evaluate rater judgments in performance assessments for evidence of differential rater functioning (DRF), which occurs when rater severity is systematically related to construct-irrelevant student characteristics after controlling for student achievement levels. However, researchers have observed that methods for detecting…

Due to numerous reforms, modern teaching now asks for the role of the teacher to be redefined as well. One of the teacher's many tasks is to master the competencies which would enable them to encourage and stimulate their learners. In this article, authors report on a research conducted at Preschool Teachers' Training College in Kikinda, which…

For this project, ACT developed math and science items that attempted to represent unique aspects of cultures, raise awareness of social justice issues, promote cultural learning, be authentic and relatable, be comprehensible, and represent people in positive, nonstereotypical ways. Creating culturally relevant items was a new challenge for ACT…

Existing educational assessments have typically been developed without appropriate attention to the intended and unintended consequences of measure implementation and interpretation. We are developing the Expanding Screening to Support Youth (ESSY) Whole Child Screener using a mixed methods approach that attends to the intended and unintended…

Existing educational assessments have typically been developed without appropriate attention to the intended and unintended consequences of measure implementation and interpretation. We are developing the Expanding Screening to Support Youth (ESSY) Whole Child Screener using a mixed methods approach that attends to the intended and unintended…

Language proficiency diagnosis is essential to extract fine-grained information about the linguistic knowledge states and skill mastery levels of test takers based on their performance on language tests. Different from comprehensive standardized tests, many language learning apps often revolve around word-level questions. Therefore, knowledge…

Recent literature in the field of L2 vocabulary assessment has advocated for the development of written receptive vocabulary tests such as Vocabulary Levels Tests (VLTs) that use: (a) meaning-recall item formats, (b) a minimum of 40 item counts per 1,000-frequency band to improve level estimates, and (c) lemmas (not word-families) as the lexical…

The aim of this study is to validate an instrument to evaluate the teaching of mathematics through mathematical processes using a structural equation model. To that end, we have administered the instrument to 95 in-service Spanish teachers and we have also analysed the presence of mathematical processes (problem solving, reasoning and proof,…

One of the issues that hinder the students' learning progress is the inability to construct an epistemological explanation of a scientific phenomenon. Four-tier multiple-choice (hereinafter, 4TMC) instrument and Partial-Credit Model were employed to elaborate on the diagnosis process of the aforementioned problem. This study was to develop and…