The National Assessment of Educational Progress (NAEP), often referred to as The Nation's Report Card, offers a window into the state of U.S. K-12 education system. Since 2017, NAEP has transitioned to digital assessments, opening new research opportunities that were previously impossible. Process data tracks students' interactions with the…

Multiple choice questions (MCQs) are commonly used for assessing students, but medical teachers may lack training in writing them. MCQs often have imperfections called item-writing flaws (IWFs) that can affect students' results and impede objective evaluation of their knowledge. This study aimed to evaluate a guideline-based faculty development…

We analyze a 12-item version of Raven's Standard Progressive Matrices test, traditionally scored with the sum score. We discuss some important differences between assessment in practice and psychometric modelling. We demonstrate some advanced diagnostic tools in the freely available R package, dexter. We find that the first item in the test…

Kelley's Discrimination Index (DI) is a simple and robust, classical non-parametric short-cut to estimate the item discrimination power (IDP) in the practical educational settings. Unlike item-total correlation, DI can reach the ultimate values of +1 and -1, and it is stable against the outliers. Because of the computational easiness, DI is…

The Remote Associates Test (RAT; Mednick, 1962; Mednick & Mednick, 1967) is a commonly employed test of creative convergent thinking. The RAT is scored with a dichotomous scoring, scoring correct answers as 1 and all other answers as 0. Based on recent research into the information processing underlying RAT performance, we argued that the…

Test fairness is critical to the validity of group comparisons involving gender, ethnicities, culture, or treatment conditions. Detection of differential item functioning (DIF) is one component of efforts to ensure test fairness. The current study compared four treatments for items that have been identified as showing DIF: deleting, ignoring,…

The COVID-19 (Severe Acute Respiratory Syndrome Coronavirus 2 [SARS-CoV-2]) pandemic has impacted much of society, including those organizations involved in the fields of outdoor adventure and experiential education (OAEE). This study examined the organizational characteristics held by a select group of OAEE organizations in an effort to identify…

While most research on scalar implicature has focused on the lexical scale "some" vs "all," here we investigated an understudied scale formed by two syntactic constructions: categorizations (e.g., "Wilma is a nurse") and comparisons ("Wilma is like a nurse"). An experimental study by Rubio-Fernandez et al.…

We aimed to develop an item bank of computerized adaptive testing for eating disorders (CAT-ED) in Chinese university students to increase measurement precision and improve test efficiency. A total of 1,025 Chinese undergraduate respondents answered a series of questions about eating disorders in a paper-pencil test. A total of 133 items from four…

The effects of different response option orders on survey responses have been studied extensively. The typical research design involves examining the differences in response characteristics between conditions with the same item stems and response option orders that differ in valence--either incrementally arranged (e.g., strongly disagree to…

One of the strongest predictors of future academic achievement is the early and informal math skills children begin their school studies. Because of this, it is essential to have proper tools for measuring the development of mathematical thinking at an early age to be able to intervene in a timelier, more effective way. The purpose of this…

The goal of this study is to provide better empirical insight into the licensing conditions of a large set of NPIs in German so that they can be used as reliable diagnostics in future research on negation-related phenomena. Experiment 1 tests the acceptability of 60 NPIs under semantic operators that are expected to license superstrong, strong,…

The study focuses on assessing the proficiency levels of higher education students, specifically the physics achievement test (PHY 101) at the National Open University of Nigeria (NOUN). This test, like others, evaluates various aspects of knowledge and skills simultaneously. However, relying on traditional models for such tests can result in…

This study examined the factors adapted from the Motivation for Reading Questionnaire. We considered eight dimensions (Self-Efficacy, Reading Challenge, Reading Curiosity, Reading Involvement, Importance of Reading, Recognition for Reading, Reading for Grades, and Social Reasons for Reading). In addition, we included some items based on the…

Addressing the participation rates in senior secondary mathematics courses in Australian schools remains a critically important issue. In this paper, the authors report on quantitative findings from a study in which all year 11 and year 12 (aged 17-18 years) Australian Tertiary Admissions Ranking (ATAR) students in Western Australia were invited…