Both the statistical and interpretational shortcomings of the three-parameter logistic (3PL) model in accommodating guessing effects on multiple-choice items are well documented. We consider the use of a residual heteroscedasticity (RH) model as an alternative, and compare its performance to the 3PL with real test data sets and through simulation…

Many large-scale performance assessments include score resolution procedures for resolving discrepancies in rater judgments. The goal of score resolution is conceptually similar to person fit analyses: To identify students for whom observed scores may not accurately reflect their achievement. Previously, researchers have observed that…

As researchers in the social sciences, we are often interested in studying not directly observable constructs through assessments and questionnaires. But even in a well-designed and well-implemented study, rapid-guessing behavior may occur. Under rapid-guessing behavior, a task is skimmed shortly but not read and engaged with in-depth. Hence, a…

This experimental study examined the effect of answering strategic adjunct questions (AQs) on L2 reading comprehension and strategy use. Participants were 124 Chinese intermediate advanced EFL learners from a large public university in China. Of them, 24 and 100 participated in the pilot study and formal study, respectively. Participants read two…

Large-scale standardized tests are regularly used to measure student achievement overall and for student subgroups. These uses assume tests provide comparable measures of outcomes across student subgroups, but prior research suggests score comparisons across gender groups may be complicated by the type of test items used. This paper presents…

This article considers psychometric properties of composite raw scores and transformed scale scores on mixed-format tests that consist of a mixture of multiple-choice and free-response items. Test scores on several mixed-format tests are evaluated with respect to conditional and overall standard errors of measurement, score reliability, and…

Vocabulary learning constitutes an essential component of language learning and teaching. The type of input students receive is one of the factors that affect the pace and range of this learning. In the incidental vocabulary learning process, learners have been shown to benefit from exposure to a variety of input types to varying degrees. In this…

This study uses a case study methodology to showcase the use of the DTSICM (Design thinking Strategy to Identify and Clear Misconceptions) model, which provides a design thinking approach to identify and clear a common misconception on photosynthesis, held by a sample of 27 A-level students. As a first stage, data collected through the…

When conducting biological investigations, experts constantly integrate their conceptual and quantitative understanding of variation with the design and analysis of the investigation. This process is difficult for students, because curricula often treat these concepts as separate components. This study describes the effect of a curricular…

Purpose: The aim of this paper is to study the use of FIS Response Analysis for Critical Thinking Assessment (FRACTA) method to assess critical thinking in STEM problem solving. The use of FIS (facts, ideas and solutions) chart as a tool to elicit student critical thinking responses and the method of scoring the responses are investigated. Method:…

We examined the effect of two methods of assessment--multiple-choice sentence-picture matching and an animated sentence-verification task--on typically developing children's understanding of relative clauses. A sample of children between the ages of 3 years 6 months and 4 years 11 months took part in the study (N = 103). Results indicated that (a)…

This paper describes an experience based on the use of an active method in which students of a basic physics course prepare multiple choice questions (MCQs) to prepare for exams in the subject. The objective of the research was to provide the students with a method that would enhance their desire to learn physics, and consequently lead to an…

This research aims at comparing item characteristics of instruments for assessing the level of mastery in scientific method for elementary students as they were analyzed using Classical Test Theory (CTT) and Item Response Theory (IRT). The two analyses are usually done separately, for difference object, in this moment it was analyzed…

Design-based learning has been recognized by educational scholars as the key approach to science, technology, engineering, and mathematics (STEM) education at K-12 levels. However, it is unclear whether, and which dimensions of, design thinking mindsets support the conceptual learning of science. This quasi-experimental study aims to explore 37…

Foreign language testing is a multi-dimensional phenomenon and obtaining objective and error-free scores on learners' language skills is often problematic. While assessing foreign language performance on high-stakes tests, using different testing approaches including Classical Test Theory (CTT), Generalizability Theory (GT) and/or Item Response…