Tests of statistical significance often play a decisive role in establishing the empirical warrant of evidence-based research in education. The results from pattern-based assessment items, as introduced in this paper, are categorical and multimodal and do not immediately support the use of measures of central tendency as typically related to…

Many large-scale performance assessments include score resolution procedures for resolving discrepancies in rater judgments. The goal of score resolution is conceptually similar to person fit analyses: To identify students for whom observed scores may not accurately reflect their achievement. Previously, researchers have observed that…

Purpose: The aim of this paper is to study the use of FIS Response Analysis for Critical Thinking Assessment (FRACTA) method to assess critical thinking in STEM problem solving. The use of FIS (facts, ideas and solutions) chart as a tool to elicit student critical thinking responses and the method of scoring the responses are investigated. Method:…

In order to identify the potential benefits and challenges of implementing student portfolios as quality mathematics assessment, a pilot study was conducted with teachers in various secondary school settings. The multi-case study consisted of five teacher participants from geographically and demographically differing contexts, four in the USA and…

The main objective of the article is to compare several methods of evaluating multiple-choice options through classical item analysis. The methods subjected to examination include the tabulation of choice distribution, the interpretation of trace lines, the point-biserial correlation, the categorical analysis of trace lines, and the investigation…

The objective of this study was to employ a new tool for assessing pragmatic "proficiency" (over "performance") in L2 students and to determine if pragmatic lessons on compliment sequences had a positive impact on L2 Spanish students' intercultural competence. To this end, students at a Midwestern college engaged in live video…

Concept inventories (CIs) are assessment instruments designed to measure students' conceptual understanding of fundamental concepts in particular fields. CIs utilise multiple-choice questions (MCQs), and specifically designed response selections, to help identify misconceptions. One shortcoming of this assessment instrument is that it fails to…

Purpose: This study reports on the development of an auditory passage comprehension task for Swedish primary school children of cultural and linguistic diversity. It also reports on their performance on the task in quiet and in noise. Method: Eighty-eight children aged 7-9 years and showing normal hearing participated. The children were divided…

In this study, we investigated the value of a concept map marking guide as an alternative formative assessment tool for science teachers to adopt for the topic of energy. Eight high school science teachers marked students' concept maps using an itemized holistic marking guide. Their marking was compared with the researchers' marking and the scores…

Common test items play an important role in equating alternate test forms under the common item nonequivalent groups design. When the item response theory (IRT) method is applied in equating, inconsistent item parameter estimates among common items can lead to large bias in equated scores. It is prudent to evaluate inconsistency in parameter…

This study compared how three different gloss modes affected college students' L2 reading comprehension and vocabulary acquisition. The study also compared how results on comprehension and vocabulary acquisition may differ depending on the four assessment methods used. A between-subjects design was employed with three groups of Mandarin-speaking…

Nonequivalent groups with anchor test (NEAT) equating functions that use a single anchor can have accuracy problems when the groups are extremely different and/or when the anchor weakly correlates with the tests being equated. Proposals have been made to address these issues by incorporating more than one anchor into NEAT equating functions. These…

This quasi-experimental study investigated how explicit instruction about multiple modes of representation (MMR) impacted grades 7 (n = 61) and 8 (n = 141) students' learning and multimodal use on end-of-unit assessments. Half of each teacher's (n = 3) students received an intervention consisting of explicit instruction on MMR in science…

Enrollment increases at many institutions have forced science faculty to reevaluate assessment decisions in light of increasing demands on time. Some have advocated the replacement of free-response examinations with forced-choice examinations as a time-saving strategy. The existing research literature contains many studies comparing student…

This article presents the Variable Match Index (VM-Index), a new statistic for detecting answer copying. The power of the VM-Index relies on two-dimensional conditioning as well as the structure of the test. The asymptotic distribution of the VM-Index is analyzed by reduction to Poisson trials. A computational study comparing the VM-Index with the…