The purpose of the present study is to compare the psychometric qualities of canonical single-response multiple-choice items with their double-response counterparts. Thirty, two-response fouroption grammar items for undergraduate students of English were constructed. A second version of the test was constructed by replacing one of the correct…

This study investigated the relational reasoning capabilities of older adolescents and young adults when the focal assessment was a verbal and more schooled measure than 1 that was figural and more novel in its configuration. To achieve this end, the verbal test of relational reasoning (vTORR) was constructed to parallel the test of relational…

The main purpose of this study was to develop a valid and reliable scale for printed and digital competencies ("The Printed and Digital Reading Habits Scale"). The problem statement of this research can be expressed as: "The Printed and Digital Reading Habits Scale: is a valid and reliable scale?" In this study, the scale…

Purpose: To create two matched short forms of the Philadelphia Naming Test (PNT; Roach, Schwartz, Martin, Grewal, & Brecher, 1996) that yield similar results to the PNT for measuring anomia. Method: In Study 1, archived naming data from 94 individuals with aphasia were used to identify which PNT items should be included in the short forms. The 2…

Standardized conceptual assessment represents a widely used tool for educational researchers interested in student learning within the standard undergraduate physics curriculum. For example, these assessments are often used to measure student learning across educational contexts and instructional strategies. However, to support the large-scale…

Experts use their domain expertise and knowledge of examinees' ability levels as they write test items. The expert test writer can then estimate the difficulty of the test items subjectively. However, an objective method for assigning difficulty to a test item would capture the cognitive demands imposed on the examinee as well as be…

Existing reading comprehension assessments have been criticized by researchers, educators, and policy makers, especially regarding their coverage, utility, and authenticity. The purpose of the current study was to evaluate a new assessment of reading comprehension that was designed to broaden the construct of reading. In light of these issues, we…

Testlets are subsets of test items that are based on the same stimulus and are administered together. Tests that contain testlets are in widespread use in language testing, but they also share a fundamental problem: Items within a testlet are locally dependent with possibly adverse consequences for test score interpretation and use. Building on…

A method for medical screening is adapted to differential item functioning (DIF). Its essential elements are explicit declarations of the level of DIF that is acceptable and of the loss function that quantifies the consequences of the two kinds of inappropriate classification of an item. Instead of a single level and a single function, sets of…

Frustrations with traditional testing led a group of teachers at the English for adults program at Universidad EAFIT (Colombia) to design tests aligned with the institutional teaching philosophy and classroom practices. This article reports on a study of an item-by-item evaluation of a series of English exams for validity and reliability in an…

Problem Statement: Among attitude measures, attitude scales are the most common, objective, and effective in gathering attitude data and there is a plenty of scales that measure various factors of attitude towards mathematics. However, there is a need for attitude scales that are content specific such as geometry, algebra, probability and…

Self-regulation has become a widely discussed subject in education as it facilitates learners' ability to master their own learning. The purpose of the present study is to examine the psychometric properties of self-regulation in second language learning via Rasch measurement. A total of 528 high-school students from an East Asian country…

Studies on science education show that students have many misunderstandings and misconceptions related to chemistry concepts. Many techniques have been used to determine those misconceptions such as multiple choice tests, interviews, drawing, etc. Two-tier diagnostic test is one of these techniques for using to determine misconceptions and their…

This article describes a computerized adaptive test (CAT) based on the uniform item exposure multi-form structure (uMFS). The uMFS is a specialization of the multi-form structure (MFS) idea described by Armstrong, Jones, Berliner, and Pashley (1998). In an MFS CAT, the examinee first responds to a small fixed block of items. The items comprising…

This paper describes the entire methodology for the development of a scale to measure Attitude towards Open Educational Resources (ATOER). Traditionally, it is observed that some teachers are more willing to share their work than others, indicating the need to understand teachers' psychological and behavioural determinants that influence use of…