This study examines the use of subpopulation invariance indices to evaluate the appropriateness of using a multiple-choice (MC) item anchor in mixed-format tests, which include both MC and constructed-response (CR) items. Linking functions were derived in the nonequivalent groups with anchor test (NEAT) design using an MC-only anchor set for 4…

Three experiments examined whether quizzing promotes learning and retention of material from a social studies course with sixth grade students from a suburban middle school. The material used in the experiments was the course material students were to learn and some of the dependent measures were the actual tests on which students received grades.…

Approximately 52% of school psychologists with doctorate degrees take the Examination for Professional Practice in Psychology (EPPP) each year. A passing score on the EPPP is a mandatory requirement in all 50 states and in most provinces in Canada for licensure as an independent provider of psychological services. Approximately 300 students…

Federal policy on alternate assessment based on modified academic achievement standards (AA-MAS) inspired this research. Specifically, an experimental study was conducted to determine whether tests composed of modified items would have the same level of reliability as tests composed of original items, and whether these modified items helped reduce…

The authors are professors of literacy in a teacher education program that leads to a reading endorsement. Their graduates are reading specialists, literacy coaches, and district language arts specialists--but only if, in addition to the coursework and practicum experience that make up their National Council for Accreditation of Teacher Education…

This article presents the Variable Match Index (VM-Index), a new statistic for detecting answer copying. The power of the VM-Index relies on two-dimensional conditioning as well as the structure of the test. The asymptotic distribution of the VM-Index is analyzed by reduction to Poisson trials. A computational study comparing the VM-Index with the…

End-of-Course (EOC) tests are given statewide in 10 courses typically taken in high school. Results for 2008-09 (and prior years, where available) are reported in terms of both average scale scores and the percentage of students scoring proficient. After the recent introduction of new EOC tests with higher standards, scores in WCPSS have begun to…

This study examined the role of particular tasks implemented through two instructional methods on college students' "achievement" and understanding of probability. A mixed methods design that utilized a pre-test and post-test was used. This included treatment and control groups, each comprised of students in three sections of an…

This paper illustrates a method of item analysis used to identify discriminating multiple-choice items in placement data. The data come from two rounds of pilots given to both SHL students and Spanish as a Second Language (SSL) students. In the first round, 104 items were administered to 507 students. After discarding poor items, the second round…

Scores assigned by trained raters and by an automated scoring system (SpeechRater[TM]) on the speaking section of the TOEFL iBT[TM] were validated against a communicative competence criterion. Specifically, a sample of 555 undergraduate students listened to speech samples from 184 examinees who took the Test of English as a Foreign Language…

We apply a "tutorial design process", which has proven to be successful for a number of physics topics, to design curricular materials or "tutorials" aimed at improving student understanding of important concepts in a university-level introductory materials science and engineering course. The process involves the identification…

This paper presents an interactive system designed to facilitate the effective management of both knowledge consolidation and (self-)assessment of the progress made in the learning of physics by upper secondary school students. Via a specific multiple-choice test database, the system proposes several learning paths designed and implemented in an…

Many instructors seek to improve student engagement, but determining how to achieve student engagement can be complex and complicated. The authors sought to explore how the implementation of active-learning strategies in undergraduate history courses at a metropolitan community college using graphic organizers and group discussion impacted student…

Multiple-choice tests of punctuation and usage are used throughout the United States to assess the writing skills of new community college students in order to place them in either a basic writing course or first-year composition. To determine whether using the COMPASS Writing Test (CWT) is a valid placement at a community college, student test…

A MC (multiple-choice) question can be defined as a question in which students are asked to select one alternative from a given set of alternatives in response to a question stem. The objective of this paper is to analyse if MC questions may be considered as an interesting alternative for assessing knowledge, particularly in the mathematics area,…