Those items or test characteristics that are likely to result in differential item functioning (DIF) across accommodated test forms in statewide tests have received little attention. An examination of elementary-level student performance across accommodated test forms in a large-scale mathematics assessment revealed DIF variations by grades,…

This study sought to determine how students would describe their group-only cooperative testing experiences in terms of key elements of cooperative learning often cited in the literature. Written comments of 159 graduate students were analyzed and 26 related categories of comments were derived from 495 statements of students enrolled in two…

This article considers the design process for new formative history assessments. Over the course of 3 years, my colleagues from the Stanford History Education Group and I designed, piloted, and revised dozens of "History Assessments of Thinking" (HATs). As we created HATs, we sought to gather information about their cognitive validity,…

This study presents the results of the analysis of a group of teacher-made test questions for statistics courses at the university level. Teachers were asked to submit tests they had used in their previous two semesters. Ninety-seven tests containing 978 questions were gathered and classified according to the SOLO taxonomy (Biggs & Collis,…

Testing programs often use multiple test forms of the same test to control item exposure and to ensure test security. Although test forms are constructed to be as similar as possible, they often differ. Test equating techniques are those statistical methods used to adjust scores obtained on different test forms of the same test so that they are…

In automated test assembly (ATA), the methodology of mixed-integer programming is used to select test items from an item bank to meet the specifications for a desired test form and optimize its measurement accuracy. The same methodology can be used to automate the formatting of the set of selected items into the actual test form. Three different…

The need for increased exam security, improved test formats, more flexible scheduling, better measurement, and more efficient administrative processes has caused testing agencies to consider converting the administration of their exams from paper-and-pencil to computer-based testing (CBT). Many decisions must be made in order to provide an optimal…

There has been increasing interest in using of web-based surveys--rather than paper based surveys--for collecting data on alcohol and other drug use in middle and high schools in the US. However, prior research has indicated that respondent confidentiality is an underlying concern with online data collection especially when computer-assisted…

This paper describes one of the first efforts by the National Assessment of Educational Progress (NAEP) to improve measurement at the lower end of the distribution, including measurement for students with disabilities (SD) and English language learners (ELLs). One way to improve measurement at the lower end is to introduce one or more…

People of Hispanic origin, including monolingual Spanish speakers, have experienced difficulty identifying with a race category on U.S. demographic surveys. As part of a larger research effort by the U.S. Census Bureau to improve race and Hispanic origin questions for the 2020 Census, we tested experimental versions of race and Hispanic origin…

Background/Context: The nature of the impact of state-mandated accountability testing on teachers' classroom practices remains contested. While many researchers argue that teachers change their teaching in response to mandated testing, others contend that the nature and degree of the impact of testing on teaching remains unclear. The research on…

Using multitrait, multimethod data, and confirmatory factor analysis, the current study examined the effects of arithmetic item formatting and the possibility that across formats, abilities other than arithmetic may contribute to children's answers. Measurement hypotheses were guided by several leading theories of arithmetic cognition. With a…

Researchers (Sandarg & Schomber, 2009; Wilkerson, Schomber, & Sandarg, 2004) have urged the profession to develop a new subject-matter licensure test to reflect the best practices in the foreign language classroom. In October 2010, the Praxis II: World Language Test joined the Praxis Series. Given that this standards-driven test differs…

This article presents and analyses a classroom-based assessment method to test students' speaking skills in a variety of professional settings in tourism. The assessment system has been implemented in the Communication in English for Tourism course, as part of the Tourism Management degree programme, at Florida Universitaria (affiliated to the…

This article considers the effects on universities of Gutenberg's invention of printing. It considers four major effects: the gradual displacement of Latin as the language of scholarship with vernacular languages, the expansion and eventual opening of libraries, major changes to curriculum, and major changes to pedagogy including lectures.…