What follows is a practical guide for establishing the validity of a survey for research purposes. The motivation for providing this guide is our observation that researchers, not necessarily being survey researchers per se, but wanting to use a survey method, lack a concise resource on validity. There is far more to know about surveys and survey…

The Next Generation Science Standards propose a multidimensional model of science learning, comprised of Core Disciplinary Ideas, Science and Engineering Practices, and Crosscutting Concepts (NGSS Lead States, 2013). Accordingly, there is a need for student assessment aligned with the new standards. Creating assessments that validly and reliably…

This article considers the design process for new formative history assessments. Over the course of 3 years, my colleagues from the Stanford History Education Group and I designed, piloted, and revised dozens of "History Assessments of Thinking" (HATs). As we created HATs, we sought to gather information about their cognitive validity,…

As part of the test development process, this technical report is intended to present technical information from the tryout and the pilot stages of the Michigan High School Proficiency Test (HSPT) in Communication Arts: Reading. There are four major parts to this report. Part 1, Evolution of the HSPT in Communication Arts: Reading, introduces the…

As part of the test development process, this technical report is intended to present technical information from the tryout and pilot stages of the Michigan High School Proficiency Test (HSPT) in Communication Arts: Writing. There are four major parts to this report. Part 1, Evolution of the HSPT in Communication Arts: Writing, introduces the…

Issues concerning the cost and feasibility of using Formulating Hypotheses (FH) test item types for the Graduate Record Examinations have slowed research into their use. This project focused on two major issues that need to be addressed in considering FH items for operational use: the costs of scoring and the assignment of scores along a range of…

The National Conference of Bar Examiners commissioned American College Testing, Inc., to help them in the development and evaluation of a performance test for use in bar admissions decisions. Because it was recognized that candidate perceptions would provide valuable information, a candidate-perception questionnaire was developed to be…

This project explored the possible applications of new technology to standardized testing. Because the multimedia approach is particularly promising for music, the Graduate Record Examination (GRE) music test was chosen as the context for this project. The basic system for administering the test and recording the results was written using…

A way to assess knowledge acquired through simulation-based learning (intuitive knowledge) is presented. A "WHAT-IF" test item format is developed, and two pilot studies involving 74 college students responding to WHAT-IF items are described. The tests did tap improvement in learning, although test validity was only partially supportive.…

This article describes the development of an English spelling measure designed to assess the progress made by Spanish-English bilingual children from Grade 2 to Grade 5. Different stages of developing the measure are described, such as selecting the focus features, the prepilot and pilot phases, and the operational version. Two underlying…

The history of the Educational Testing Service (ETS) Factor Kits is summarized. The original ETS Factor Kit was developed in 1954 and contained 51 items, three each for each of 15 factors and six for a 16th factor. The next edition was developed in 1963 and included adaptations (clones) of the defining tests instead of the exact copies. These…

The Charleston County School District (CCSD) has recently begun development of criterion-referenced tests (CRT) in different subject areas and for different grade levels. This paper outlines the process that CCSD followed in the development of math and language arts tests for grades one through eight and area exams for required high school…

The development and validation of a test of listening comprehension for English as a second language at the Dutch National Institute for Educational Measurement (Cito) is described. The test uses two distinct item formats: true-false items and modified cloze items with two options. Both item formats were found to measure foreign language listening…

This paper summarizes the standardized procedures and psychometric standards states must follow in developing performance-based assessment. The National Reporting System (NRS), which serves as the accountability system for federally funded adult education and literacy programs, requires that states have their local programs assess educational gain…