The paper presents first the theoretical foundations used to develop a pre-experimental version of a questionnaire on relationship to work, and then the four stages of its initial validation leading to an experimental version. These stages included: (1) Defining the dimensions and sub-dimensions of the relationship to work concept; (2)…

Validity evidence based on test content is critical to meaningful interpretation of test scores. Within high-stakes testing and accountability frameworks, content-related validity evidence is typically gathered via alignment studies, with panels of experts providing qualitative judgments on the degree to which test items align with the…

In Australia, one of the key findings of the Teacher Education Ministerial Advisory Group was that not all graduating pre-service teachers possess adequate pedagogical content knowledge (PCK) to teach effectively. The concern is that higher education providers working with pre-service teachers are using pedagogical practices and assessments which…

Assessment engineering is a new way to design and implement scalable, sustainable and ideally lower-cost solutions to the complexities of designing and developing tests. It represents a merger of sorts between cognitive task modeling and engineering design principles--a merger that requires some new thinking about the nature of score scales, item…

The PEDI-CAT is a new computer adaptive test (CAT) version of the Pediatric Evaluation of Disability Inventory (PEDI). Additional PEDI-CAT items specific to postacute pediatric hospital care were recently developed using expert reviews and cognitive interviewing techniques. Expert reviews established face and construct validity, providing positive…

Item-objective congruence as developed by R. Rovinelli and R. Hambleton is used in test development for evaluating content validity at the item development stage. Provides a mathematical extension to the Rovinelli and Hambleton index that is applicable for the multidimensional case. (SLD)

In this technical report, we describe the development of cognitive diagnostic test items that form the basis of the diagnostic system for Project DIVIDE (Dynamic Instruction Via Individually Designed Environments). The construct underlying the diagnostic test is division of fractions. We include a description of the process we used to identify the…

Describes an alternative approach to assessing content validity and content equivalence in terms of item-content structures and content area constructs. Results from applying structural equation modeling to item-response data from two Regents College examinations to verify content constructs suggest the different degrees of inconsistency and bias…

The development and validation of the English-Spanish Verbatim Translation Exam (ESVTE) is described. The test is for use by the Federal Bureau of Investigation (FBI) in the selection of applicants for the positions of Language Specialist or Contract Linguist. The report is divided into eight sections. Section 1 describes the need for the test,…

Describes content-validity theory and illustrates new and traditional approaches for conducting content-validity studies. Newer approaches are based on multidimensional scaling analysis of item-similarity ratings, while traditional approaches are based on ratings of item-objective congruence and relevance. (Author/SLD)

The development and validation of the Spanish-English Verbatim Translation Exam (SEVTE) is described. The test is for use by the Federal Bureau of Investigation (FBI) in the selection of applicants for the positions of Language Specialist or Contract Linguist. The report is divided into eight sections. Section 1 describes the need for the test,…

Describes the development of a placement test specifically designed for students entering Pembroke State University. Includes question construction and suitable test standards in discussing the features of a good placement test. Concludes that the test provides a reliable measure of students potential success. (MDH)

This document contains the framework and a set of recommendations for the NAEP 2007 mathematics assessment, which will assess student achievement nationally and state-by-state, as well as in select urban districts, in grades 4 and 8. It includes descriptions of the mathematical content of the test, the types of test questions, and recommendations…

Work Keys (occupational tests developed by American College Testing) could support an employer's human resource function in a number of ways: (1) communicating to educators the skill requirements for an employer's particular jobs on a national basis; (2) providing students with a realistic preview of skills needed for jobs and an assessment of…