Assessing complex constructs such as those discussed under the umbrella of 21st century constructs highlights the need for a principled assessment design and validation approach. In our discussion, we made a case for three considerations: (a) taking construct complexity into account across various stages of assessment development such as the…

Because of the critical function of the IEP in the planning and implementation of effective instruction for students with disabilities, educators need a reference to determine the standards of a quality IEP and a process by which to compare an IEP to those standards. A rubric can support educators in examining the quality of IEPs. This study used…

This article presents information on the development and initial validation of the 16-item Response to Intervention (RTI) Beliefs Scale. The scale is designed to measure the extent to which educators working in schools hold beliefs consistent with the tenets of RTI. The authors administered the instrument to 2,430 educators in 62 elementary…

Structured questionnaires and semi-structured interviews are often used in mixed method studies to generate confirmatory results despite differences in methods of data collection, analysis, and interpretation. A review of 19 questionnaire-interview comparison studies found that consensus and consistency statistics were generally weak between…

Changes in views of personnel selection research include changing opinions about choosing predictors and criteria, methods of data collection, and methods of evaluating selection procedures. Distinctions are made between job-relatedness, inferred from validity coefficients based on job-related criteria, and the valid measurement of a trait,…

The effect of different combinations of item response theory (IRT) item parameters (item difficulty, item discrimination, and the guessing probability) on the reliability and construct validity (correlation with the latent trait being measured) of pretest, posttest, and gain scores was analytically examined using the 3-parameter logistic (3PL)…

Methods that have been employed in McGill University's (Montreal, Quebec) program of research into the nature of learning are described. The methods illustrate four phases of inquiry: conceptualization or model-building; data gathering techniques; data representation; and data analysis. For the university's learning task project, the development…

Indicators of mathematics and science education progress are important to policymakers and the public in order to evaluate the quality of education. Recent reports have evaluated existing indicators and suggested core aspects of mathematics and science education that an indicator system should evaluate. This note discusses two fundamental aspects…

This proof-of-concept investigation describes a computer-based approach for deriving the knowledge structure of individuals and of groups from their written essays, and considers the convergent criterion-related validity of the computer-based scores relative to human rater essay scores and multiple-choice test scores. After completing a…