Examination of a test's internal structure can be used to identify what domains or dimensions are being measured, identify relationships between the dimensions, provide evidence for hypothesized multidimensionality and test score interpretations, and identify construct-irrelevant variance. The purpose of this research is to provide a…

Depression therapy literature cites the importance of self-concept in formulating therapeutic strategies. Traditional depression measures catalog a client's symptoms, but fail to tap the structure of dysfunctional thoughts and judgments that form the client's self-concept. Vector-product multidimensional scaling was used to develop a measure of…

DETECT, the acronym for Dimensionality Evaluation To Enumerate Contributing Traits, is an innovative and relatively new nonparametric dimensionality assessment procedure used to identify mutually exclusive, dimensionally homogeneous clusters of items using a genetic algorithm ( Zhang & Stout, 1999). Because the clusters of items are mutually…

Two aspects of the reliability of multidimensional measures can be distinguished: the amount of scale score variance that is accounted for by all underlying factors (composite reliability) and the degree to which the scale score reflects one particular factor (construct reliability). Confidence intervals for composite and construct reliabilities…

Two quasiexperimental designs--nonequivalent dependent variable and reversed treatment designs--illustrate pattern matching logic as a basis for evaluation, examining college health services. Three pattern matches are significant: (1) program pattern match indicates implementation; (2) measurement match assesses test validity; and (3) effect…

An expanded version of the method of content evaluation proposed by S. G. Sireci and K. F. Giesinger (1992) was evaluated with respect to a national licensure examination and a nationally standardized social studies achievement test. Two groups of 15 subject-matter experts rated the similarity and content relevance of the items. (SLD)

Applied qualitative methods to assess students' interest in science to responses of 2,118 German students in grades 5 through 7 to items measuring interest. Each method (additive cluster analysis, multidimensional scaling, and latent class analysis) is considered qualitative because it supports a focus on the structure of interest. Each approach…

The purpose of this monograph is to show that sufficient achievements in scaling applications have been made to justify serious study of scaling methodologies, particularly multidimensional scaling (MDS) as a tool for geographers. To be useful research, it was felt that the common methodological and technical problems that specialized researchers…

Some of the theoretical and methodological problems with current practices in evaluating instruction at the higher education level are reviewed. Controversy over the evaluation of instruction in higher education has resulted at least in part from inadequate instrumentation. The instruments for instructional rating now used include administrator…

A study provided the initial test of a multidimensional instrument based on the idea that syntactic language choice might predict writing apprehension. The test measured six factors: (1) blank page paralysis, (2) general affect toward writing, (3) positive/negative business affect, (4) alternative modes, (5) attitude toward writing competence, and…

Concept mapping is a structured conceptualization that can be used by groups to develop a conceptual framework that guides evaluation or planning. Twelve papers discuss concept mapping in evaluation/planning in terms of theory development; measurement, construct validity, and pattern matching; outcome assessment and internal validity;…

Longitudinal, student performance-based, value-added accountability models have become popular of late and continue to enjoy increasing popularity. Such models require student data to be vertically scaled across wide grade and developmental ranges so that the value added to student growth/achievement by teachers, schools, and districts may be…

Research explored methods of providing a coherent framework for the Instructional Systems Development (ISD) model which would promote better system evaluation, internal communications and student testing. Lists of critical tasks for two Air Force specialties were compiled and multidimensional scaling and hierarchical cluster analysis employed to…

This study compared college students' responses on their evaluations of the effectiveness of full- and part-time college faculty. A group of 1,101 students completed evaluation instruments for all courses taught by full-time faculty, and 2,067 students completed evaluations for all courses taught by part-time faculty in spring 1998. In fall 1998,…

A new adaptive procedure for assessing multiple dimensions of self-concept for children younger than 8 years was studied with a sample of 501 children from kindergarten through grade 2. Use of the Self-Description Questionnaire with young children was supported by factor analysis. Practical and theoretical implications are discussed. (SLD)