This paper introduces the Website Acceptability Tiered Checklist (WATCH), a preliminary version of a multi-trait scale that could be used by instructors and students to assess the quality of websites chosen as source materials in students' research papers in a Humanities program. The scale includes bands for assessing: (i) the authority and…

This paper is about the structural equation modelling of quantitative measures that are obtained from a multiple facet design. A facet is simply a set consisting of a finite number of elements. It is assumed that measures are obtained by combining each element of each facet. Methods and traits are two such facets, and a multitrait-multimethod…

This study is concerned with evaluating critical learning of 10-11 year-old students studying global citizenship through an online discussion environment. The evaluation is based on analysing the use of language as both a social reasoning tool and cognitive learning tool. Evaluation methods use: (1) content analysis of the online discussion…

Concept mapping is a structured conceptualization that can be used by groups to develop a conceptual framework that guides evaluation or planning. Twelve papers discuss concept mapping in evaluation/planning in terms of theory development; measurement, construct validity, and pattern matching; outcome assessment and internal validity;…

This article describes the development of a multifaceted evaluation strategy to assess the effects of guaranteed subsidized child care on the subsequent attainment of welfare independence and aggregate welfare expenditures for Aid to Families with Dependent Children (AFDC). Advantages of a multimethod approach are discussed. (SLD)

Measures of 4traits (cognitive competence, social competence, social maladaption, and personal maladaption) were obtained on 157 persons with mental retardation, using 3 measurements: standardized assessment instrument, day shift staff ratings, and evening shift staff ratings. The multitrait-multimethod matrix procedure demonstrated strong…

The construct validity of 14 measures used in college faculty personnel decisions was evaluated through a multitrait-multimethod matrix for data from 89 faculty members in 7 departments. The three-pronged model of teaching, research, and service was not validated. Exploratory factor analysis identified five or six behavior domains for evaluation.…

In this study, the author tested the reliability, concurrent validity, and predictive validity of three hemispheric cognitive style instruments: (a) the Preference Test (PT; R. Zenhausern, 1978), (b) the Polarity Questionnaire (PQ; B. E. Morton, 2002), and (c) the Wagner Preference Inventory II (WAPI II; R. F. Wagner & K. A. Wells, 1985).…

Correlational analysis, classical test theory, confirmatory factor analysis, and multilevel Rasch modeling were used to refine a measure of adolescents' exposure to violence (ETV). Interpersonal violence could be distinguished from other potentially traumatic events; it was also possible to distinguish three routes of exposure (victimization,…

The construct validity of a multidimensional adolescent self-concept was estimated separately for males and females, and the results were compared across gender. The application of four multitrait-multimethod (MTMM) approaches to estimating construct validity was demonstrated, and the scope and consistency of the findings derived from each were…

The No Child Left Behind Act has brought great attention to the high school graduation rate as one of the mandatory accountability measures for public school systems. However, there is no consensus on how to calculate the high school graduation rate given the lack of longitudinal databases that track individual students. This study reviews…

Results of an investigation of the construct validity of measurements of social and academic competencies of 175 3rd graders, 193 7th graders, and 159 11th graders made by the students themselves, teachers, parents, and peers suggest that researchers should consider making greater use of parent ratings for elementary school students. (SLD)