Evaluation capacity building (ECB) has become an area in the evaluation field that is attracting both scholarly attention and the practical work of evaluators. Despite some recent contributions, differing conceptions still exist concerning what constitutes ECB, let alone the nature of the capacity being built. Responding to an earlier call on the…

To date, hardly any evidence is available on the quality of adult education programs for vulnerable adults. Evaluation instruments or models mostly focussed on regular education and less on programs of adult education aiming to enhance social inclusion. This study presents a first exploration of the construct validity of a newly developed…

This article discusses the development of a scale informed by the construct of emotional intelligence designed to measure student development outcomes identified as co-curricular goals. Supervisors, staff, and coaches provided firsthand accounts of student development outcomes at a small, private, liberal arts work college, generating data on…

This paper reports a feasibility study on developing computer model-based assessments of chemical reasoning at the high school level. Computer models are flash and NetLogo environments to make simultaneously available three domains in chemistry: macroscopic, submicroscopic, and symbolic. Students interact with computer models to answer assessment…

Within the field of educational technology, Technological Pedagogical Content Knowledge (TPACK) has been theorized as a seven-factor construct to describe teacher's integration of information and communication technology (ICT) in their teaching. However, this framework has yet to be successfully validated through survey instruments. This paper…

In response to the shift from a system-centred care model to a person-centred support model, the Supports Intensity Scale (SIS) has been developed as an instrument to assess the support needs of persons with intellectual disabilities. The instrument is used as a tool for constructing individual support plans, as well as a tool for resource…

The purpose of this article is to demonstrate application of a new framework, the validation framework (VF), to assist researchers in evaluating mixed research studies. Based on an earlier work by Dellinger and Leech, a description of the VF is delineated. Using the VF, three studies from education, health care, and counseling fields are…

The construct validity of three variants of the Trail Making Test was investigated using 162 undergraduate psychology students. During a 3-week period, the Trail Making Test of the Delis-Kaplan Executive Function System, Comprehensive Trail Making Test, and Connections Task were administered in six possible orders. Using confirmatory factor…

Developing instruments to assess teacher competence requires a model of competent performance which can guide both the collection and appraisal of evidence in task situations. Following Kane (1992), the validation of statements about teachers' competence is regarded as the evaluation of interpretive argumentation. Based on contemporary insights…

This paper examines the applicability of the learning organization concept and its influence upon firm performance in mainland China. Based on the theoretical framework proposed by Watkins and Marsick, four dimensions of the learning organization instead of seven dimensions were identified. A balanced scorecard-based performance evaluation…

Investigated the factor structure of a battery of tasks hypothesized to measure the constructs of the planning, attention, and simultaneous-successive (PASS) process model of human cognition. Results suggest that the original PASS model provides an improper factor solution. Recommends further refinement of the PASS theory or tests. (RJM)

The thought of Samuel Messick has influenced language testing in 2 main ways: in proposing a new understanding of how inferences made based on tests must be challenged, and in drawing attention to the consequences of test use. The former has had a powerful impact on language-testing research, most notably in Bachman's work on validity and the…