The study reported in this paper, a Multistage Longitudinal Comparative (MLC) Design Stage II evaluation conducted as a planned preliminary efficacy evaluation (psychometric evaluation of measures, short-term controlled outcome studies, etc.) of the Changing Lives Program (CLP), provided evidence for the reliability and validity of qualitative…

The "No Child Left Behind Act" signed into law in 2002 requires school districts to hire highly qualified teachers who possess the necessary dispositions to ensure that all children learn (Center on Education Policy, 2002). The National Council for Accreditation of Teacher Education (NCATE) (2002) defines dispositions as "the values, commitments,…

The major purpose of the study was to determine the construct validity of the Spanish version of the Emotional Skills Assessment Process (ESAP) in a targeted population of agriculture college students in Mexico. The ESAP is a self assessment approach that helps students to identify and understand emotional intelligence skills relevant for…

Presents a quick distribution-free test that contributes evidence of construct validity from the Multitrait-Multimethod Matrix. The procedure is carried by reducing the heterotrait-heteromethod and heterotrait-monomethod triangles and the validity and reliability diagonals into a matrix of four levels. The null hypothesis states that the values…

Sense of community (SOC) is empirically "unpacked" as a multilevel construct with place and social elements. SOC has been studied primarily at the individual level despite researchers acknowledging its effects at the community level. Little attention has been given to the roles of place and place attitudes in SOC. We argue that place and…

This study was designed to assess the (score) construct-related validity of an instrument called the School-Wide Cultural Competence Observation Checklist (SCCOC). The instrument was developed to use as a tool in conducting culture audits as a means of assessing school-wide cultural competence, or how well a school's programs, policies, and…

The effect of the conditioning score on the results of differential item functioning (DIF) analysis was examined with simulated data. The study demonstrates that results of DIF that rely on a conditioning score can be quite different depending on the conditioning variable that is selected. (SLD)

This simulation study considered the effects on statistical measures of test dimensionality that result from systematic sampling variation in both a single- and a double-trait assessment model. Results suggest that there are distinct psychological and psychometric states of test dimensionality, and that psychometric unidimensionality may be…

Background: A number of disorders are associated with pragmatic difficulties. Instruments that can make subdivisions within the larger construct of pragmatics could be important tools for disentangling profiles of pragmatic difficulty in different disorders. The deficits underlying the observed pragmatic difficulties may be different for different…

The purpose of the present study is to investigate evidence of the validity of Survey of Attitudes Toward Statistics Scale (SATS) scores and their relationship with scores from two other measures of attitudes toward statistics, the Attitude Toward Statistics Scale (ATS) and the Statistics Attitude Survey. The pre- and postcourse responses of 342…

In keeping with the theme of the International Language Testing Association/Language Testing Research Colloquium Conference in 2008, "Focusing on the Core: Justifying the Use of Language Assessments to Stakeholders," I define "stakeholder-friendly tests," "defensible testing," and "testing-context analysis."…

Many programs designed to compute the readability of texts are narrowly based on surface-level linguistic features and take too little account of the processes which a reader brings to the text. This study is an exploratory examination of the use of Coh-Metrix, a computational tool that measures cohesion and text difficulty at various levels of…

Community coalitions (CCs) have labored with some difficulty to demonstrate empirical evidence of effectiveness in preventing a wide range of adolescent problem behaviors. Training and technical assistance (TA) have been identified as important elements in promoting improved functioning of CCs. A reliable, valid, and inexpensive method to assess…

A new instrument of motivational climate in physical education is presented with the goal of measuring perceptions of teachers' emphasis on mastery, performance-approach, performance-avoidance, and social approval goals. The measure was based on the principle of compatibility, according to which climate perceptions and achievement goals should be…

In this study, the ability of test development staff to predict the difficulty of analogy items was explored. The nature of the item attributes that contributed to test writers' predictions of difficulty as well as actual item difficulty was also investigated. The two expert test writers studied were quite good at predicting item difficulty. Item…