A method for evaluating the validity of multicomponent measurement instruments in heterogeneous populations is discussed. The procedure can be used for point and interval estimation of criterion validity of linear composites in populations representing mixtures of an unknown number of latent classes. The approach permits also the evaluation of…

This paper argues that the dominant framework for conceptualizing validation evidence and analysis--the "five sources" framework from the 1999 "Standards"--is seriously limited. Its limitation raises a significant barrier to understanding the nature of comprehensive validation, and this presents a significant threat to…

In this article, we revisit Aaron Cicourel's classic text "Method and Measurement in Sociology." We consider the legacy and influence of the book in the context of the continued and urgent significance of such properly methodological inquiry. We examine, in particular, the ways in which Cicourel's concern with decisions of measurement --…

In the knowledge-based economy, R&D centers in service industries increasingly depend on the performance of knowledge workers to gain competitive advantage. Therefore, these centers must give careful consideration to the performance assessment and continuous improvement of knowledge workers using appropriate performance assessment systems and…

We describe a combination of methods for assessing the effectiveness of complex interventions, especially where substantial heterogeneity with regard to the population, intervention, comparison, outcomes, and study design of interest is expected. We applied these methods in a recent systematic review of the effectiveness of reinforced home-based…

George Grob presented the fifth and final Eleanor Chelimsky Forum address at the 2017 annual meeting of the Eastern Evaluation Research Society. In this commentary, I respond to several points that George raises in the "American Journal of Evaluation" paper based on that address. An overarching theme of my comments involves the potential…

Courses: Instructional Communication, Graduate Teaching Assistant Training Programs. Objectives: Students will (1) understand critical communication pedagogy (CCP); (2) evaluate traditional and critical objectives and assessment procedures; and (3) create critical objectives and assessment procedures.

This article examines the implications of argument-based validity for the continued development of dynamic assessment (DA) research and practice. We propose that the move toward validation as a process of interpretation and evidence-based argument is commensurable with DA but that fundamental ontological differences with conventional approaches to…

The role the visiting lecturer plays in promoting and supporting student teacher learning on practicum is an important one in initial teacher education (ITE). The practicum experience is a challenging and high-stakes environment for student teachers. One of the reasons it is a high-stakes situation is because of the tension around assessment, and…

Wollack, Cohen, and Eckerly suggested the "erasure detection index" (EDI) to detect fraudulent erasures for individual examinees. Wollack and Eckerly extended the EDI to detect fraudulent erasures at the group level. The EDI at the group level was found to be slightly conservative. This article suggests two modifications of the EDI for…

Background: Aphasia assessment is traditionally divided into formal and informal approaches. Informal assessment is useful in developing a rich understanding of the person with aphasia's performance, e.g., describing performance in the context of real-world activities, and exploring the impact of environmental and/or partner supports upon…

Repetitive sensory motor behaviors are a direct target for clinical treatment and a potential treatment endpoint for individuals with intellectual or developmental disabilities. By removing the burden associated with video annotation or direct observation, automated detection of stereotypy would allow for longer term monitoring in ecologic…

The authors evaluate Dialogues on Race, an interracial group intervention in which undergraduate student facilitators led conversations about race with their peers. The evaluation process is described, including developing collaborative relationships, identifying program goals, selecting measures, and analyzing and presenting results. The authors…

Given the prevalence of sex addiction (SA) among collegiate populations, the authors designed this study to examine college counselors' training in SA, use of formal assessments, and referrals to support groups. Results indicated that 84.4% of college counselors (N = 77) had at least one client present with SA-related issues in the past year.…

Data from student learning provide learning curves that, ideally, demonstrate improvement in student performance over time. Existing data mining methods can leverage these data to characterize and improve the domain models that support a learning environment, and these methods have been validated both with already-collected data, and in…