One of the widely known evaluation models adapted to education is the Kirkpatrick model. However, this model has limitations when used by evaluators especially in the complex environment of higher education. Addressing the scarcity of a collective effort on discussing these limitations, this review paper aims to present a descriptive analysis of…

Despite the rising popularity of big data, there is speculation that evaluators have been slow adopters of these new statistical approaches. Several possible reasons have been offered for why this is the case: ethical concerns, institutional capacity, and evaluator capacity and values. In this method note, we address one of these barriers and aim…

Purpose: The purpose of this paper is to focus on assessing individuals' problems in learning groups/teams and should lead to the assessment of the group/team itself as a learning entity. Design/methodology/approach: In this paper, an extension of the IMS-Learning Design (IMS-LD) meta-model is proposed in order to support the assessment of…

Simulations and games offer interactive tasks that can elicit rich data, providing evidence of complex skills that are difficult to measure with more conventional items and tests. However, one notable challenge in using such technologies is making sense of the data generated in order to make claims about individuals or groups. This article…

Modelling-based teaching activities have been designed and analysed from distinct theoretical perspectives. In this paper, we use one of them--the model of modelling diagram (MMD)--as an analytical tool in a regular classroom context. This paper examines the challenges that arise when the MMD is used as an analytical tool to characterise the…

This study examines the perceptions of teachers in one Midwest school district relative to the current teacher evaluation system used in the district as well as a new model of teacher evaluation connected to Missouri's educator standards. To fully understand the perspective of the teachers, this study incorporates a mixed-methods approach which…

This paper contains results of an empirical study that tested the efficacy and acceptability of two templates designed to fully involve students in proper and fair peer-assessments of their group project work (GPW) by providing concrete evidence of independent progressive documentation of their peers' contributions to the work-process and…

Despite increased focus on the effects of organized activities on youth development, there is currently no consensus about the best way to assess various dimensions of involvement. This article explores the complexities of assessing involvement and focuses specifically on the following organized activity dimensions: (a) breadth, (b) intensity, (c)…

As the largest international study ever taken in history, the Trend in Mathematics and Science Study (TIMSS) has been held as a benchmark to measure U.S. student performance in the global context. In-depth analyses of the TIMSS project are conducted in this study to examine key issues of the comparative investigation: (1) item flaws in mathematics…

This paper addresses a key methodological challenge in the modeling of individual poverty dynamics--the influence of measurement error. Taking the US and Britain as case studies and building on recent research that uses latent Markov models to reduce bias, we examine how measurement error can affect a range of important poverty estimates. Our data…

To test model of general managerial effectiveness, superiors (N=271), subordinates (N=605), and peers (N=469) rated 344 managers. Study designed to test three specific hypotheses on criterion type and criterion weights found consensus in effectiveness models of superiors, subordinates, and peers. Consensus among different raters was high on both…

Analyzes two methods of testing group differences of a latent variable: group code analysis and structured means analysis. Describes these methods in terms of conceptual representation, unique underlying assumptions, and relative merits and limitations; points toward methodological extensions beyond this two-sample case. (RJM)

Delineates a process model for mental-health counselors to follow in formulating a differential diagnosis of dementia and depression in adults 65 years and older. The model is derived from empirical, theoretical, and clinical sources of evidence. Explores components of the clinical interview, of hypothesis formation, and of hypothesis testing.…

Applied latent growth curve methodology to study of patterns of change in client resistance during parent training therapy of 68 mothers of children with confirmed conduct problems. Pretherapy maternal characteristics of inept discipline and antisocial behavior predicted chronically high levels of resistance. Lack of negative curvature of…

The Comparing Options in Secondary Mathematics: Investigating Curriculum (COSMIC) project is a longitudinal study of student learning from two types of mathematics curricula: integrated and subject-specific. Previous large-scale research studies such as the National Assessment of Educational Progress (NAEP) indicate that numerous variables are…