This commentary to the recent article by Musso et al. (2013) discusses issues related to model fitting, comparison of classification accuracy of generative and discriminative models, and two (or more) cultures of data modeling. We start by questioning the extremely high classification accuracy with an empirical data from a complex domain. There is…

"Game-Based Assessments: A Promising Way to Create Idiographic Perspectives" (Adrienne Walker and George Englehard) comments on: "How Task Features Impact Evidence from Assessments Embedded in Simulations and Games" by Russell G. Almond, Yoon Jeon Kim, Gertrudes Velasquez, and Valerie J. Shute. Here, Walker and Englehard write…

Glaserian grounded theory methodology, which has been widely adopted as a scientific methodology in recent decades, has been variously characterised as "hermeneutic" and "positivist." This commentary therefore takes a different approach to characterising grounded theory by undertaking a comprehensive analysis of: (a) the philosophical paradigms of…

This commentary reflects on the contributions to learning analytics and theory by a paper that describes how multiple theoretical frameworks were woven together to inform the creation of a new, automated discourse analysis tool. The commentary highlights the contributions of the original paper, provides some alternative approaches, and touches on…

In this commentary, the author asks the analogous question, "where's the psychology?" Not because the authors of the focus article "Unique Characteristics of Diagnostic Classification Models: A Comprehensive Review of the Current State-of-the-Art" have not provided a solid review of the technical aspects of Diagnostic…

The current literature is replete with instances of imprecise and conflicting usage of "qualitative" and "quantitative" evaluation. This paper presents a framework for making distinctions among several related concepts to eliminate this potential source of confusion. In the process, the terms "qualitative" and…

Presents a model for instructional design that highlights formative evaluation as the central process. Other models of instructional design are discussed; data collection methods are examined; the evaluator's role is considered; and the recursive nature of the design process is emphasized. (seven references) (LRW)

A series of five questions forms a model for organizing the content of a continuing education staff evaluation system: What purpose will the system serve? What responsibilities should be evaluated? What characteristics are desirable in the position? Who supplies relevant information? Who uses the information? (SK)

Whenever there is a data gathering need and a group of people have input, the group interview may be a viable approach. The authors offer a step-by-step model for conducting group interviews. (JOW)

Describes the evaluation of a new model for software evaluation that emphasizes the collection of student performance data to determine the extent to which students learn the knowledge a software package intends to teach. Discussion covers the results of two studies, evaluation criteria and methods, evaluator subjectivity in decision making,…

Three issues must be addressed when discussing the standards needed to judge the methodological rigor of naturalistic approaches to administrative research. The first issue involves defining naturalistic inquiry. In contrast to the scientific paradigm, naturalistic inquiry emphasizes, first, the inseparability of variables or events from their…

Methodological adequacy in naturalistic inquiry is enhanced by understanding the differences between the naturalistic and rationalistic paradigms; by using simultaneous data collection and analysis, with prolonged field research, an audit trail, multiple sources, and referential materials; and by employing "thick description" extensively…

In this article, the author comments on an article by Dunn, Kadane, and Garrow, "Comparing Harm Done by Mobility and Class Absence: Missing Students and Missing Data." He believes the research reported in that article should serve as a model for future applications of Bayesian methods in important educational research problems. The author lauds…

Evaluation of a middle school humanities program is the focus of this report. It explains how to identify information needs and set priorities, how to obtain information from a variety of sources, and what to do with the data collected in terms of formulating recommendations for the school board. The variety of evaluation approaches presented are…

Examines problem areas of training needs analysis (TNA), first by presenting a model of the TNA process, then by listing sources of data available for TNA (based on an analysis of the literature), and finally by proposing a method of choosing appropriate data-gathering techniques for TNA. (CT)