We study the properties of two specification tests that have been applied to a variety of estimators in the context of value-added measures (VAMs) of teacher and school quality: the Hausman test for choosing between student-level random and fixed effects, and a test for feedback (sometimes called a "falsification test"). We discuss…

The paper reports a study of a narrative-based Dynamic Assessment (DA) procedure developed in the USA that is used in the UK with children with developmental language disabilities. Three monolingual English children with language disabilities are assessed by a speech/language pathologist/therapist who is learning to work with DA in collaboration…

In this essay, the authors reflect on the ongoing teacher effectiveness debate. W. David Hibler is an experienced language arts teacher, who has taught in public high schools and middle schools in Alaska, North Carolina, and New York City. Jeffrey Aaron Snyder is a historian of education who writes about schooling in the twentieth-century United…

A number of validated survey instruments for assessing technological pedagogical content knowledge (TPACK) do not accurately discriminate between the seven elements of the TPACK framework particularly technological content knowledge (TCK) and technological pedagogical knowledge (TPK). By posing simple questions that assess technological,…

A latent variable modeling approach for scale reliability evaluation in heterogeneous populations is discussed. The method can be used for point and interval estimation of reliability of multicomponent measuring instruments in populations representing mixtures of an unknown number of latent classes or subpopulations. The procedure is helpful also…

The process of identifying students as creatively gifted provides numerous challenges for educators. Although many schools assess for creativity in identifying students for gifted and talented services, the relationship between creativity and giftedness is often not fully understood. This article reviews commonly used methods of creativity…

Students in higher education are increasingly asked to give feedback on their education experience, reflecting an increase in the importance attached to that feedback. Existing literature demonstrates that qualitative student feedback is valued and important, yet there has been limited evaluation of the means by which qualitative student feedback…

This chapter describes international policy contexts of adult literacy and language assessment and the shift toward standardization through measurement tools. It considers the implications the quantification of learning outcomes has for pedagogy and practice and for the social inclusion of transnational migrants.

Residential environmental education aims to enhance proenvironmental attitudes, knowledge, and behaviors, as well as attain outcomes related to personal and interpersonal skills. Although these outcomes may not be evident for months or even years afterward, few program evaluations investigate how the experience and context affect intended outcomes…

In this article, I propose that neither traditional assessment nor alternative, competence-based assessment is adequate to meet the challenges of uncertain change. Existentialist assessment that focuses on developing learners' commitment, rather than their competence, may be more decisive in empowering learners who are facing adversity.…

In 2012, the American Evaluation Association (AEA) added community psychology (CP) to its roster of topical interests groups (TIG). One of the highlights of the CP TIG program at the 2012 AEA Conference and the genesis of this "American Journal of Evaluation" Forum was a panel of accomplished community psychologists and evaluation…

Previous studies comparing holistic scoring to analytic scoring of second language writing have given mixed results. Some of them suffer from methodological drawbacks, such as limited writing sample size, limited number of raters, and lack of direct comparison of the two methods. Based on 300 writing samples graded by 14 raters, this research…

Bayesian Knowledge Tracing (BKT) has been in wide use for modeling student skill acquisition in Intelligent Tutoring Systems (ITS). BKT tracks and updates student's latent mastery of a skill as a probability distribution of a binary variable. BKT does so by accounting for observed student successes in applying the skill correctly, where success is…

In this paper, we present a flexible full-information approach to modeling multiple userdefined response styles across multiple constructs of interest. The model is based on a novel parameterization of the multidimensional nominal response model that separates estimation of overall item slopes from the scoring functions (indicating the order of…

This executive summary highlights findings from the main report (published separately) which examines the practical implications of student learning objective (SLO) assessment decisions for teacher appraisal. We present student-level growth data from SLO assessments administered in 2013-2014. Growth data are compared according to type (i.e.,…