Designing and implementing assessment instruments are ongoing challenges for physical educators. The initial design phase includes asking the question, "What do I want the students to know and/or be able to do?" Seemingly, the question is direct and should lead to a concrete answer. In addition to designing assessment instruments, one of the most…

Despite a wealth of tacit knowledge in academia regarding effective teaching strategies and a rich theoretical and empirical knowledge base on student learning, social work instructors wishing to identify appropriate ways to measure teaching and learning have little evidence to guide them. This article presents a framework for assessment of…

This experimental project investigated the reliability and validity of rubrics in assessment of students' written responses to a social science "writing prompt". The participants were asked to grade one of the two samples of writing assuming it was written by a graduate student. In fact both samples were prepared by the authors. The…

It is familiar in the world of systems building that funders start out saying they are not particularly interested in attribution, only to later begin using words like "prove" and "impact." Boards begin by asking for intelligent reflection from the 30,000-foot level and then suddenly want to know how many more children are ready for school.…

Are the five states that are participating in the Great Start project, in fact, off to a Great Start? The simple answer from a casual read of this excellent case study appears to be "yes." Any early learning initiative that begins with a scientific evaluation is off to a great start. Sadly, some public and private funders have begun early learning…

Indicators of the proficiency of teacher candidates at applying knowledge of child development to teaching and learning were examined to see if they predict the overall success of the candidates full-time student teaching. The assessment instrument, the Full-Time Student Teaching Summary Report (FSTSR), was found statistically reliable and…

Sackett, Borneman, and Connelly argued that several common criticisms of cognitively laden tests are not well supported by the literature. The authors' systematic exploration of research surrounding seven specific criticisms is laudable, and we do not find fault with their conclusions as presented. In evaluating the seven concerns, however, the…

The Investigators studied scoring reliability of Candidates' ten day unit plans of instruction through prescribed action research projects, across three academic years. Scoring of the projects in year one provided opportunities for further refinement of the action research evaluation methods in year two. Across three terms in years one and two…

Lecoutre, Lecoutre, and Poitevineau (2010) have provided sophisticated grounding for "p[subscript rep]." Computing it precisely appears, fortunately, no more difficult than doing so approximately. Their analysis will help move predictive inference into the mainstream. Iverson, Wagenmakers, and Lee (2010) have also validated…

Current economic conditions and the increasing competition for government funding are leading to an increased focus on the impact of research. Measuring the impact of research is difficult because not all impacts are direct and some can be negative or result from the identification of problems that require a non-research response. The time between…

In this article, Lindsay Cassedy, Catherine Flaherty and Michael Fordham draw upon their empirical research to assess what understandings their students had of historical interpretations at the end of their compulsory education in history. They found that most students operated with an underlying epistemological model that did not reflect the way…

There's a war of sorts going on within the normally staid assessment industry, and it's a war over the definition of a type of assessment that many educators understand in only a sketchy fashion. Formative assessments, also known as "classroom assessments," are in some ways easier to define by what they are not. They're not like the long,…

Variable-length computerized adaptive testing (CAT) can provide examinees with tailored test lengths. With the fixed standard error of measurement ("SEM") termination rule, variable-length CAT can achieve predetermined measurement precision by using relatively shorter tests compared to fixed-length CAT. To explore the application of…

The purpose of this study was to analyze case law related to teacher evaluation between 1980 and 2008 in the SREB states to determine the problems associated with teacher evaluation and if these problems were documented in the literature. Content analysis of teacher dismissal cases revealed many types of teacher evaluation problems. The two most…

Compared to unidimensional item response models (IRMs), cognitive diagnostic models (CDMs) based on latent classes represent examinees' knowledge and item requirements using discrete structures. This study systematically examines the viability of retrofitting CDMs to IRM-based data with a linear attribute structure. The study utilizes a procedure…