Partial Order Theory has been recently more and more employed in applied science to overcome the intrinsic disadvantage hidden in aggregation, if a multiple attribute system is available. Despite its numerous positive features, there are many practical cases where the interpretation of the partial order can be rather troublesome. In these cases…

While participatory evaluation (PE) constitutes an important trend in the field of evaluation, its ontology has not been systematically analyzed. As a result, the concept of PE is ambiguous and inadequately theorized. Furthermore, no existing instrument accurately measures stakeholder participation. First, this article attempts to overcome these…

In defending tests of cognitive abilities, knowledge, or skills (CAKS) from the skepticism of their "family members, friends, and neighbors" and aiding psychologists forced to defend tests from "myth and hearsay" in their own skeptical social networks (p. 215), Sackett, Borneman, and Connelly focused on evaluating validity coefficients, racial or…

Indicators of the proficiency of teacher candidates at applying knowledge of child development to teaching and learning were examined to see if they predict the overall success of the candidates full-time student teaching. The assessment instrument, the Full-Time Student Teaching Summary Report (FSTSR), was found statistically reliable and…

This case study examined the intersection of collegiate-level student learning outcomes assessment with regional accreditation to understand how regional accreditation policies and practices leverage student learning outcomes efforts on US college campuses. To that end, the standards of each of the regional accreditation agencies were carefully…

Designing and implementing assessment instruments are ongoing challenges for physical educators. The initial design phase includes asking the question, "What do I want the students to know and/or be able to do?" Seemingly, the question is direct and should lead to a concrete answer. In addition to designing assessment instruments, one of the most…

Despite a wealth of tacit knowledge in academia regarding effective teaching strategies and a rich theoretical and empirical knowledge base on student learning, social work instructors wishing to identify appropriate ways to measure teaching and learning have little evidence to guide them. This article presents a framework for assessment of…

This experimental project investigated the reliability and validity of rubrics in assessment of students' written responses to a social science "writing prompt". The participants were asked to grade one of the two samples of writing assuming it was written by a graduate student. In fact both samples were prepared by the authors. The…

Sackett, Borneman, and Connelly argued that several common criticisms of cognitively laden tests are not well supported by the literature. The authors' systematic exploration of research surrounding seven specific criticisms is laudable, and we do not find fault with their conclusions as presented. In evaluating the seven concerns, however, the…

It is familiar in the world of systems building that funders start out saying they are not particularly interested in attribution, only to later begin using words like "prove" and "impact." Boards begin by asking for intelligent reflection from the 30,000-foot level and then suddenly want to know how many more children are ready for school.…

Are the five states that are participating in the Great Start project, in fact, off to a Great Start? The simple answer from a casual read of this excellent case study appears to be "yes." Any early learning initiative that begins with a scientific evaluation is off to a great start. Sadly, some public and private funders have begun early learning…

Current economic conditions and the increasing competition for government funding are leading to an increased focus on the impact of research. Measuring the impact of research is difficult because not all impacts are direct and some can be negative or result from the identification of problems that require a non-research response. The time between…

In this article, Lindsay Cassedy, Catherine Flaherty and Michael Fordham draw upon their empirical research to assess what understandings their students had of historical interpretations at the end of their compulsory education in history. They found that most students operated with an underlying epistemological model that did not reflect the way…

The purpose of this study is to identify the self-reported research-based instructional and assessment practices used by third through fifth grade teachers among rural school environments in Western Pennsylvania which have attained Adequate Yearly Progress (AYP) pursuant to statewide assessments. Specifically, this study examines the…

Standardized testing for higher education has been much in the news in the US over the last few years. In the wake of the Spellings Commission, the clear intent of the Department of Education's (USDOE) position in negotiated rulemaking in 2007 was to mandate its use in accreditation. Standardized testing is also a central feature of the Voluntary…