Current literature provides many examples of rubrics that are used to evaluate the quality of web-quest designs. However, reliability of these rubrics has not yet been researched. This is the first study to fully characterize and assess the reliability of a webquest evaluation rubric. The ZUNAL rubric was created to utilize the strengths of the…

Presented at the Annual Meeting of National Council on Measurement in Education (NCME) in San Diego, CA in April 2009. This presentation describes the methodology that was used with subject-matter experts (SMEs) to articulate the content and skills important in the domain, and then the iterative processes that were used to articulate the claims…

The reflective and interrogative processes required for developing effective qualitative research questions can give shape and direction to a study in ways that are often underestimated. Good research questions do not necessarily produce good research, but poorly conceived or constructed questions will likely create problems that affect all…

The impacts of incorrect responses to reverse-coded survey items were examined in this simulation study by reversing responses to traditional Likert-format items from 700 administrators in randomly selected schools in a 7-county region in central Arkansas that were obtained from an archival dataset. Specifically, the number of reverse-coded items…

This article describes four measurement tools that are of potential value for institutional researchers as greater demands are being placed upon their work. The author describes scale development, select methods for setting passing scores, validating passing scores and the topic of equating--both equipercentile and linear. Not only should…

In this paper, the authors introduce the "Targeted Assessment Rubric for Interdisciplinary Writing," an empirically-tested instrument designed to assess interdisciplinary writing at the collegiate level. Interdisciplinary writing presents unique challenges to students, calling upon them to mediate the rhetorical, theoretical, and…

While participatory evaluation (PE) constitutes an important trend in the field of evaluation, its ontology has not been systematically analyzed. As a result, the concept of PE is ambiguous and inadequately theorized. Furthermore, no existing instrument accurately measures stakeholder participation. First, this article attempts to overcome these…

Just like buildings, tests are designed and built for specific purposes, people, and uses. However, both buildings and tests grow and change over time as the needs of their users change. Sometimes, they are also both used for purposes other than those intended in the original designs. This paper explores architecture as a metaphor for language…

Get an in-depth understanding of how to create fun, engaging, and challenging performance assessments that require students to elaborate on content and demonstrate mastery of skills. This update of an ASCD (Association for Supervision and Curriculum Development) classic includes new scoring methods, reading assessments, and insights on navigating…

The ideas and examples in this book help teachers successfully collaborate to raise student achievement through the use of formative assessments. Here, Todd Stanley and Betsy Moore, educators with over 40 years of combined experience, offer proven formative assessment strategies to teachers in a professional learning community. Contents include:…

The Able Privilege Scale (APS) is a theoretically derived reflexive instrument that asks participants to assess their level of personal power and privilege in relation to society depending upon the presence, and/or type, of disability. The 23-items on the APS are derived form McIntosh's concept of white privilege (1988) and adapted to reflect…

Curriculum-based measurement (CBM) is designed to measure students' academic status and growth so the effectiveness of instruction may be evaluated. In the most popular forms of reading CBM, the student's oral reading fluency is assessed. This behavior is difficult to sample in a computer-based format, a limitation that may be a function of the…

Indicators of the proficiency of teacher candidates at applying knowledge of child development to teaching and learning were examined to see if they predict the overall success of the candidates full-time student teaching. The assessment instrument, the Full-Time Student Teaching Summary Report (FSTSR), was found statistically reliable and…

This article focuses on the development of a Literacy Assessment Battery for the diagnosis of Maltese children with specific learning difficulties. It forms part of a wider research study involving testing of 549 children in Malta as well as standardisation of the tool. Results of the children's performance and psychometric validation go beyond…

A computer adaptive test (CAT) is a delivery methodology that serves the larger goals of the assessment system in which it is embedded. A thorough analysis of the assessment system for which a CAT is being designed is critical to ensure that the delivery platform is appropriate and addresses all relevant complexities. As such, a CAT engine must be…