Content analysis scales apply rigorous measurement to verbal communications and make possible the quantification of text in counseling research. The limitations of the Origin and Pawn Scales (M. T. Westbrook & L. L. Viney, 1980), the Positive Affect Scale (M. T. Westbrook, 1976), the Content Analysis Scales of Psychosocial Maturity (CASPM; L.…

This study provides a framework for the evaluation of assessments that may be used in adult continuing education. It provides an example of the analysis of an examination for 33 solicitors seeking specialist accreditation. Resampling was used to generate a group of 1000 results, and responses were analysed using a Rasch model. Results indicated a…

In 2003, a trial National Assessment of Educational Progress (NAEP) mathematics assessment was administered in Spanish to public school students at grades 4 and 8 in Puerto Rico. Based on preliminary analyses of the 2003 data, changes were made in administration and translation procedures for the 2005 NAEP administration in Puerto Rico. This…

This study examined a model of assessment that could be applied nationally for Year Twelve Vocational Education and Training (VET) subjects and which could yield both a differentiating score and recognition of competence. More than fifty colleges across all states and territories of Australia field-tested the approach over one school year. Results…

There are usually many testing activities going on in a school, with different tests serving different purposes, thus organization and planning are key in creating an efficient system in assessing the most important educational objectives. In the ideal case, an assessment system will be able to inform on student learning, instruction and…

The goal of this research project was to investigate the use of dynamic assessment to increase equity, fairness, and accuracy in the testing of abilities and achievement. Dynamic tests have been found to reveal developing expertise in underrepresented minorities around the world that is not revealed by conventional static tests. The…

The AP Course Audit utilizes a criterion-based professional judgment method of analysis within a nested multi-step review process. The overall goal of the methodology is to yield a final judgment on each syllabus that is ultimately valid. While reviewer consistency is an important consideration, the most important goal is to reach a final judgment…

This article addresses a pervasive need in the area of videoconference-supported distance language learning: task design. On the basis of Chapelle's (2001) criteria for CALL task appropriateness, this article proposes a set of criteria for evaluating videoconferencing-based tasks which examine such aspects of a task as practicality,…

One of the main limitations of the current generation of computer-based tests is its dependency on the multiple-choice item. This research was aimed at extending computer-based testing by bringing limited forms of performance assessment to it in the domain of mathematics. This endeavor involves not only building task types that better reflect…

This document consists of the physics 300 provincial examination (English version), a separate "provincial summary report" on the results of giving the test, and a separate French language version of the examination. This physics examination contains a 53-item multiple choice section and an 12 item free response section. Subsections of…

This paper reports the results of using a three-layer backpropagation artificial neural network to predict item difficulty in a reading comprehension test. Two network structures were developed, one with and one without a sigmoid function in the output processing unit. The data set, which consisted of a table of coded test items and corresponding…

This study focuses on possible factors which contributed to the low mathematics scores achieved by Florida's 11th graders on the 1977 Functional Literacy Test. The authors developed preliminary hypotheses to explain the low scores based upon professional conjecture, analyses of test items, and examination of item data from the October 1977 test…

CSAR (Characteristic Storage And Retrieval) is the name of an interactive item bank system for the storage, retrieval, manipulation, and summarization of information about multiple choice test items. The purpose of the system is to facilitate the test construction process. The system has two main components: one or more item banks and an…

The two conference papers comprising this document address course development and assessment procedures used in distance education at the West German Open University. The first paper, on course design and development techniques used in distance teaching, reviews some of the techniques of course evaluation and course design that have been used in…

The purpose of this book is to make it possible for measurement specialists to solve practical testing problems through the use of item response theory (IRT). The topics, organization, and presentation are those used in a 4-week seminar held each summer for the past several years. The material is organized to facilitate understanding; all related…