We employed qualitative research methods to examine student learning in context during a teacher's unit on 1920s-Great Depression in an 11th grade United States & Virginia History class in a standards-based setting with a high-stakes end-of-course test. We focused on four focal students (all of whom were classified as English learners at some…

The teaching of English as a foreign language in Indonesia has a long history, and it is always important to ask whether the assessment of the students' language skills has been valid and reliable. A screening of many articles in several prominent databases reveal that a number of evaluation studies have been done by Indonesian scholars in the…

Essay tests are easily constructed, relatively valid assessments of higher cognitive processes but are harder to score reliably. Teachers using essay tests are advised to follow clearly designed objectives, construct all-inclusive, pilot-tested questions, develop a checklist of specific scoring points and a model answer for each question, and use…

After analyzing four methods of selecting distractor items for multiple-choice tests, the authors recommend that classroom teachers use their own judgment in choosing test items. (Ed.)

A well developed multiple choice test is a reliable instrument for grading students and evaluating teacher presentation. There are three steps in the development of a valid multiple choice examination: 1) design or "blueprinting," 2) item construction, and 3) item analysis and evaluation. "Blueprinting" is the identification of the types of…

Students in an introductory college course (n=275) responded to equivalent 20-item halves of a test under number-right and formula-scoring instructions. Formula scores of those who omitted items overaged about one point lower than their comparable (formula adjusted) scores on the test half administered under number-right instructions. In contrast,…

This rejoinder to Grant Wiggins on performance assessment suggests that true educational reform will undoubtedly be evidenced by something more substantial than pocket folders bulging with student work. Labeling performance tests "authentic" does not ensure their validity, reliability, or incorruptibility. Such tests are neither replacements nor…

Different forms of a vocabulary test were administered to college students. Results indicated that as the frequency of specific determiners increased, they formed increasingly strong but differential guessing response sets in high and low scoring groups; however, the magnitude of the effect was much stronger for position specific determiners.…

After an extensive review of the available research on large-scale writing assessment, certain issues in writing assessment seem to be unresolved, and still other issues are not supported by adequate research. This paper reviews the basic issues in writing assessment, points out which topics are supported by strong research, and which topics are…

True-false achievement test items written by typical classroom teachers show about two-thirds of the discrimination of their multiple-choice test items. This is about what should be expected in view of the higher probability of chance success on the true-false items. However, at least half again as many true-false items as multiple-choice items…

The problems of validity and fairness involved in multiple-choice critical thinking tests can be lessened by using verbal reports of examinees' thinking during the process of developing such tests in order to retain only those items which rely on critical thinking skills to obtain the correct answer. Multiple-choice testing can lead to unfair…

The present study was an attempt to alleviate some of the difficulties inherent in multiple-choice items by having examinees respond to multiple-choice items in a probabilistic manner. Using this format, examinees are able to respond to each alternative and to provide indications of any partial knowledge they may possess concerning the item. The…

Controversy has characterized the research on writing. On the one side are those who state that, to evaluate achievement in writing, evaluate the writing of students. On the other side are those pointing out the problems associated with direct measures of writing such as low reliability and high cost in terms of time and often dollars. The purpose…

A potentially valuable measure of overconfidence on probabilistic multiple-choice tests was evaluated. The measure of overconfidence was based on probabilistic responses to nonsense items embedded in a vocabulary test. The test was administered under both confidence response and conventional choice response directions to 208 undergraduate…