Determined effects of various methods and formats of administering a Piagetian task on college students' (N=376) performance. Concludes neither method nor format influenced subject performance; and this lack of influence is similar for various combinations of method and format. Importance of this finding and implications for teachers are…

The evaluation tools written by teachers are rarely valid or reliable. One teaching aid that can help in the creation of an effective evaluation instrument is called a test map. A test map is a systematic method to consider variables that are important in the construction of the format of a test. Five variables that are discussed in the test…

There is no one test or approach that is sufficient to serve all the objectives and purposes of assessment within the major. A multidimensional approach combining locally developed procedures such as theses, portfolios, orals, external examiners, with standardized tests is an effective strategy. (Author/MSE)

Provides a framework for understanding the concept of validity and how it applies to simulation research. Extant tests of validity are discussed in terms of this framework, and a general schema for testing validity is proposed. (MBR)

Compares the features, learning outcomes tested, reliability, viability, and cost effectiveness of essay tests with those of interpretive tests used in training programs. A case study illustrating how an essay test was converted to an interpretive test and pilot tested is included to illustrate the advantages of interpretive testing. (MBR)

Describes efforts in the Canadian provinces of Manitoba, British Columbia, New Brunswick, and Ontario to require actual samples of student writing on English performance tests. Includes a bibliography, a holistic marking scale, and an outline of criteria typical in analytic scoring. (EL)

The study investigated the structural corroboration of instructional evaluation information collected from one source (students) by three different methods: responses to objective questionnaire items, written comments to open-ended questions, and group interview results. The three types of information presented a similar general impression of…

Reviews recent theoretical, methodological, and analytical developments in language testing, focusing on more refined models of language ability, reliability and validity, performance testing, innovative test formats, new applications of Item Response Theory and Generalizability Theory to test performance. An annotated bibliography discusses seven…

[Gottfredson, L. S. (2003). Dissecting practical intelligence theory: Its claims and evidence. Intelligence, 31, 343-397.] provided a detailed critique of Sternberg's [Sternberg, R. J., Fotsythe, G. B., Hedlund, J., Horvath, J. A., Wagner, R. K., Williams, W. M., Snook, S. A., Grigorenko, E. L. (2000). Practical intelligence in everyday life. New…

This project consisted of a meta-analysis of U.S. research published from 1980 to 2004 on the effect of specific science teaching strategies on student achievement. The six phases of the project included study acquisition, study coding, determination of intercoder objectivity, establishing criteria for inclusion of studies, computation of effect…

This digest introduces three issues to consider when evaluating test items for bias: fairness, bias, and stereotyping. In any bias investigation, the first step is to identify the subgroups of interest. Bias reviews and studies generally focus on differential performance for sex, ethnic, cultural, and religious groups. In preparing an item bias…

The goal of teaching philosophy is to develop philosophically literate students and to ensure that students develop philosophical literacy by design and not by chance. Perhaps the best method for teaching philosophy to beginning students is the public model, in which the practice of defending positions in the public arena forces students to become…

A "modified essay examination" was used to help teach and to assess clinical problem-solving skills with 11 first trimester doctoral students. This examination provided a paper-and-pencil simulation of problems encountered in case management. Students were required to generate hypotheses, formulate questions, discuss issues, and make…

Context effects are defined as being influences on test performance associated with the content of successively presented test items or sections. Four types of context effects are identified: (1) direct context effects (practice effects) which occur when performance on items is affected by the examinee having been exposed to similar types of…

Reviews the Stanford Writing Assessment Program that has three intended uses: district-wide survey of students' writing ability, diagnosis of classroom or district-wide instructional strengths and weaknesses, and staff development through training for administering and scoring of writing samples. Notes that of these uses, none is necessarily best…