A paradoxical phenomenon of decreases in reliability as the number of elements averaged over increases is shown to be possible in multifacet reliability procedures (intraclass correlations or generalizability coefficients). Conditions governing this phenomenon are presented along with implications and cautions. (Author)

In an earlier article, Hunt envisions the automation of intelligence testing, but he appears to be overly optimistic. He neglects to mention conceptual and practical difficulties at the interface of measurement and theory that place psychometry not in the dawn of microcomputerization, but rather more nearly in its primordium. (Author)

Argues that critical thinking and problem-solving skills do exist in primary grade students, that they can be measured, and illustrates how. (RB)

The Inpatient Scale of Minimal Functioning (ISMF)--based on revised scoring of the Social Breakdown Syndrome Gradient Index (SBSGI) item pool--is described as a means of overcoming inherent problems in the SBSGI scoring procedure. The ISMF possesses greater reliability, with an increment in concurrent validity as compared to SBSGI. (Author)

This article describes some of the programming improvements made to a computer-based instructional support system after it was operating as had been envisioned during its design. Changes were made to accommodate differences between the original objectives and what users discovered they really wished to do. (Author/BD)

The test files for 30 introductory psychology textbooks were searched for psychometric information and none was found. It is argued that publishers should include that information and suggestions are made for how and exactly what information to incorporate into test files. (ND)

Instead of shying away from problem solving items, testing specialists should devise and offer guidelines for construction and scoring problem solving items. (Editor/LBH)

This paper addresses three key topics related to making state National Assessment of Educational Progress (NAEP) assessments more efficient: (1) reducing the burden for the states; (2) stabilizing the assessment schedule; and (3) facilitating and promoting the use of state NAEP data. The paper recommends promoting the use of state NAEP data for…

This Digest describes matrix sampling of test items as an approach to achieving broad coverage while minimizing testing time per student. Matrix sampling involves developing a complete set of items judged to cover the curriculum, then dividing the items into subsets and administering one subset to each student. Matrix sampling, by limiting the…

This paper proposes criteria for determining necessary assumptions of arguments. In their book Evaluating Critical Thinking, S. Norris and R. Ennis (1989) state that although it is tempting to think that certain assumptions are logically necessary for an argument or position, they are not. Many writers of introductory logic texts and the authors…

The purpose of the study was to compare reliability estimates for a test composed of stimulus-dependent testlets as derived from item scores, testlet scores, and under the univariate generalizability theory and multivariate generalizability theory designs, as well as to determine the influence of the number of testlets and the number of items per…

This document contains a description of the Georgia High School Graduation Test in mathematics. The test item specifications, reflecting the Georgia State Quality Core Curriculum, are used by writers and reviewers who are responsible for the development of test items. Much of the content in the description is based on earlier test versions…

Advances in cognitive psychology deepen the understanding of how students gain and use knowledge. Advances in technology make it possible to capture more complex performances in assessment settings, by including, for example, simulation, interactivity, collaboration, and constructed response. The challenge is in knowing just how to put this new…

This position paper discusses ethical standards in test preparation and administration. Guidelines for creating a situation that will assist students in doing their best on tests are included. These standards were developed in a series of seminars sponsored by the Washington Educational Research Association in 1998-1999. The standards stress that…

This overview of the Massachusetts Comprehensive Assessment System (MCAS) tests is designed to help schools implement the Massachusetts"Curriculum Frameworks." For this fourth administration of the MCAS tests in 2001, the design of the tests remains essentially the same, but there are some changes highlighted in this overview. The first…