Five sets of paired comparison judgments were made concerning test item difficulty, in order to identify the most probable source of intrasensitivity in the data. The paired comparisons method was useful in providing information about sensitivity to stimulus differences, but less useful for assessing dimensionality of judgment criteria.…

A study involving 63 third graders revealed that the Wide Range Achievement Test gives higher grade equivalent scores than the Test of Written Spelling and that Canadian and American norms were incongruent. Spelling error analysis suggested that the visual image should be a primary focus for both third-grade and remedial students. (CL)

A computer-assisted student recordkeeping system provides storage and statistical analysis of machine-scored test results and produces colored frequency distribution graphs for posting. (MSE)

Microcomputer software for computer-assisted classroom testing is reviewed. The teacher and classroom are emphasized in applying computer technology. The major issues are identification of appropriate classroom testing microcomputer applications; identification of available microcomputer testing software; techniques for software evaluation; and…

The convergent and discriminant validity of common measures of three faculty competence attributes (teaching, research, and service) were investigated using multitrait-multimethod (MTMM) matrix analysis. Three different measures for each component were collected on 57 college professors. Results distinguished the three hypothesized components, but…

Three numerical coefficients for analyzing the validity and reliability of ratings are described. Each coefficient is computed as the ratio of an obtained to a maximum sum of differences in ratings. The coefficients are also applicable to the item analysis, agreement analysis, and cluster or factor analysis of rating-scale data. (Author/BW)

The multidimensional structure of verbal comprehension test items was investigated. Empirical evidence was provided to support the theory that item tasks are multivariate-multiordered composites of faceted components: language, contextual knowledge, and cognitive operation. Linear and circular properties of cylindrical manifestation were…

Three methods of test equating (linear, equipercentile, and item response theory) were investigated with respect to the issue of scale drift. Results indicate that all three models work well in limited settings but that the item response theory approach provided the most stable results overall. (JKS)

Given known item parameters for a test, unbiased estimators are derived for an examinee's ability parameter, his or her proportion correct true score for the variances of these parameters and for the parallel forms reliability of the maximum likelihood estimator of the ability parameter. (Author/JKS)

The purpose of this study is to explore the relationship between a set of item characteristics and the difficulty of TOEFL[R] dialogue items. Identifying characteristics that are related to item difficulty has the potential to improve the efficiency of the item-writing process The study employed 365 TOEFL dialogue items, which were coded on 49…

Item writing is a major responsibility of trainers. Too often, qualified staff who prepare lessons carefully and teach conscientiously use inadequate tests that do not validly reflect the true level of trainee achievement. This monograph describes techniques for constructing multiple-choice items that measure student performance accurately. It…

This paper chronicles the steps, methods, and presents hypothetical results of quantitative and qualitative studies being conducted to develop a Generalized Expertise Measure (GEM). Per Hinkin (1995), the stages of scale development are domain and item generation, content expert validation, and pilot test. Content/face validity and internal…

Authors describe a measurement technique which processes item data so as to indicate logical relationships among items. (HB)