Critical to precise quantitative research is reliability estimation. Researchers have limited tools, however, to assess the reliability of evolving instruments. Consequently, cursory assessment is typical and in-depth evaluation is rare. This paper presents a rationale for and description of PIAS, a computerized instrument analysis system. PIAS…

Describes a program system which was developed for the purpose of making estimates about the nature of the distribution of test scores which will result from an administration of a test composed of items of which estimates of item-difficulty and discrimination are available. (Author/RC)

A general FORTRAN computer program for analyzing categorical or frequency data obtained from questionnaires is described. A variety of descriptive statistics, chi square, Kendall's tau and Cramer's statistic are provided. (Author/JKS)

A two-phase FORTRAN IV program called ITANA-III for an IBM 1130 computer is described that permits computation of psychometric characteristics of multiple-choice examinations including test statistics (phase I) and item statistics (phase II). Consisting of 280 statements, the program can handle up to 200 items with not more than 9 alternatives…

The computer program WEIGAN makes the weighted G analysis available for computer users. The input and output of the program are described. (Author/JKS)

Three algorithms for selecting a subset of originally available items, to maximize coefficient alpha, were compared on the size of the resulting alpha and computation time required with nine sets of data. The characteristics of a computer program to perform these item analyses are described. (Author/JKS)

The effect of stratified sampling of items on the estimation of test score distribution parameters by multiple matrix sampling was studied. Item difficulty and/or interitem correlations were the bases of stratification. Various item iniverses were created by computer simulation and sampled according to several plans. The results indicate that…

A general purpose computer program for the calculation of a matrix of tetrachoric correlations is described. This program was developed for use in adaptive (and other) testing research for examining the unidimensionality assumption in latent trait theory, in conjunction with available factor analysis programs. Several other potential applications,…

Range of analysis available, from simple scoring to corrected scores with item analysis, makes the program attractive to both inexperienced and experienced test administrators. (Authors)

An interactive test analysis system was developed which interfaces a 3M DATRONICS system with a XEROX Sigma 9 computer. The computer programs were written in A Programming Language (APL). The current implementation of the program is characterized by its capability to: read responses from a DATRONIC answer sheet; allow the faculty member the option…

A subject by item matrix of test responses is shown to be a useful heuristic in criterion referenced and norm referenced test analysis, and in the teaching of measurement. The pattern of responses within the matrix provides indications of item interactions, weak deceptors, and conventional test statistics. The strong visual analogy between the…

This is one of a series of reports on the National Longitudinal Study of Mathematical Abilities (NLSMA). This report is a discussion of many of the programs from the SMSG Computer Program Library as it existed in June, 1972. Major programs included involve item analysis, attitude item analysis, scale scoring, correlation and t-test, stepwise…

Brief descriptions are provided of general-purpose mathematical and statistical software, including 27 "stand-alone" programs, three subroutine systems, and two nationally recognized statistical packages, which are available in the Air Force Human Resources Laboratory (AFHRL) software library. This index was created to enable researchers…

Procedures are presented for equating simultaneously several tests which have been calibrated by the Rasch Model. Three multiple test equating designs are described. A Full Matrix Design equates each test to all others. A Chain Design links tests sequentially. A Vector Design equates one test to each of the other tests. For each design, the Rasch…

False-positive and false-negative dicisions are the fundamental errors committed with a mastery test; yet the estimation of the likelihood of committing these errors has not been investigated. Accordingly, two methods of estimating the likelihood of committing these errors are described and then investigated using Monte Carlo techniques.…