There has been increased interest in assessing the quality and usefulness of short versions of the Raven's Progressive Matrices. A recent proposal, composed of the last twelve matrices of the Standard Progressive Matrices (SPM-LS), has been depicted as a valid measure of "g." Nonetheless, the results provided in the initial validation…

Figural matrices tasks are one of the most prominent item formats used in intelligence tests, and their relevance for the assessment of cognitive abilities is unquestionable. However, despite endeavors of the open science movement to make scientific research accessible on all levels, there is a lack of royalty-free figural matrices tests. The Open…

A technique for assessing the agreement between the Q-sorts of two or more groups of subjects is presented which relies on the relationship between the Kendall coefficient of concordance (W) and the Spearman rank order correlation (rho). The proposed statistical treatment of Q-sort data involves the use of a number of intercorrelations rather than…

A procedure for estimating the reliability of a factorially complex composite is considered. An application of its use with Scholastic Aptitude Test data is provided. (Author/JKS)

This report gives some simple examples of stability for one factor and 2 x 2 factorial analysis of variance, reliability and correlations. The findings are very different: from superstability (no transformation whatsoever can change the result) to almost total instability. This is followed by a discussion of applications to multivariate analysis,…

Development of an alternate form of Raven's Standard Progressive Matrices Test is described. Reliability analysis with 449 children of differing racial/ethnic backgrounds showed good reliability and comparable predictive validity. The alternate form is a promising research tool. (SLD)

Measures of consistency and completeness of order relations derived from test-type data are proposed. The measures are generalized to apply to incomplete data such as tailored testing. The measures are based on consideration of the items-plus-persons by items-plus-persons matrix as an adjacency matrix in which a 1 means that the row element…

The Matrices and Order of Appearance subtests of a Piagetian test battery were administered to a sample of second-grade children on two occasions under two test conditions: standardized testing and a dialogue between child and examiner. Differences for test condition and time of testing were found. (JKS)

Order Analysis is a multidimensional scaling (MDS) technique for determining order among items. This paper reviews articles by different authors describing various components of ordering theory. A common nomenclature is constructed to link together the various ideas and is applied to a fairly simple set of data. Topics discussed include a more…

This paper is an extended series of appendices to the report "Exploring the T.R.Q.: An Assessment of the Effectiveness of the Teachers' Rating Questionnaire," Report Number 123. It should be most useful to those familiar with multiple regression analysis and factor analysis and wishing a more complex record of the statistical procedures…

The Mastery-Learning test model is extended. Methods for estimating prior probabilities are described. The use of an adjustment matrix to transform a probability of mastery measure and empirical methods for estimating adjustment matrix parameters are derived. Adjustment matrices are interpreted as indicators of instructional effectiveness and as…

Employed were a small sample of fifth graders to examine techniques for assessing the validity of psychosocial maturity (PSM) and the scales used to measure it. Three validation techniques were examined: (1) Data obtained from self-report scales, teacher ratings, and peer ratings were used to generate three multitrait-multimethod matrices (total…

Researchers studying monitoring accuracy currently use two different indexes to estimate accuracy: relative accuracy and absolute accuracy. The authors compared the distributional properties of two measures of monitoring accuracy using Monte Carlo procedures that fit within these categories. They manipulated the accuracy of judgments (i.e., chance…

Developmental psychologists have not traditionally documented the psychometric properties of their observational instruments, partly because such concepts as reliability and validity are associated mainly with paper-and-pencil tests. A multitrait-multimethod correlation matrix (MTMM) was presented as a useful method for the psychometric evaluation…

TAILOR is a computer program that uses the implied orders concept as the basis for computerized adaptive testing. The basic characteristics of TAILOR, which does not involve pretesting, are reviewed here and two studies of it are reported. One is a Monte Carlo simulation based on the four-parameter Birnbaum model and the other uses a matrix of…