Mantel-Haenszel and SIBTEST, which have known difficulty in detecting non-unidirectional differential item functioning (DIF), have been adapted with some success for computerized adaptive testing (CAT). This study adapts logistic regression (LR) and the item-response-theory-likelihood-ratio test (IRT-LRT), capable of detecting both unidirectional…

The development of the DETECT procedure marked an important advancement in nonparametric dimensionality analysis. DETECT is the first nonparametric technique to estimate the number of dimensions in a data set, estimate an effect size for multidimensionality, and identify which dimension is predominantly measured by each item. The efficacy of…

Exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) have contributed to test development and validation in counseling psychology, but additional applications have not been fully realized. The author presents an overview of the goals, terminology, and procedures of factor analysis; reviews best practices for extracting,…

Researchers sometimes need a statistical test of the hypothesis that two values of Cronbach's alpha reliability coefficient are equal. The situation may involve scores from two different measures administered to independent random samples or from the same measure administered to random samples from two different populations. Feldt derived a test…

Background: The objectives of this review were to examine the overall efficacy of music therapy for children and adolescents with psychopathology, and to examine how the size of the effect of music therapy is influenced by the type of pathology, client's age, music therapy approach, and type of outcome. Method: Eleven studies were included for…

Computer-administered self-interviewing (CASI) has been advocated as a way of over coming under reporting of sensitive sexual behaviors. The present study compared reports of consensual and nonconsensual sexual behaviors (including childhood and adulthood sexual victimization) among women using CASI (n=1014) versus a self-administered…

The following study investigates the relative importance of Web management practices in business curricular pedagogy from an undergraduate student perspective. Using conjoint methodology, the results suggest that students early in their program of studies tend to most value (more) tests in terms of course attributes, while students later in their…

Since the end of the 1980s, education in Russia has been characterized by changes that were qualified as "reform" at first and then, later, as "modernization." These changes have been going on against the background of the profound transformation of society, one aspect of which is the transition from a relatively cohesive…

In recent years, the mathematics achievement of Peruvian students has been evaluated in three national and two international studies. The results in all cases suggest very poor learning. A similar situation is found in many developing countries. In this study, we analyzed the opportunities to learn (OTL) mathematics of sixth grade students from…

This paper deals with the problems that arise in performance assessment from the granularity that results from having a small number of tasks or prompts and raters of responses to these tasks or prompts. Two problems are discussed in detail: (1) achieving a satisfactory degree of reliability; and (2) equating or adjusting for differences of…

The National Assessment of Educational Progress (NAEP) has always included students with disabilities and limited English proficient (LEP) students in the sample to be assessed, but only in relatively limited numbers. Recent research has indicated that many students who have been excluded are in fact capable of participating. The National Center…

This paper summarizes and highlights some of the critical developments, issues, and trends which impact the work of survey research. The issue of preventing or minimizing nonresponse bias by successfully obtaining cooperation from people being surveyed continues to be of concern to survey research professionals. The most effective response rate…

This paper describes the Multiple Assessment Programs and Services (MAPS) Placement Research Service. Students entering nonselective colleges show a wide range of ability. The College Board offers these colleges a number of tests of reading, writing, and mathematics skills for use in placing students appropriately. The MAPS Placement Research…

This report addresses the problem of sample size in developing prediction equations for college freshman grade averages under the American College Testing (ACT) Assessment Program. For the ACT Assessment, the prediction weights are estimated by standard least squares procedures. Because prediction weights are estimated regression coefficients…

The central purpose of the present study was to evaluate several statistical techniques (analysis of variance (ANOVA) on raw gains, standardized ANOVA, standard analysis of covariance (ANCOVA), and z-score ANOVA) under various quasi-experimental conditions (three levels of reliability, three levels of sample size, three levels of gain, and the…