Examinees who take high-stakes assessments are usually given an opportunity to repeat the test if they are unsuccessful on their initial attempt. To prevent examinees from obtaining unfair score increases by memorizing the content of specific test items, testing agencies usually assign a different test form to repeat examinees. The use of multiple…

Introduction: The objective was to develop and psychometrically evaluate (feasibility, reliability, validity) a questionnaire-based multisource feedback (MSF) system for quality improvement (QI) for occupational therapists (OTs). Methods: Surveys were developed for assessment of OTs by clients, co-workers, and themselves, respectively, using…

In a series of publications, the author and his colleagues have obtained scores from students in higher education on different questionnaires, and they have described the relationships among these scores using the statistic known as Wilks' [lambda]. Burt (2005) has criticized that the use of this measure is inappropriate, arguing (1) that the…

When there exist omitted effects, measurement error, and/or simultaneity in multilevel models, explanatory variables may be correlated with random components, and standard estimation methods do not provide consistent estimates of model parameters. This paper introduces estimators that are consistent under such conditions. By employing generalized…

This study examined the efficacy of 4 different parceling methods for modeling categorical data with 2, 3, and 4 categories and with normal, moderately nonnormal, and severely nonnormal distributions. The parceling methods investigated were isolated parceling in which items were parceled with other items sharing the same source of variance, and…

This article presents the results of an evaluation study in Physical Education (PE) in which 23 schools, 49 classes and 1142 year 4 Cypriot students participated. This study attempted to identify the extent to which a theoretical framework of educational effectiveness research based on Creemers' model can be developed. The relationship between…

The Center on Education Policy (CEP) report, "Has Progress Been Made in Raising Achievement for English Language Learners?", finds that some states have seen increases in the number of English language learners (ELLs) meeting proficiency standards under No Child Left Behind (NCLB), while others have seen decreases. The report notes some…

In large-scale assessments, such as state-wide testing programs, national sample-based assessments, and international comparative studies, there are many steps involved in the measurement and reporting of student achievement. There are always sources of inaccuracies in each of the steps. It is of interest to identify the source and magnitude of…

This study linked nonlinear profile analysis (NPA) of dichotomous responses with an existing family of item response theory models and generalized latent variable models (GLVM). The NPA method offers several benefits over previous internal profile analysis methods: (a) NPA is estimated with maximum likelihood in a GLVM framework rather than…

If students are to understand inferential statistics successfully, they must have a profound understanding of the nature of the sampling distribution. Specifically, they must comprehend the determination of the expected value and standard error of a sampling distribution as well as the meaning of the central limit theorem. Many students in a high…

The Longitudinal Surveys of Australian Youth (LSAY) is a research program that tracks young people as they move from school into further study, work and other destinations. This "User guide" has been developed for users of the LSAY data. The guide endeavours to consolidate existing technical documentation and other relevant information…

This paper describes an empirical evaluation of a Bayesian procedure for equating scores on test forms taken by small numbers of examinees, using collateral information from the equating of other test forms. In this procedure, a separate Bayesian estimate is derived for the equated score at each raw-score level, making it unnecessary to specify a…

The method of maximum-likelihood is typically applied to item response theory (IRT) models when the ability parameter is estimated while conditioning on the true item parameters. In practice, the item parameters are unknown and need to be estimated first from a calibration sample. Lewis (1985) and Zhang and Lu (2007) proposed the expected response…

Will reporting subscores provide any additional information than the total score? Is there a method that can be used to provide more trustworthy subscores than observed subscores? These 2 questions are addressed in this study. To answer the 2nd question, 2 subscore estimation methods (i.e., subscore estimated from the observed total score or…

In educational measurement, the construction of parallel test forms is often a combinatorial optimization problem that involves the time-consuming selection of items to construct tests having approximately the same test information functions (TIFs) and constraints. This article proposes a novel method, genetic algorithm (GA), to construct parallel…