A broad range of strategies in sampling, measurement, design, execution, implementation, and analysis are examined. Specific strategies are suggested that tend to be successful in the real world of psychiatric clinical research. (Author)

The quality of educational data in Nepal was evaluated by investigating three questions: (1) the extent of reporting error in national education data; (2) accuracy of error estimation; and (3) levels at which error is introduced. Evidence suggests that data may be more accurate than decision makers suppose. (SLD)

This paper comments on a critical review of cohort studies on PCB-related neurodevelopmental deficit in young children by D.V. Cicchetti, A.S. Kaufman, and S.S. Sparrow (CKS). Major points of criticism of CKS, namely alleged violation of statistical principles, presumed lack of clinical significance of findings, and alleged insufficient control of…

With the increasing globalization of human resources practices, a commensurate increase in demand has occurred for multi-language ("global") personality norms for use in selection and development efforts. The combination of data from multiple translations of a personality assessment into a single norm engenders error from multiple sources. This…

Many times in both educational and social science research it is impossible to collect data that is complete. When administering a survey, for example, people may answer some questions and not others. This missing data causes a problem for researchers using structural equation modeling (SEM) techniques for data analyses. Because SEM and…

Assessments in English that are constructed for native English speakers may not provide valid inferences about the achievement of English language learners (ELLs). The linguistic complexity of the test items that are not related to the content of the assessment may increase the measurement error, thus reducing the reliability of the assessment.…

We contend that generalizability (G) theory allows the design of psychometric approaches to testing English-language learners (ELLs) that are consistent with current thinking in linguistics. We used G theory to estimate the amount of measurement error due to code (language or dialect). Fourth- and fifth-grade ELLs, native speakers of…

By means of more than a dozen user friendly packages, structural equation models (SEMs) are widely used in behavioral, education, social, and psychological research. As the underlying theory and methods in these packages are vulnerable to outliers and distributions with longer-than-normal tails, a fundamental problem in the field is the…

Among the plethora of cooperative learning studies, several investigations of cooperative or group assessment (CA) have appeared. In this investigation, the methodology of R. R. McCown (1992) is refined to examine CA in a classroom setting, primarily examining achievement outcomes and student perceptions of the CA process. Fifty-six undergraduates…

The regression-discontinuity approach to evaluating educational programs is reviewed, and regression-discontinuity post-program mean differences under various conditions are discussed. The regression-discontinuity design is used to determine whether post-program differences exist between an experimental program and a control group. The difference…

A two-dimensional, compensatory item response model and a unidimensional model were fitted to the reading and mathematics items in the Woodcock-Johnson Psycho-Educational Battery-Revised for a sample of 1,000 adults aged 20-39 years. Multidimensional information theory predicts that if the unidimensional abilities can be represented as vectors in…

One of the most frequently used research methods in education and psychology involves repeated observations on the same individuals. When sample sizes are relatively small and a multivariate analysis lacks power, there are currently two analytical options in testing time effects. One is to assume a time series structure to these observations, and…

The advantages of applying confirmatory factor analysis (CFA) to multitrait-multimethod (MTMM) data are widely recognized. However, because CFA as traditionally applied to MTMM data incorporates single indicators of each scale (i.e., each trait/method combination), important weaknesses are the failure to: (1) correct appropriately for measurement…

A framework is described for preparing process profiles of two different surveys conducted by the National Center for Education Statistics (NCES): the Recent College Graduates Survey and the Higher Education General Information Survey (HEGIS) Fall Enrollment Survey. The process profile examines the adequacy of the entire survey process, using…

This paper evaluates the logic underlying various criticisms of statistical significance testing and makes specific recommendations for scientific and editorial practice that might better increase the knowledge base. Reliance on the traditional hypothesis testing model has led to a major bias against nonsignificant results and to misinterpretation…