This study reviews the international literature of empirical educational research to examine the application of logistic regression. The aim is to examine common practices of the report and interpretation of logistic regression results, and to discuss the implications for educational research. A review of 130 studies suggests that: (a) the…

As a replication in the Chinese context of previous aptitude testing validation studies, this research aims at exploring the validity of an interpreting aptitude test battery, composed of the Logical Memory Test (LMT), the Scale of Language Anxiety (SLA) and the Achievement Motivation Test (AMT), in the prediction of consecutive interpreting…

The OECD Programme for International Student Assessment (PISA) examines what students know in reading, mathematics and science, and what they can do with what they know. It provides the most comprehensive and rigorous international assessment of student learning outcomes to date. Results from PISA indicate the quality and equity of learning…

As the 1994 publication manual of the American Psychological Association emphasized, "p" values are affected by sample size. As a result, it can be helpful to interpret the results of statistical significant tests in a sample size context by conducting so-called "what if" analyses. However, these methods can be inaccurate…

Contends that tests of statistical significance and measures of magnitude in counseling psychology research do not provide same information. Argues interpreting magnitude of experimental effects must be two-stage decision process with the second stage of process being conditioned on results of a test of statistical significance and entailing…

Considered methods of evaluating the pattern of subtest scores on the Wechsler Adult Intelligence Scale-Revised. The rationale and method for calculating the size of the significant difference between a subtest and the mean of the subtests scores for an individual are described. (JAC)

Proposes and illustrates a new method by which "what if" analyses can be conducted using estimated true population effects. Use of these "what if" methods may prevent authors with large sample sizes from overinterpreting their small effects once they see that the small effects would no longer have been statistically significant with only a…

The author discusses the importance of statistical significance to researchers and suggests that researchers should consider an additional statistic, the magnitude of effect index. (MK)

Reviews practices regarding tests of statistical significance and policies of the American Educational Research Association (AERA). Decades of misuse of statistical significance testing are described, and revised editorial policies to improve practice are highlighted. Correct interpretation of statistical tests, interpretation of effect sizes, and…

Critiqued and reanalyzed a recent study of the validity of five Minnesota Multiphasic Personality Inventory (MMPI) alcoholism scales. The original study concluded that these scales were invalid in terms of classifying patients in regard to alcoholic status. Reanalysis provides evidence for the validity of four of the five scales. (Author/JAC)

Raw scores for the clinical scales of MMPI can be changed to T scores by linear transformation. If the underlying distributions of raw scores are not distributed normally, one cannot assume the traditional point of significance. Suggests that clinicians consider more conservative interpretation for some scales. (Author)

Procedures are described for determining the statistical significance of a set of ratings made on bidirectional (B) scales. B and its statistical significance can be determined on samples of items or raters. The statistical significance of a mean of B values can be assessed by applying a normal approximation test. (Author/DWH)

Performances of the Mantel Haenszel odds-ratio estimator and chi-square significance test were investigated using simulated data for 500 reference group and 500 focal group examinees. Results demonstrate the importance of using both the odds-ratio and significance tests in interpreting the presence or absence of differential item functioning. (SLD)

The original nine programs for semantic differential analysis have been condensed into three programs which have been further refined and augmented. They yield: (1) means, standard deviations, and standard errors for each subscale on each concept; (2) Evaluation, Potency, and Activity (EPA) means, standard deviations, and standard errors; (3)…

In this paper it is argued that the problem of construct validation in the construction of instruments and indicators is an important problem for educational researchers and practitioners; moreover, it is claimed that the popular notion of operational definition is a misleading idea which has obscured the problem of construct validity in…