Likert-type item is the most popular response format for collecting data in social, educational, and psychological studies through scales or questionnaires. However, there is no consensus on whether parametric or non-parametric tests should be preferred when analyzing Likert-type data. This study examined the statistical power of parametric and…

This article addresses the problem of testing the difference between two correlated agreement coefficients for statistical significance. A number of authors have proposed methods for testing the difference between two correlated kappa coefficients, which require either the use of resampling methods or the use of advanced statistical modeling…

The current study aimed to construct a questionnaire that measures students' personality traits related to "striving for understanding" and "learning value of geometry" and then examine its psychometric properties. Through the use of multiple methods on two independent samples of 402 and 521 middle school students, two studies…

Since heterogeneity between reliability coefficients is usually found in reliability generalization studies, moderator analyses constitute a crucial step for that meta-analytic approach. In this study, different procedures for conducting mixed-effects meta-regression analyses were compared. Specifically, four transformation methods for the…

The purpose of this study was to illustrate the use of the randomization test for single-case research designs (SCR; Kratochwill & Levin, 2010). To demonstrate the application of this approach, a systematic replication of Grünke, Wilbert, and Calder Stegemann (2013) was conducted to evaluate the effects of a story map to improve the reading…

Applied researchers often include mediation effects in applications of advanced methods such as latent variable models and linear growth curve models. Guidance on how to estimate statistical power to detect mediation for these models has not yet been addressed in the literature. We describe a general framework for power analyses for complex…

In the first part of the study, nine estimators of the first-order autoregressive parameter are reviewed and a new estimator is proposed. The relationships and discrepancies between the estimators are discussed in order to achieve a clear differentiation. In the second part of the study, the precision in the estimation of autocorrelation is…

There are good reasons for the growing popularity of Monte Carlo procedures; but with increasing use comes increasing misuse. A variety of exact and approximate alternatives should be considered before one chooses to approach a problem with Monte Carlo methods. Once it has been decided that simulation is desirable, consideration should be given to…

The problem of determing how many significant discriminant functions are present in a given data set for a one-way, fixed-effects multivariate analysis of variance design is studied using a Monte Carlo procedure. A variety of procedures, including the popular partitioned-U procedure, are compared with respect to their Type I error rates and power…

Monte Carlo techniques were employed to compare the familiar F-test with Welch's V-test procedure for testing hypotheses concerning a priori contrasts among K treatments. The two procedures were compared under homogeneous and heterogeneous variance conditions. (Author)

Compares three methods of analyzing pairwise treatment differences in a multi-treatment experiment via computer simulation techniques. Under the equal n condition, the robustness of the conventional Tukey Wholly Significant Difference test (WSD) to heterogeneous variances was contrasted with two alternate techniques. Under unequal n conditions,…

Hawkin's procedure for testing a sequence of observations for a shift in location could have applicability for assessing change within a single subject. Monte Carlo results suggest that Hawkins' procedure is robust with respect to moderate violations of its underlying assumptions of homogeneity of variance and normality. (Author/GDC)

A new item parameter replication method is proposed for assessing the statistical significance of the noncompensatory differential item functioning (NCDIF) index associated with the differential functioning of items and tests framework. In this new method, a cutoff score for each item is determined by obtaining a (1-alpha ) percentile rank score…

This study compared three approaches to the two-factor experiment with repeated measures on one factor: (1) the conventional mixed model analysis of variance, (2) the Greenhouse-Geisser conservative analysis of variance, and (3) multivariate extensions of analysis of variance. Computer simulated data were used in a total of 96 sets of covariance…