This simulation study investigated to what extent departures from construct similarity as well as differences in the difficulty and targeting of scales impact the score transformation when scales are equated by means of concurrent calibration using the partial credit model with a common person design. Practical implications of the simulation…

In this study, it was aimed to examine the effect of missing data in different patterns and sizes on test equating methods under the NEAT design for different factors. For this purpose, as part of this study, factors such as sample size, average difficulty level difference between the test forms, difference between the ability distribution,…

We discuss analysis of 5-grade Likert type data in the two-sample case. Analysis using two-sample "t" tests, nonparametric Wilcoxon tests, and ordinal regression methods, are compared using simulated data based on an ordinal regression paradigm. One thousand pairs of samples of size "n"=10 and "n"=30 were generated,…

Over the past ten years, propensity score methods have made an important contribution to improving generalizations from studies that do not select samples randomly from a population of inference. However, these methods require assumptions and recent work has considered the role of bounding approaches that provide a range of treatment impact…

Population invariance is a desirable property of test equating which might not hold when significant changes occur in the test population, such as those brought about by the COVID-19 pandemic. This research aims to investigate whether equating functions are reasonably invariant when the test population is impacted by the pandemic. Based on…

This article is concerned with the large-sample parameter estimator behavior in applications of Bayesian confirmatory factor analysis in behavioral measurement. The property of strong convergence of the popular Bayesian posterior median estimator is discussed, which states numerical convergence with probability 1 of the resulting estimates to the…

With the availability of educational digital data acquisition systems, it has also become possible in physics education to generate 'big' data sets by (a) measuring multiple variables simultaneously, (b) increasing the sample rate, (c) extending the measurement duration, or (d) choosing a combination among these three options. In the context of…

The authors discuss the use of surveys for collecting data from a population sample and emphasise the importance of being careful with the language of data collection. [For "The Data Files 5: Graphs for Exploring Relationships," see EJ1355504.]

The reliability of a test score is usually underestimated and the deflation may be profound, 0.40 - 0.60 units of reliability or 46 - 71%. Eight root sources of the deflation are discussed and quantified by a simulation with 1,440 real-world datasets: (1) errors in the measurement modelling, (2) inefficiency in the estimator of reliability within…

Optimal design of multisite randomized trials leverages sampling costs to optimize sampling ratios and ultimately identify more efficient and powerful designs. Past implementations of the optimal design framework have assumed that costs of sampling units are equal across treatment conditions. In this study, we developed a more flexible optimal…

In two-level designs, the total sample is a function of both the number of Level 2 clusters and the average number of Level 1 units per cluster. Traditional multilevel power calculations rely on either the arithmetic average or the harmonic mean when estimating the average number of Level 1 units across clusters of unbalanced size. The current…

Hierarchical data is often observed in education data. Analyzing such data with Multilevel Modeling becomes crucial to understanding the relationship at the individual and group levels. However, one of the most significant problems with this kind of data is small sample sizes and very low Intraclass Correlations. The multivariate Latent Covariate…

While learners' evaluations of author trustworthiness have received much attention in prior research, less work has examined how students evaluate information within texts or engage in critique. Specifically, in this exploratory study, we sought to determine how effective higher education students were at engaging in research report critique, a…

Comprehensive evaluation of treatment effects is aided by considerations for moderated effects. In educational research, the combination of natural hierarchical structures and prevalence of group-administered or shared facilitator treatments often produces three-level partially nested data structures. Literature details planning strategies for a…

Determining the number of factors in exploratory factor analysis (EFA) is crucial because it affects the rest of the analysis and the conclusions of the study. Researchers have developed various methods for deciding the number of factors to retain in EFA, but this remains one of the most difficult decisions in the EFA. The purpose of this study is…