This dissertation examined classification outcome differences among four popular individual supervised machine learning (ISML) models (logistic regression, decision tree, support vector machine, and multilayer perceptron) when predicting minor class membership within imbalanced datasets. The study context and the theoretical population sampled…

The 0.05 boundary within Null Hypothesis Statistical Testing (NHST) "has made a lot of people very angry and been widely regarded as a bad move" (to quote Douglas Adams). Here, we move past meta-scientific arguments and ask an empirical question: What is the psychological standing of the 0.05 boundary for statistical significance? We…

Using data from multiple informants has long been considered best practice in education. However, multiple informants often disagree on similar constructs, complicating decision-making. Polynomial regression and response-surface analysis (PRA) is often used to test the congruence effect between multiple informants on an outcome. However, PRA…

To detect differential item functioning (DIF), Rasch trees search for optimal split-points in covariates and identify subgroups of respondents in a data-driven way. To determine whether and in which covariate a split should be performed, Rasch trees use statistical significance tests. Consequently, Rasch trees are more likely to label small DIF…

Mixed-effects models can be used to examine the association between a categorical moderator and the magnitude of the effect size. Two approaches are available to estimate the residual between-studies variance, t[superscript 2][subscript res] --namely, separate estimation within each category of the moderator versus pooled estimation across all…

This letter documents some problems in Ancaiani et al. (2015). Namely the evaluation of concordance, based on Cohen's kappa, reported by Ancaiani et al. was not computed on the whole random sample of 9,199 articles, but on a subset of 7,597 articles. The kappas relative to the whole random sample were in the range 0.07-0.15, indicating an…

Introduction: The use of averaged topic-level scores can result in the loss of valuable data and can cause misinterpretation of the effectiveness of system performance. This study aims to use the scores of each document to evaluate document retrieval systems in a pairwise system evaluation. Method: The chosen evaluation metrics are document-level…

In this article, we explore the meaning potentials of teacher education in terms of the significance of a research-based approach and the different pedagogic identities that such an approach implies. The study's aim is to examine the important factors for education to be considered research-based and to identify and analyse the research base of…

This study adapted an effect size measure used for studying differential item functioning (DIF) in unidimensional tests and extended the measure to multidimensional tests. Two effect size measures were considered in a multidimensional item response theory model: signed weighted P-difference and unsigned weighted P-difference. The performance of…

The present study reports on an investigation of the generalizability of the technical adequacy of the Positive Experience at School Scale (PEASS) with a sample of students (N = 1,002) who differed substantially in age/grade level (i.e., adolescents in middle school as opposed to children in elementary school) and ethnic identity (i.e., majority…

The authors examined master of business administration (MBA) degrees earned by women at U.S. higher education institutions at three specific years spanning a decade: 2003, 2008, and 2013 to determine whether there was a significant difference in the percentage of MBA degrees earned by women based on the independent variables of institutional type,…

The worldwide expansion of higher education introduced the problem of quality of knowledge that graduate students possess, as well as question whether they are competent to fulfill the requirements of their future profession. Education and training for professional work, in our educational system, is realized in various ways: through lectures,…

Despite federal and state laws and regulations that require states and local districts to provide English language learners (ELLs) with support services, prior research has indicated that ELLs are, in general, lagging behind non-ELLs in academic achievement. An unanswered question is whether the initial designation of students as ELL influences…

We have studied the types of student teams that are most effective for collaborative learning in a large freshman university physics course. We compared teams in which the students were all of roughly equal ability to teams with a mix of student abilities, we compared teams with three members to teams with four members, and we examined teams with…

The purpose of this study was to examine evidence of a hypothesized shift in the operative research paradigms in music education during the first quarter century of the publication of the "Journal of Research in Music Education," during the period 1953 to 1978. This shift was from humanities-oriented historical and philosophical studies…