Hamdani et al. recently provided guidance for prospective authors on a wide range of issues encountered in quantitative research papers submitted for review at the "Journal of Management Education." Building on their insights, this essay focuses on experimental designs and provides more specific guidance and recommendations for…

Most of the scientometric indicators use only the total number of citations of an article and produce a single number for scientific assessment of scholars. Although this concept is very simple to compute, it fails to show the scientific productivity and impact of scholars during a time-span or in a year. To overcome this, several time series…

Toward the goal of more rapid knowledge accumulation via better meta-analyses, this article explores statistical approaches intended to increase the precision and comparability of effect sizes from education research. The featured estimate of the proposed approach is a standardized mean difference effect size whose numerator is a mean difference…

This tool is intended to support state and local education agencies in developing a statistical model for estimating student postsecondary success at the school or district level. The tool guides education agency researchers, analysts, and decisionmakers through options to consider when developing their own model. The resulting model generates an…

Cost, cost-effectiveness, and benefit-cost analysis are methods used by economists to evaluate public policies. Essentially, these methods rely on impact evaluations, that is, research studies of efficacy and effectiveness. However, in most research in education, these cost and impact evaluations are performed separately. This separation creates…

Research funders and policymakers increasingly focus on societal benefits of their investments in research. Research institutions thus face increasing pressure to demonstrate their societal impact to prove their legitimacy and worth. To this end, research institutions need reliable, quantitative methods to measure societal impact. This article…

This paper investigated the performance of a propensity score analysis by a simulation study that involved using 12 covariates consisting of 3 different variable types. The three types of covariates included covariates related only to the outcome measure, covariates related only to assignment of treatment, and covariates related to both outcome…

There has been growing interest in using statistical methods to analyze data and estimate effect size indices from studies that use single-case designs (SCDs), as a complement to traditional visual inspection methods. The validity of a statistical method rests on whether its assumptions are plausible representations of the process by which the…

Design-based methods have recently been developed as a way to analyze randomized controlled trial (RCT) data for designs with a single treatment and control group. This article builds on this framework to develop design-based estimators for evaluations with multiple research groups. Results are provided for a wide range of designs used in…

Design-based methods have recently been developed as a way to analyze data from impact evaluations of interventions, programs, and policies (Freedman, 2008; Lin, 2013; Imbens and Rubin, 2015; Schochet, 2013, 2016; Yang and Tsiatis, 2001). The non-parametric estimators are derived using the building blocks of experimental designs with minimal…

Recent trends in higher education have increased interest in improving accountability in U.S. higher education beyond current accreditation practices. Many proposed solutions include using quantitative-performance measures like graduation and default rates to assess performance, but questions remain about how such a system could fit-in with…

This chapter analyzes the various ways social class identity has been measured among undergraduate students. Implications of social class definitions and measurement for student affairs practitioners also are discussed.

Experimental research in education and training programs typically involves administering treatment to whole groups of individuals. As such, researchers rely on the estimation of design parameter values to conduct power analyses to efficiently plan their studies to detect desired effects. In this study, we present design parameter estimates from a…

Role models may be essential in helping students develop environmental literacy and characteristics associated with positive youth development (PYD). We examine the identities of middle school students' self-reported role models before, immediately after, and three months following an immersive 5-day residential environmental education (EE)…

With the increasing demand for evidence-based research on teacher effectiveness and improving student achievement, more impact studies are being conducted to examine the effectiveness of professional development (PD) interventions. Cluster randomized trials (CRTs) are often carried out to assess PD interventions that aim to improve both teacher…