The statistical computing and graphics software R, despite its many advantages, is sometimes considered too complex to be introduced to undergraduate political science majors. In this article I showed that when taught appropriately, R could be a valuable and well-received aspect of an introductory research methods course. It is important to teach…

We conducted a systematic literature review of 111 empirical studies published between 1969 and 2018. We found that research does not exponentially grow in comparison to research on higher education or leadership; empirical research emerging in the 1980s does not completely replace non-empirical inquiry. Studies from English-speaking authors…

Several programs of research have sought to assess the replicability of scientific findings in different fields, including economics and psychology. These programs attempt to replicate several findings and use the results to say something about large-scale patterns of replicability in a field. However, little work has been done to understand the…

Generalizability theory is a modern, powerful, and broad framework used to assess the reliability, or dependability, of measurements. While there exist classic works that explain the basic concepts and mathematical foundations of the method, there is currently a lack of resources addressing computational resources for those researchers wishing to…

In applications of item response theory (IRT), fixed parameter calibration (FPC) has been used to estimate the item parameters of a new test form on the existing ability scale of an item pool. The present paper presents an application of FPC to multiple examinee groups test data that are linked to the item pool via anchor items, and investigates…

Missing data patterns are the combinations in which the variables with missing values occur. Exploring these patterns in multivariate data can be very useful but there are few specialized tools. The current paper presents a plot that includes relevant information for visualizing these patterns. The plot is also dynamic-interactive; so, selecting…

This contribution offers a commentary on Neil Selwyn's write up of his keynote talk from the Learning Analytics and Knowledge Conference in 2018 (Selwyn, this issue). The article has three main sections, namely an account of what Learning Analytics has done, an account of the values behind Learning Analytics, and some ideas for moving forward.…

The development of educational research designs might be daunting for novice researchers that have to make choices among the plethora of philosophical frameworks, research traditions, and different methods existing in the field. In this article we describe the process followed to formally evaluate Hopscotch, a model and a web-tool created by the…

Numerous studies merely note divergence in students' and teachers' ratings of student noncognitive constructs. However, given the increased attention and use of these constructs in educational research and practice, an in-depth study focused on this issue was needed. Using a variety of quantitative methodologies, we thoroughly investigate…

The purpose of the present study is to compare nonnormal distributions (i.e., t, skew-normal, skew-t with equal skew and skew-t with unequal skew) in growth mixture models (GMMs) based on diverse conditions of a number of time points, sample sizes, and skewness for intercepts. To carry out this research, two simulation studies were conducted with…

Applying single-level statistical models to multilevel data typically produces underestimated standard errors, which may result in misleading conclusions. This study examined the impact of ignoring multilevel data structure on the estimation of item parameters and their standard errors of the Rasch, two-, and three-parameter logistic models in…

It is necessary to examine the measurement invariance (MI) among groups in studies where different groups are compared by using a measurement instrument. Most of the studies, measurement invariance is tested with multiple group confirmatory factor analysis. This model applies many model adjustments based on the modification indexes. Therefore, it…

Cost-effectiveness analysis is a widely used educational evaluation tool. The randomized controlled trials that aim to evaluate the cost-effectiveness of the treatment are commonly referred to as randomized cost-effectiveness trials (RCETs). This study provides methods of power analysis for two-level multisite RCETs. Power computations take…

The finite population correction (FPC) factor is often used to adjust variance estimators for survey data sampled from a finite population without replacement. As a replicated resampling approach, the jackknife approach is usually implemented without the FPC factor incorporated in its variance estimates. A paradigm is proposed to compare the…

This study explores the methodology presented in four leading educational leadership journals for a period of three years to investigate the predominant methodologies reported in journals most read by faculty members in educational administration or leadership programs. This content analysis study uses frequency and percentages to gather data on…