Researchers addressing posttreatment complications in randomized trials often turn to principal stratification to define relevant assumptions and quantities of interest. One approach for the subsequent estimation of causal effects in this framework is to use methods based on the "principal score," the conditional probability of belonging…

Drawing parallels to classical test theory, this article clarifies the difference between rater accuracy and reliability and demonstrates how category marginal frequencies affect rater agreement and Cohen's kappa. Category assignment paradigms are developed: comparing raters to a standard (index) versus comparing two raters to one another…

Carpenter (2011) argued that the testing effect she observed for semantically related but associatively unrelated paired associates supports the mediator effectiveness hypothesis. This hypothesis asserts that after the cue-target pair "mother-child" is learned, relative to restudying mother-child, a review test in which…

The article serves as a guide for researchers in developing evidence of validity using bivariate correlations, specifically construct validity. The authors outline the steps for calculating and interpreting bivariate correlations. Additionally, they provide an illustrative example and discuss the implications.

The present research aimed to investigate the feasibility of e-learning implementation in an Iranian comprehensive university (included medical and non-medical fields) to provide appropriate solutions in this regard. To achieve this objective, seven research questions were formed. Surveying method was applied for data collection in this study.…

This chapter asserts that data are more likely to improve learning when assessment focuses on sensemaking conversations among students, faculty, and student affairs administrators, rather than on advanced statistical techniques.

We present a new method in textbook analysis, based on so-called praxeological reference models focused on specific content at task level. This method implies that the mathematical contents of a textbook (or textbook part) is analyzed in terms of the tasks and techniques which are exposed to or demanded from readers; this can then be interpreted…

Purpose: The purpose of this paper is to establish the role of training in building employee commitment and the task of job satisfaction in the association between training and employee commitment in the banking sector in Uganda. Design/methodology/approach: The authors used correlation, regression and MedGraph to investigate the hypotheses.…

Assessing global interrater agreement is difficult as most published indices are affected by the presence of mixtures of agreements and disagreements. A previously proposed method was shown to be specifically sensitive to global agreement, excluding mixtures, but also negatively biased. Here, we propose two alternatives in an attempt to find what…

Many education policies require estimating whether students in different grades are on track for achieving certain educational standards. One approach for constructing these cut scores is to estimate the values on tests that predict reaching targets on subsequent tests. Whether a student is deemed on target can affect the student's course…

Test score distributions of schools or demographic groups are often summarized by frequencies of students scoring in a small number of ordered proficiency categories. We show that heteroskedastic ordered probit (HETOP) models can be used to estimate means and standard deviations of multiple groups' test score distributions from such data. Because…

In 2 studies (Ns = 55 and 54), the authors examined a basic form of conceptual understanding of rational number arithmetic, the direction of effect of decimal arithmetic operations, at a level of detail useful for informing instruction. Middle school students were presented tasks examining knowledge of the direction of effects (e.g., "True or…

Whilst early childhood education is regarded as important for young Indigenous Australians and it has been a feature of policy since the 1960s, it does not receive the same attention as compulsory schooling for Indigenous Australian students. A serious lack of large-scale research contributes to the devaluing of early childhood education for young…

The objective of this study was to examine how individual interest and knowledge acquisition are causally related. Three hypotheses were tested using a cross-lagged panel analysis (N = 186) and two quasi-experimental studies (N = 68 and N = 108) involving students from schools in Singapore. The first hypothesis is the broadly shared standard…

Findings from three field tests evaluations of early childhood intervention practitioner performance checklists and three parent practice guides are reported. Forty-two practitioners from three early childhood intervention programs reviewed the checklists and practice guides and made (1) social validity judgments of both products, (2) judgments of…