In the learning design community, there has been an increasing recognition of the value of positioning teaching as a design science, in which teachers craft and test effective learning conditions through a goal-oriented and evidence-based procedure. However, the existing models and tools supporting teachers' design practice focus primarily on…

Abstract This study proposes a new Bayesian differential item functioning (DIF) detection method using posterior predictive model checking (PPMC). Item fit measures including infit, outfit, observed score distribution (OSD), and Q1 were considered as discrepancy statistics for the PPMC DIF methods. The performance of the PPMC DIF method was…

The aim of this paper is to present a schema that maps the terrain of intercultural assessment strategies. This schema is based upon Haraway's semiotic square and has two dimensions. The first considers how distant or near the cultural Other is understood to be -- whether they are perceived a "stranger" or a "neighbour." The…

Traditional statistical model evaluation typically relies on goodness-of-fit testing and quantifying model complexity by counting parameters. Both of these practices may result in overfitting and have thereby contributed to the generalizability crisis. The information-theoretic principle of minimum description length addresses both of these…

In the current higher education landscape, universities are facing expanding requirements beyond teaching and research. Evaluation methods must evolve accordingly to prevent universities from facing development dilemmas. Current mainstream evaluation methods primarily emphasize the research domain, often failing to holistically capture a…

Background/Context: Theoretical and policy frameworks consistently assert that warm, responsive, and cognitively rich teacher-child interactions are crucial for infants' and toddlers' learning and development (Burchinal, 2018; Pianta & Hamre, 2009). In Early Head Start (EHS), such "process quality" is expected to bolster children's…

For over 30 years, calls have been issued for the western evaluation field to address implicit bias in its theory and practice. Although many in the field encourage evaluators to be culturally competent, ontological competence remains unaddressed. Grounded in an institutionalized distrust of non-western perspectives of reality and knowledge…

For offering adaptive learning to learners in intelligent tutoring systems, one of the fundamental tasks is knowledge tracing (KT), which aims to assess learners' learning states and make prediction for future performance. However, there are two crucial issues in deep learning-based KT models. First, the knowledge concepts are used to predict…

The purpose of this study was to evaluate the degree of classification quality in the basic latent class model when covariates are either included or are not included in the model. To accomplish this task, Monte Carlo simulations were conducted in which the results of models with and without a covariate were compared. Based on these simulations,…

Determining the number of dimensions is extremely important in applying item response theory (IRT) models to data. Traditional and revised parallel analyses have been proposed within the factor analysis framework, and both have shown some promise in assessing dimensionality. However, their performance in the IRT framework has not been…

This article argues that Agent-Based Modelling, owing to its capabilities and methodology, has a distinctive contribution to make to delivering coherent social science prediction. The argument has four parts. The first identifies key elements of social science prediction induced from real research across disciplines, thus avoiding a straw person…

The randomized response technique (RRT) is an effective method designed to obtain the stigmatized information from respondents while assuring the privacy. In this study, we propose a new two-stage RRT model to estimate the prevalence of sensitive attribute ([pi]). A simulation study shows that the empirical mean and variance of proposed estimator…

The COVID-19 pandemic has tackled global sustainability without prejudice or geographical constraint. It has also prompted people to advance to the post-pandemic era. However, it is possible that in the future, extreme negative effects in response to crisis, especially during a pandemic, would recur. In fact, it might worsen. This situation has…

The current research study utilized a case study research method to test the theory that the creativity and innovative processes are a complex adaptive system. Through qualitative interviews with renowned creators, the current study categorized the data into eight characteristics of complex adaptive systems: path dependent, systems have a history,…

This paper reports on the results of a research-practice partnership that included a U.S. university research team and a state-funded grants program that supports informal science education. The goal of the 2-year partnership was to develop an empirically-tested model for collaboration and capacity-building (CCB) in support of collective…