Traditional statistical model evaluation typically relies on goodness-of-fit testing and quantifying model complexity by counting parameters. Both of these practices may result in overfitting and have thereby contributed to the generalizability crisis. The information-theoretic principle of minimum description length addresses both of these…

State and federal governments invest millions of dollars in providing accurate and relevant information on expected outcomes to students pursuing higher education, but whether such information targets what students value about college is unclear. We use new survey data to identify the extent to which conventional indicators for college quality and…

Thurstonian forced-choice modeling is considered to be a powerful new tool to estimate item and person parameters while simultaneously testing the model fit. This assessment approach is associated with the aim of reducing faking and other response tendencies that plague traditional self-report trait assessments. As a result of major recent…

In the current higher education landscape, universities are facing expanding requirements beyond teaching and research. Evaluation methods must evolve accordingly to prevent universities from facing development dilemmas. Current mainstream evaluation methods primarily emphasize the research domain, often failing to holistically capture a…

For over 30 years, calls have been issued for the western evaluation field to address implicit bias in its theory and practice. Although many in the field encourage evaluators to be culturally competent, ontological competence remains unaddressed. Grounded in an institutionalized distrust of non-western perspectives of reality and knowledge…

For offering adaptive learning to learners in intelligent tutoring systems, one of the fundamental tasks is knowledge tracing (KT), which aims to assess learners' learning states and make prediction for future performance. However, there are two crucial issues in deep learning-based KT models. First, the knowledge concepts are used to predict…

The purpose of this study was to evaluate the degree of classification quality in the basic latent class model when covariates are either included or are not included in the model. To accomplish this task, Monte Carlo simulations were conducted in which the results of models with and without a covariate were compared. Based on these simulations,…

Determining the number of dimensions is extremely important in applying item response theory (IRT) models to data. Traditional and revised parallel analyses have been proposed within the factor analysis framework, and both have shown some promise in assessing dimensionality. However, their performance in the IRT framework has not been…

This article argues that Agent-Based Modelling, owing to its capabilities and methodology, has a distinctive contribution to make to delivering coherent social science prediction. The argument has four parts. The first identifies key elements of social science prediction induced from real research across disciplines, thus avoiding a straw person…

The randomized response technique (RRT) is an effective method designed to obtain the stigmatized information from respondents while assuring the privacy. In this study, we propose a new two-stage RRT model to estimate the prevalence of sensitive attribute ([pi]). A simulation study shows that the empirical mean and variance of proposed estimator…

The COVID-19 pandemic has tackled global sustainability without prejudice or geographical constraint. It has also prompted people to advance to the post-pandemic era. However, it is possible that in the future, extreme negative effects in response to crisis, especially during a pandemic, would recur. In fact, it might worsen. This situation has…

The current research study utilized a case study research method to test the theory that the creativity and innovative processes are a complex adaptive system. Through qualitative interviews with renowned creators, the current study categorized the data into eight characteristics of complex adaptive systems: path dependent, systems have a history,…

This paper reports on the results of a research-practice partnership that included a U.S. university research team and a state-funded grants program that supports informal science education. The goal of the 2-year partnership was to develop an empirically-tested model for collaboration and capacity-building (CCB) in support of collective…

We have maintained the customer grade system that is being implemented to customers with excellent performance through customer segmentation for years. Currently, financial institutions that operate the customer grade system provide similar services based on the score calculation criteria, but the score calculation criteria vary from the financial…

Factor Score Regression (FSR) is increasingly employed as an alternative to structural equation modeling (SEM) in small samples. Despite its popularity in psychology, the performance of FSR in multigroup models with small samples remains relatively unknown. The goal of this study was to examine the performance of FSR, namely Croon's correction and…