This scope-review presents the milestones of how Hierarchical Rater Models (HRMs) become operable to used in automated essay scoring (AES) to improve instructional evaluation. Although essay evaluations--a useful instrument for evaluating higher-order cognitive abilities--have always depended on human raters, concerns regarding rater bias,…

One of the central components of cognitive diagnostic assessment is the Q-matrix, which is an essential loading indicator matrix and is typically constructed by subject matter experts. Nonetheless, to a large extent, the construction of Q-matrix remains a subjective process and might lead to misspecifications. Many researchers have recognized the…

This article seeks to contribute to the reflection around the training of future designers regarding teamwork. Collaboration, teamwork and negotiations are common everyday interactions that are now known to contribute positively to the design process. This article builds on a theoretical model that was initially proposed as a Ph.D. thesis…

Educational tests often have a cluster of items linked by a common stimulus ("testlet"). In such a design, the dependencies caused between items are called "testlet effects." In particular, the directional testlet effect (DTE) refers to a recursive influence whereby responses to earlier items can positively or negatively affect…

This study proposes a Bayesian method for diagnostic classification models (DCMs) for a partially known Q-matrix setting between exploratory and confirmatory DCMs. This Q-matrix setting is practical and useful because test experts have pre-knowledge of the Q-matrix but cannot readily specify it completely. The proposed method employs priors for…

Purpose: The increasing societal requirement requests higher education institutions to be more responsive to socioeconomic needs and new governmental demands. This study aims to present a self-developed multidimensional quality assurance and assessment model for higher education institutions -- R.I.S.E model (relevance, impact, significance and…

E-Learning has become a global phenomenon. It makes learning more accessible and acquisition of new skills and knowledge easier. In sub-Saharan Africa, however, online qualifications are often the subject of controversy regarding their recognition. This is clear evidence of unsuitable e-Learning systems, as well as the limited relevance of the…

Assessing instruction quality is a fundamental component of any improvement efforts in the education system. However, traditional manual assessments are expensive, subjective, and heavily dependent on observers' expertise and idiosyncratic factors, preventing teachers from getting timely and frequent feedback. Different from prior research that…

Traditional validation approaches fail to account for the ways oppressive systems (e.g. racism, radical nationalism) impact the test design and development process. To disrupt this legacy of white supremacy, we illustrate how justice-oriented, antiracist validation (JAV) framework can be applied to construct articulation and validation, data…

The purpose of this study was to demonstrate the effectiveness level of the Provus-Alkin-amalgamation evaluation application based on Weighted-Product-"Rwa-Bhineda" modification through the results of field trials. This evaluation application was an evaluation tool formed by a combination of educational evaluation models (Provus model…

This article presents the consensus of an National Council on Measurement in Education Presidential Task Force on Foundational Competencies in Educational Measurement. Foundational competencies are those that support future development of additional professional and disciplinary competencies. The authors develop a framework for foundational…

Senate Bill (SB) 1882 partnerships, codified into Texas state law in 2017, are the latest iteration of portfolio management models (PMMs) in elementary and secondary education. PMMs aim to overhaul the current governance structure of public education, granting autonomy over critical areas of school operations to school operators, while using the…

Through this point-of-departure paper we aim to prompt discussion and action around redesigning university learning to help students tackle climate-related challenges in a personally and societally meaningful way. We use the lens of assessment to draw attention to how discipline areas without an explicit environmental or climate science focus can…

The CIPP model has been widely used in the evaluation of vocational education. However, there has been no research that examines the suitability of CIPP in evaluating vocational education. Therefore, this study examined the suitability of CIPP in evaluating vocational education through a literature review. This research was a literature review…

This article presents the performance of item response theory (IRT) models when double ratings are used as item scores over single ratings when rater effects are present. Study 1 examined the influence of the number of ratings on the accuracy of proficiency estimation in the generalized partial credit model (GPCM). Study 2 compared the accuracy of…