This study examined a holistic admissions review process at one institution to determine whether variance occurred and, if so, possible explanations for it. The study analyzed reader reviews for approximately 15,000 individual undergraduate admission reviews over three years. The primary method was focused on the variance and inter-rater…

In its purest form, the purpose of assessment is to use evidence to give an account of and improve student learning, but assessment is rarely practiced in its purest form. For many staff and faculty in higher education, assessment is something they are asked or, more likely, required to do. The reason is because some external entity has required…

With the upcoming review of the National Certificates of Educational Achievement (NCEA) and the removal of National Standards, it is time to reconsider how we approach assessment. In this edition of Assessment News I argue that it is time to put assessment for learning (AfL) and the assessment-capable teacher and student "front and…

Metrics including Cohen's kappa, precision, recall, and F[subscript 1] are common measures of performance for models of discrete student states, such as a student's affect or behaviour. This study examined discrete model metrics for previously published student model examples to identify situations where metrics provided differing perspectives on…

This article is a written version of the Presidential Address I gave at the annual meeting of the National Council on Measurement in Education (NCME) in April 2017. It is a call to NCME members (and others who read this, of course) to rebalance their focus so that classroom assessments are seen as being at least as important as large-scale…

Traditional pre-test (TpT)/post-test (PT) and retrospective pre-test (RpT)/post-test (PT) designs are used to collect data on self-reported measures to assess the magnitude of change that occurs from interventions. If measurement invariance does not exist across the measurement occasions within these research designs, it is inappropriate to…

This review examines the external systems in place to assure the quality of higher education in Brazil. It highlights the relative success of the Brazilian quality assurance model in regulating market entry for private operators in Brazil, which cater to over 70% of students. But it also calls into question the effectiveness of existing systems to…

In Huggins-Manley & Han (2017), it was shown that WLSMV global model fit indices used in structural equating modeling practice are sensitive to person parameter estimate RMSE and item difficulty parameter estimate RMSE that results from local dependence in 2-PL IRT models, particularly when conditioning on number of test items and sample size.…

Purpose: The purpose of this paper is to analyze and explore the effectiveness of using balanced scorecard (BSC) as a management tool in the evaluation of the performance and thereby the quality services of a University. Design/methodology/approach: The survey was conducted among the various faculties and departments Sohar University through a…

This article looks at how colonialism has contributed to the racialized history of Indigenous people by unethical diagnostic implementations of categories and classifications, while overlooking exceptionalities when assessing Indigenous people. By understanding how settler-colonial assessments and/or diagnostic tests have been developed and…

Disproportionality persists with regard to the labeling of students with emotional and behavioral disorders (EBD). A blending of critical race theory and disability studies, or DisCrit, provides a framework to examine disproportionality. In this article, a DisCrit mindset is applied to examine how racism and ableism intersect to disproportionately…

Inquiry-Based Teaching Practice (IBTP) is an essential component of science education, and promoting its implementation is at the heart of various reform efforts. Even though science teachers regard IBTP as an essential pedagogical method, they rarely use it for various reasons. This study utilizes Bronfenbrenner's ecological framework to examine…

This study examined the integration of artificial intelligence-powered speech recognition technology within early reading assessments in Morocco's Teaching at the Right Level (TaRL) program. The purpose was to evaluate the effectiveness of an automated speech recognition tool compared to traditional paper-based assessments in improving reading…

The use of learner modelling approaches is critical for providing adaptive support in educational computer games, with predictive learner modelling being among the key approaches. While adaptive supports have been shown to improve the effectiveness of educational games, improperly customized support can have negative effects on learning outcomes.…

The Micro-Credential Program is a digital badging system composed of competency-based pathways that move forward early childhood professionals to achieving mastery in employability skills. These skills are crucial for early childhood professionals to have to provide high-quality, nurturing learning environments to children in their care as well as…