In this paper, we describe student understanding of the "force concept" (basic concepts of Newtonian mechanics) by representing it as a vector-valued quantity, which we refer to as the "score-state vector," in a (30-dimensional) Force Concept Inventory (FCI) score space. We use a large ensemble of FCI results collected…

Group differences in test scores are a key metric in education policy. Response time offers novel opportunities for understanding these differences, especially in low-stakes settings. Here, we describe how observed group differences in test accuracy can be attributed to group differences in latent response speed or group differences in latent…

Australia participated in the eighth cycle of the Trends in International Mathematics and Science Study (TIMSS). TIMSS is an international sample study that assesses the mathematics and science achievement of Year 4 and Year 8 students every 4 years. Australia has participated in all cycles of TIMSS since it commenced in 1995 and over this 28-year…

TIMSS (Trends in International Mathematics and Science Study) is a long-standing international assessment of mathematics and science at the fourth and eighth grades, collecting trend data every four years since 1995. Over 70 countries rely on TIMSS to monitor their education systems in a global context, benchmarking national curricula and…

In this article, we extend Liao's test for across-group comparisons of the fixed effects from the generalized linear model to the fixed and random effects of the generalized linear mixed model (GLMM). Using as our basis the Wald statistic, we developed an asymptotic test statistic for across-group comparisons of these effects. The test can be…

The traditional description of "the scientific method" as a stepwise, linear process of hypothesis testing through experimentation is a myth. Although the teaching and learning of the scientific method have been a curriculum and assessment goal, the notion of the 'scientific method' itself has been identified as being problematic. Many…

In a signal detection theory (SDT) approach to multiple choice exams, examinees are viewed as choosing, for each item, the alternative that is perceived as being the most plausible, with perceived plausibility depending in part on whether or not an item is known. The SDT model is a process model and provides measures of item difficulty, item…

The participation of countries in various international large-scale assessments (ILSA) is motivated by different factors. In recent years however, there has been a growing popularity and importance placed on the results of ILSA. Recognising the significance of ILSA as a valuable source of feedback for enhancing the basic education system, the…

Providing diagnostic feedback about growth is crucial to formative decisions such as targeted remedial instructions or interventions. This article proposed a longitudinal higher-order diagnostic classification modeling approach for measuring growth. The new modeling approach is able to provide quantitative values of overall and individual growth…

Plant identification is a critical skill for students in biological sciences, especially forestry. Many students begin with limited plant identification abilities and struggle to learn this skill. To support student learning of identification and ecological characteristics of important forest plants in an undergraduate forest ecology course at the…

The world demands bold action to meet the global goal of zero net emissions by 2050. Young people will experience the consequences of climate change more directly during their lifetime than any previous generation in recent history. Education can play a pivotal role in preparing new generations for a greener future. What students learn may mean…

As we move further into the digital age, the acquisition of digital literacy (DL) and computational thinking (CT) skills is emerging internationally as an essential goal for students in contemporary school curricula. As the world becomes more uncertain and volatile due to impacts of artificial intelligence (AI), international unrest, climate…

Integrated assessment evaluates language proficiency through tasks that require the test-taker to produce a written or spoken output based on listening or reading comprehension (reading or listening-into-writing or speaking). Since integrated assessment aims at reflecting the communicative and cognitive requirements of academic life and other…

In the Italian education system, secondary students (ages 14-19) are confronted with the foundations of quantum physics during the final term of scientific high school (pre-university year). The Italian Ministry of Education, University and Research (acronym MIUR) has remarked its importance in the syllabus to address the high school exit…

The authors have experienced increasing demand from undergraduate students, particularly those in the early years of study, to be able to access more "test-style" material to help with revision, as well as guidance on how to approach their university assessments. With increased use of multiple-choice questions (MCQs) in university…