Background: Chi and colleagues have argued that some of the most challenging engineering concepts exhibit properties of emergent systems. However, students often lack a mental framework, or schema, for understanding emergence. Slotta and Chi posited that helping students develop a schema for emergent systems, referred to as schema training, would…

Although the root-mean squared deviation (RMSD) is a popular statistical measure for evaluating country-specific item-level misfit (i.e., differential item functioning [DIF]) in international large-scale assessment, this paper shows that its sensitivity to detect misfit may depend strongly on the proficiency distribution of the considered…

The Reaction Coordinate Diagram Inventory (RCDI) has been developed to measure student thinking and confidence with reaction coordinate diagrams (RCDs) and their correspondence to reaction mechanisms. The RCDI was designed using a sequential mixed-methods protocol, such that the questions and distractors in the instrument were generated based on…

Since probability is a new topic at the primary school level in many countries, many primary school teachers may consider themselves not well prepared or may not value the formative role of probability as a topic for their students to learn. Consequently, the assessment of teachers' attitudes using valid and reliable instruments is a preliminary…

Some of the most important skills of university students is to develop the capacity to resolve problems posed by their communities, which implies that students become independent, autonomous and self-regulated. Also they need to be capable of monitor, asses and modify their learning through their own process of metacognition, this way they can…

This study investigates how interactive features embedded in the illustrations of storybook apps influenced young readers' story enjoyment and comprehension. Kindergartners and second graders (N = 91) were randomly assigned to read storybook apps in an interactive or noninteractive condition. Findings showed that children's self-reported enjoyment…

This study outlines the steps taken to create an academic multi-word unit list derived from corpus data. It gives details on the procedure used and the rationale behind why certain approaches were utilised. It also compares existing resources and makes some suggestions for practical use of the resulting resource.

The National Assessment Governing Board (the Board) contracted with Pearson to design and implement a review of the achievement level descriptions (ALDs) for National Assessment of Educational Progress (NAEP) Grade 8 assessments in Science, U.S. History, and Civics. This document describes the procedural and technical aspects and outcomes of the…

Cognitive diagnostic models (CDMs) have received much interest within the field of language testing over the last decade due to their great potential to provide diagnostic feedback to all stakeholders and ultimately improve language teaching and learning. A large number of studies have demonstrated the application of CDMs on advanced large-scale…

The Multiple-choice (MC) item format is commonly used in educational assessments due to its economy and effectiveness across a variety of content domains. However, numerous studies have examined the quality of MC items in high-stakes and higher-education assessments and found many flawed items, especially in terms of distractors. These faulty…

Cognitive diagnostic models (CDMs) have received sustained attention in educational settings because they can be used to operationalize formative assessment to provide diagnostic feedback and inform instruction. A large number of CDMs have been developed over the past few years. An important component of all CDMs is a Q-matrix that specifies a…

Automated scoring of free drawings or images as responses has yet to be used in large-scale assessments of student achievement. In this study, we propose artificial neural networks to classify these types of graphical responses from a TIMSS 2019 item. We are comparing classification accuracy of convolutional and feed-forward approaches. Our…

This study compared holistic and analytic marking methods for their effects on parameter estimation (of examinees, raters, and items) and rater cognition in assessing speech act production in L2 Chinese. Seventy American learners of Chinese completed an oral Discourse Completion Test assessing requests and refusals. Four first-language (L1)…

In order to identify the potential benefits and challenges of implementing student portfolios as quality mathematics assessment, a pilot study was conducted with teachers in various secondary school settings. The multi-case study consisted of five teacher participants from geographically and demographically differing contexts, four in the USA and…

Anxiety has a significant effect on oral communication, particularly when it occurs in the form of a public address. The quality of a public academic speaker's oral presentation may highly be determined by a variety of emotive elements. However, this has received much too little attention in the realm of academic dissertation oral defense…