The main objective of this Methods Showcase Article is to show how the technique of adaptive comparative judgment, coupled with a crowdsourcing approach, can offer practical solutions to reliability issues as well as to address the time and cost difficulties associated with a text-based approach to proficiency assessment in L2 research. We…

Network meta-analysis is a popular method to synthesize the information obtained in a systematic review of studies (e.g., randomized clinical trials) involving subsets of multiple treatments of interest. The dominant method of analysis employs within-study information on treatment contrasts and integrates this over a network of studies. One…

Timely diagnostic feedback is helpful for students and teachers, enabling them to adjust their learning and teaching plans according to a current diagnosis. Motivated by the practical concern that the simultaneity estimation strategy currently adopted by longitudinal learning diagnosis models does not provide timely diagnostic feedback, this study…

In this work, we explore the use of digital technologies and statistical analysis to monitor how Italian secondary school students' writing changes over time and how comparisons can be made across different high school types. We analyzed more than 2,000 exam essays written by Italian high school students over 13 years and in five different school…

Suicide is a major cause of death in American youth. Suicide risk assessment is a promising suicide prevention strategy; however, little is known about school-based suicide risk assessment practices. The purpose of this study was to examine the scope of standardization, comprehensiveness, and follow-up procedures as part of the suicide risk…

The construct of "learning potential" has been proposed to capture differences between learner independent performance and performance during Dynamic Assessment (DA). This paper introduces a new LPS formula implemented in a DA study involving Pakistani learners of L2 Chinese. Learners were randomly assigned to a control or experimental…

Tests of statistical significance often play a decisive role in establishing the empirical warrant of evidence-based research in education. The results from pattern-based assessment items, as introduced in this paper, are categorical and multimodal and do not immediately support the use of measures of central tendency as typically related to…

Social innovations (SIs) frequently bring previously unrelated actors, ideas, and practices together in new configurations with the goal of addressing social needs. However, the dizzying variety of definitions of SI and their dynamic, exploratory character raise dilemmas for evaluators tasked with their evaluations. This article is based on a…

Research-based assessments (RBAs) measure how well a course achieves discipline-specific outcomes. Educators can use outcomes from RBAs to guide instructional choices and to request resources to implement and sustain instructional transformations. One challenge for using RBAs, however, is a lack of comparative data, particularly given the skew in…

The purpose of this descriptive analysis study was to investigate high school music teachers' levels of satisfaction with the teacher evaluation practices used by administrators and music supervisors in the Commonwealth of Virginia. Virginia high school music teachers (n = 76) were surveyed to collect data used to determine their levels of…

Comprehensibility has emerged as a useful and intuitive means of globally evaluating second language (L2) speakers in many research and instructional contexts. In most cases, L2 speakers' comprehensibility is assessed by external listeners who do not engage in extensive communication with the speakers, even though the degree to which a speaker is…

This paper presents new evidence that explores the strengths, weaknesses and overall quality of school inspection practice in China. In one city region of Shandong Province, the research examines stakeholder perceptions of inspection purposes, processes and outcomes, as well as the potential to improve inspection practice and compulsory education…

Comparative interrupted time series (CITS) designs evaluate impact by modeling the relative deviation from trends among a treatment and comparison group after an intervention. The broad applicability of the design means it is widely used in education research. Like all non-experimental evaluation methods however, the internal validity of a given…

We investigated French primary school teachers' assessment practice in mathematics. Using an online questionnaire on teachers' background, teaching, and grading practice, we were able to determine assessment profiles of 604 primary school teachers. As evidenced by the teachers' scores on the latent factors Assessment purposes, Assessment…

Assessing children's working memory capacity (WMC) can be challenging for a variety of reasons, including the rapid increase in WMC across early childhood. Here, we developed and piloted an adapted WMC task, which involved minimal equipment, could be performed rapidly, and did not rely on verbal production ability (to facilitate the use of the…