This study evaluates the ability of large language models (LLMs) to deliver criterion-based grading and examines the impact of prompt engineering with detailed criteria on grading. Using well-established human benchmarks and quantitative analyses, we found that even free LLMs achieve criterion-based grading with a detailed understanding of the…

To improve clinical teaching skills, feedback on teachers' strengths and weaknesses needs to be reliable, timely, and relevant. To provide timely feedback we undertook development of an analytical dashboard to provide learner feedback to our faculty. As dashboard data displays are limited we performed a modified Delphi (mDelphi) method to…

Transform your school's grading practices with this updated second edition on evidence-based grading. The book provides a five-phase process for moving beyond standards-based and competency-based grading models. Administrators and teachers will gain understanding of the core principles of evidence-based assessment, refocus assessments on…

Large Language Models (LLMs) hold promise as dynamic instructional aids. Yet, it remains unclear whether LLMs can replicate the adaptivity of intelligent tutoring systems (ITS)--where student knowledge and pedagogical strategies are explicitly modeled. We propose a prompt variation framework to assess LLM-generated instructional moves' adaptivity…

This study investigated how much practice is necessary for learners to attain durable second language (L2) grammar knowledge. Using digital flashcards, 119 participants practiced translating 12 sentences into an artificial language, followed by feedback, until they had typed all sentences correctly. Participants repeated this activity in one, two,…

This study aims to develop a scale to measure the design thinking process and to evaluate the reliability and validity of this scale. It fills this gap by introducing a 36-item scale specifically designed to measure design thinking abilities across the five key stages of the design thinking process: empathize, define, ideate, prototype, and test,…

Detailed learning objectives foster an effective and equitable learning environment by clarifying what instructors expect students to learn, rather than requiring students to use prior knowledge to infer these expectations. When questions are labeled with relevant learning goals, students understand which skills are tested by those questions.…

Empirical growth benchmarks, as introduced by Hill, Bloom, Black, and Lipsey (2008), are a well-known way to contextualize effect sizes in education research. Past work on these benchmarks, both positive and negative, has largely avoided confronting the role of vertical scales, yet technical issues with vertical scales trouble the use of such…

This study aims to conduct differential item functioning analyses in the context of cognitive diagnosis assessments using various formulations of the Wald test. In implementing the Wald test, two scenarios are considered: one where the underlying reduced model can be assumed; and another where a saturated CDM is used. Illustration of the different…

Responsive coaching at engage2learn is an innovative and evidence-based solution. This 2022-2023 study, paired with previous reports, compellingly validates the efficacy of the engage2learn program by exploring end-of-year STAAR test performance for Math and Science among Grades 6-8. LXD Research, an independent research firm, analyzed educator…

Teachers often struggle to implement inquiry-based science teaching. To support them, IndagApp--a 3D educational app that offers curriculum-aligned, inquiry-based lesson plans--was designed. The app is rooted in the inquiry phases recommended in best-practices literature, which arguably align with most international standards. This study describes…

Feedback literacy is an important graduate attribute that supports students' future work capacities. This study aimed to develop a framework through which discipline-specific feedback literacies, as a set of socially situated skills, can be developed within core curricula. The framework is developed through a content analysis of National…

Background: Most United States schools include school-based physical fitness testing (SB-PFT), yet little evidence shows how it is implemented, perceived, and used. Purpose: 1) Explore stakeholders' experiences with SB-PFT; 2) identify: challenges in analyzing fitness data, ways schools can use fitness data, and predictors of meeting fitness…

Presenting novel numbers about climate change to people after they estimate those numbers can shift their attitudes and scientific conceptions. Prior research suggests that such science learning can be supported by encouraging learners to make use of given benchmark information, however there are several other numerical estimation skills that may…

This study examines the effectiveness of problem-based learning with game theory versus thesis format in graduate project management degrees as the capstone course. The project management body of knowledge based on ISO was established as the rules of play with modifications to fit into the classroom context. We supplied a work breakdown structure…