Artificial intelligence (AI) has gained massive interest with the public release of the conversational AI "ChatGPT," but it also has become a matter of concern for academia as it can easily be misused. We performed a quantitative evaluation of the performance of ChatGPT on a medical physiology university examination. Forty-one answers…

Scientific practices are the skills used to develop scientific knowledge and are essential for careers in science. Despite calls from education and government agencies to cultivate scientific practices, there remains little evidence of how often students are asked to apply them in undergraduate courses. We analyzed exams from biology courses at…

This design case details the design process of a multiple-choice assessment of socio-scientific systems thinking. This assessment is situated within a larger project that aims to understand the ways students use multiple scientific models to understand complex socio-scientific issues. In addition to the research component, this project entails…

The loss of insect biodiversity is a major global sustainability issue that is highly relevant to science education. Science education can support and develop learners' competence to take actions to sustain insect biodiversity and empower learners to deal actively with this sustainability issue. However, we currently lack an instrument to assess…

This study focuses on creating a reliable and valid instrument to measure high school students' perceptions of academic challenge. The research is divided into four phases: qualitative analysis, item development, exploratory factor analysis (EFA), and validation. Initial data from college students' retrospective views and high school students'…

In this work, the authors document an expansion of the Public Speaking Competency Rubric (PSCR). First developed in 2012 by Schreiber, et al., the original rubric has only one item related to non-verbal communication. The authors of this work expanded the rubric to include 10 items related to the non-verbal aspects of public speaking and had it…

Knowledge is an important predictor and outcome of learning and development. Its measurement is challenged by the fact that knowledge can be integrated and homogeneous, or fragmented and heterogeneous, which can change through learning. These characteristics of knowledge are at odds with current standards for test development, demanding a high…

This paper describes the design and evaluation of the Organic chemistry Representational Competence Assessment (ORCA). Grounded in Kozma and Russell's representational competence framework, the ORCA measures the learner's ability to "interpret," "translate," and "use" six commonly used representations of molecular…

For more than 2 decades, Karin Hess has worked with the concept of depth of knowledge (DOK) and expanded applications of cognitive rigor across content areas and grade levels, proving that every student can experience deeper learning. This interactive book offers a self-guided journey beginning with the basics: what DOK is, what it is not, and…

While the field advocates for a diversified and comprehensive professional role (National Association of School Psychologists, 2020), school psychologists have long spent most of their time in assessment-related activities (Farmer et al., 2021), averaging about eight cognitive evaluations monthly (Benson et al., 2020). Assessment practices have…

The purposes of the current study were to 1) develop a learning burnout assessment for Thai undergraduate students and 2) examine the effects of a positive thinking training program on Thai undergraduate students' learning burnout. The study was divided into two parts: the instrumental development of the assessment tool and the implementation of…

In Part 1 of this series, the authors briefly reviewed some challenges inherent in using standardized tools with students who are not well represented in norming data. To help readers clearly conceptualize the framework steps, the authors present two case studies that showcase how a nonstandardized approach to assessment can be individualized to…

By design, randomized experiments (XPs) rule out bias from confounded selection of participants into conditions. Quasi-experiments (QEs) are often considered second-best because they do not share this benefit. However, when results from XPs are used to generalize causal impacts, the benefit from unconfounded selection into conditions may be offset…

Evaluating teacher AI competence levels and building effective, safe, and healthy learning environment are crucial steps in transitioning to AI-based education. Current established digital competence frameworks may indirectly address AI competence but often overlook the impact of AI on society, ethics, and assessment. Research on teacher AI…

Background/purpose: The purposes of this research are to develop a reliable and valid assessment tool for measuring systems thinking skills in upper primary students in Thailand and to establish a normative criterion for evaluating their systems thinking abilities based on educational standards. Materials/methods: The study followed a three-phase…