One expected outcome of physics instruction is that students develop quantitative reasoning skills, including strategies for evaluating solutions to problems. Examples of well-known "canonical" evaluation strategies include special case analysis, unit analysis, and checking for reasonable numbers. We report on responses from three tasks…

The importance of mathematical problem solving (MPS) has been widely recognized. While there has been significant progress in developing and studying interventions to support teaching and learning MPS for students with disabilities, the research on how to accurately and effectively assess the impact of those interventions has lagged, leaving a gap…

Contribution: We present a framework for teachers to investigate the relationships between attributes of students' solutions in the process of problem solving or computational thinking. We provide visualization and evaluation techniques to find hidden patterns in the students' solutions which allow teachers to predict the specific behavior of…

The development of a set of rubrics for teachers and curriculum designers interested in the quality of numeracy tasks emerged from our struggle with an attempt to clarify the distinction between numeracy and mathematics. Shifting our perspective from asking what numeracy and mathematics are to asking what they are about led to the…

Determining the most appropriate method of scoring an assessment is based on multiple factors, including the intended use of results, the assessment's purpose, and time constraints. Both the dichotomous and partial credit models have their advantages, yet direct comparisons of assessment outcomes from each method are not typical with constructed…

With the ability to predict learning behaviors, artificial intelligence (AI) is increasingly involved in assessing the performance of problem solving. This study explored the potential of AI to predict whether mathematics problems could be solved based on eye movements and handwriting in a digital problem-solving environment. Sixty-one students…

Arithmetic fluency is regarded as a foundational math skill, typically measured as a single construct with pencil-and-paper-based timed assessments. We introduce a tablet-based assessment of single-digit fluency that captures individual trial response times across several embedded experimental contrasts of interest. A large (n = 824) cohort of…

Background: Cultivating students' problem-solving knowledge and skills in the workspace has been regarded as a primary goal in technical and vocational education. To this end, students are usually guided to complete the learning of workspace knowledge and skills by following the question, prompt, interaction and evaluation (QPIE) procedure.…

With the deepening of educational reform, classroom teaching constantly emphasizes the importance of context, and the simulated situational teaching method is gradually applied in the instructional design of activities. As an important part of the education and teaching process, evaluation which is the process of determining the changes in…

This study has three aims: (1) test the effectiveness of using an ebook based on the Collegiate Learning Assessment (CLA) Task to empower critical explanatory ability; (2) examine the influence of problem-solving style differences on critical explanatory ability; and (3) assess the interaction between the use of CLA Task-based Ebooks and…

This research aimed to develop and validate a rubric to assess Artificial Intelligence (AI) chatbots' effectiveness in accomplishing tasks, particularly within educational contexts. Given the rapidly growing integration of AI in various sectors, including education, a systematic and robust tool for evaluating AI chatbot performance is essential.…

In massive open online course (MOOC) environments, computer-based analysis of course reviews enables instructors and course designers to develop intervention strategies and improve instruction to support learners' learning. This study aimed to automatically and effectively identify learners' concerned topics within their written reviews. First, we…

This study examined how students utilized metacognition while solving physics problems. A case study design was implemented, involving 30 11th-grade students. Data were collected by using open-ended physics problems, with a think-aloud strategy applied during the process. Both quantitative and qualitative analyses were conducted using the…

Computation competence (CC) in simple addition and subtraction using non-counting (NC) strategies is an important learning objective in Grade 1 mathematics but many children, especially low achievers in mathematics, struggle to acquire these skills. To provide these students with the support they need, it is important to have valid and reliable…

Social problem solving (SPS) represents a social cognitive reasoning process that gives way to behavior when individuals are navigating challenging social situations. Autistic individuals have been shown to struggle with specific aspects of SPS, which, in turn, has been related to social difficulties in children. However, no previous work has…