This research aimed to develop and validate a rubric to assess Artificial Intelligence (AI) chatbots' effectiveness in accomplishing tasks, particularly within educational contexts. Given the rapidly growing integration of AI in various sectors, including education, a systematic and robust tool for evaluating AI chatbot performance is essential.…

Background: Several inventories have been developed to assess social problem-solving. However, these instruments originally developed for adult or adolescence and do not capture the full range of main interpersonal relationships over which elementary students resolve daily life interpersonal problems and apply elementary-age typical responses.…

The Inventory of Emotions Experienced by Adolescents when Solving Mathematical Tasks (INETAM, for its acronym in Spanish), measures four influential emotions related to Math performance: Enthusiasm, Frustration, Enjoyment, and Boredom. Content validity, construct validation and item calibration analyses were performed to obtain evidence of its…

The development of knowledge assessment instrument based on problem solving in the electrochemistry. This research aimed to find out the characteristics, teacher responses, and student responses to the problem-based knowledge assessment instrument on the electrochemistry material. The research method used is research and development which consists…

We describe the use of think alouds to examine substantive processes involved in performance on a formative assessment of computational thinking (CT) designed to support self-regulated learning (SRL). Our task design model included three phases of work on a computational thinking problem: forethought, performance, and reflection. The cognitive…

Computational thinking is a way of thinking that covers 21st century skills and includes new generation concepts such as robotics, coding, informatics and information construction. Computational thinking has reached an important point especially in the field of science in line with the rapid developments in technology. Robotics applications,…

The aim of the study was describing the development and validation of students' perception on learning by questioning (LBQ) scale in physics. Research and Development (R & D) design was utilized in the research method. The number of senior high school students involved in the research were 224 students, composed of 95 boys (42.41%) and 129…

This study aims to develop a multidimensional 21st century skills scale for adolescent and early adulthood students in the 15-25 age group. The research was conducted with 660 high school, associate degree and undergraduate students. From the item pool created during the first stage of the study, 146 items were selected in line with expert…

Background: The shortage of skilled workers choosing STEM (Science, Technology, Engineering, and Math) careers in the USA and worldwide has fueled a movement towards STEAM, in which the "A" addresses the arts and humanities. STEAM education has been proposed as a way to offer relevant problems to solve while drawing on creative and…

The purpose of this study is to develop and validate an 18-item Problem-based Learning Process Inventory (PBLPI) for learning in this 21st century. Preservice teachers at the National Institute of Education (NIE) doing Educational Psychology are exposed to a Problem-Based Learning (PBL) environment. Findings from Exploratory Factor Analysis of…

Assessing complex constructs such as those discussed under the umbrella of 21st century constructs highlights the need for a principled assessment design and validation approach. In our discussion, we made a case for three considerations: (a) taking construct complexity into account across various stages of assessment development such as the…

The Physics Metacognition Inventory was developed to measure physics students' metacognition for problem solving. In one of our earlier studies, an exploratory factor analysis provided evidence of preliminary construct validity, revealing six components of students' metacognition when solving physics problems including knowledge of cognition,…

Background: Complex problem-solving competence is regarded as a key construct in science education. But due to the necessity of using interactive and intransparent assessment procedures, appropriate measures of the construct are rare. This paper consequently presents the development and validation of a computer-based problem-solving environment,…

The following report describes an assessment instrument called the Mathematics Performance and Cognition (MPAC) interview. The MPAC interview was designed to measure two outcomes of interest. It was designed to measure first and second graders' mathematics achievement in number, operations, and equality, and it was also designed to gather…

This report provides an overview of the development, implementation, and psychometric properties of a student mathematics interview designed to assess first- and second-grade student achievement and thinking processes. The student interview was conducted with 622 first- or second-grade students in 22 schools located in two public school districts…