This research aimed to develop and validate a rubric to assess Artificial Intelligence (AI) chatbots' effectiveness in accomplishing tasks, particularly within educational contexts. Given the rapidly growing integration of AI in various sectors, including education, a systematic and robust tool for evaluating AI chatbot performance is essential.…

Background: Several inventories have been developed to assess social problem-solving. However, these instruments originally developed for adult or adolescence and do not capture the full range of main interpersonal relationships over which elementary students resolve daily life interpersonal problems and apply elementary-age typical responses.…

The development of knowledge assessment instrument based on problem solving in the electrochemistry. This research aimed to find out the characteristics, teacher responses, and student responses to the problem-based knowledge assessment instrument on the electrochemistry material. The research method used is research and development which consists…

In a world of burgeoning societal issues, future scientists must be equipped to work interdisciplinarily to address real-world problems. To train undergraduate students toward this end, practitioners must also have quality assessment tools to measure students' ability to think within an interdisciplinary system. There is, however, a dearth of…

Computational thinking is a way of thinking that covers 21st century skills and includes new generation concepts such as robotics, coding, informatics and information construction. Computational thinking has reached an important point especially in the field of science in line with the rapid developments in technology. Robotics applications,…

The Inclusive Assessment of Computational Thinking (CT) designed for accessibility and learner variability was studied in over 50 classes in US schools (grades 3-8). The validation studies of IACT sampled thousands of students to establish IACT's construct and concurrent validity as well as test-retest reliability. IACT items for each CT practice…

The aim of the study was describing the development and validation of students' perception on learning by questioning (LBQ) scale in physics. Research and Development (R & D) design was utilized in the research method. The number of senior high school students involved in the research were 224 students, composed of 95 boys (42.41%) and 129…

This study aims to develop a multidimensional 21st century skills scale for adolescent and early adulthood students in the 15-25 age group. The research was conducted with 660 high school, associate degree and undergraduate students. From the item pool created during the first stage of the study, 146 items were selected in line with expert…

The purpose of this study is to develop and validate an 18-item Problem-based Learning Process Inventory (PBLPI) for learning in this 21st century. Preservice teachers at the National Institute of Education (NIE) doing Educational Psychology are exposed to a Problem-Based Learning (PBL) environment. Findings from Exploratory Factor Analysis of…

The following report describes an assessment instrument called the Mathematics Performance and Cognition (MPAC) interview. The MPAC interview was designed to measure two outcomes of interest. It was designed to measure first and second graders' mathematics achievement in number, operations, and equality, and it was also designed to gather…

This report provides an overview of the development, implementation, and psychometric properties of a student mathematics interview designed to assess first- and second-grade student achievement and thinking processes. The student interview was conducted with 622 first- or second-grade students in 22 schools located in two public school districts…

This article addresses two unsolved measurement issues in dynamic problem solving (DPS) research: (a) unsystematic construction of DPS tests making a comparison of results obtained in different studies difficult and (b) use of time-intensive single tasks leading to severe reliability problems. To solve these issues, the MicroDYN approach is…

Problem solving is a key component of weight loss programs. The Social Problem Solving Inventory-Revised (SPSI-R) has not been evaluated in weight loss studies. The purpose of this study was to evaluate the psychometrics of the SPSI-R. Cronbach's a (0.95 for total score; 0.67-0.92 for subscales) confirmed internal consistency reliability. The…

The validation of key contextual features of algebra word problems was studied in two phases. In the first phase, five experts were asked to assess the appropriateness of the concepts in the problems and the adequacy of the assignment of the contextual features to the problems. In the second phase, construct validity was established by having 6…

Preliminary psychometric data assessing the reliability and validity of a method used to measure the diagnostic reasoning and problem-solving skills of predoctoral students in orthodontia are described. The measurement approach consisted of sets of patient demographic data and dental photos and x-rays, accompanied by a set of 33 multiple-choice…