Online metacognitive skills are the real-time awareness of cognition, which can effectively promote science learning and improve performance in solving scientific problems. Therefore, it is important to enhance and diagnose students' online metacognitive skills in science education. This study aimed to evaluate ninth-grade students' online…

Response process validity evidence provides a window into a respondent's cognitive processing. The purpose of this study is to describe a new data collection tool called a whole-class think aloud (WCTA). This work is performed as part of test development for a series of problem-solving measures to be used in elementary and middle grades. Data from…

Reasoning for complexity is a fundamental competency in these complex times for solutions to social problems and decision-making. The purpose of this paper is to demonstrate the validity and reliability of the eComplexity instrument by presenting its psychometric properties. The instrument consists of a Likert-type scale questionnaire designed to…

Currently, there is significant interest being directed towards the development of STEM education to meet economic and societal demands. While economic concerns can be a powerful driving force in advancing the STEM agenda, care must be taken that such economic imperative does not promote research approaches that overemphasize pragmatic application…

The Physics Metacognition Inventory was developed to measure physics students' metacognition for problem solving. In one of our earlier studies, an exploratory factor analysis provided evidence of preliminary construct validity, revealing six components of students' metacognition when solving physics problems including knowledge of cognition,…

Multiple-choice questions are an important part of large-scale summative assessments, such as the advanced placement (AP) chemistry exam. However, past AP chemistry exam items often lacked the ability to test conceptual understanding and higher-order cognitive skills. The redesigned AP chemistry exam shows a distinctive shift in item types toward…

The following report describes an assessment instrument called the Mathematics Performance and Cognition (MPAC) interview. The MPAC interview was designed to measure two outcomes of interest. It was designed to measure first and second graders' mathematics achievement in number, operations, and equality, and it was also designed to gather…

This report provides an overview of the development, implementation, and psychometric properties of a student mathematics interview designed to assess first- and second-grade student achievement and thinking processes. The student interview was conducted with 622 first- or second-grade students in 22 schools located in two public school districts…

The aim of this study was to create an instrument to measure elementary teachers' interest in teaching chemistry. The interest in chemistry teaching instrument (ICTI) was created to measure both the affective and cognitive components of interest. After establishing the face and content validity of the instrument, the internal consistency of the…

Current assessment practices in the United States are not able to accurately capture the total linguistic, cognitive, and achievement abilities of bilingual learners. There are psychometric complexities involved when assessing and interpreting test results of bilingual students, which impact the validity of this practice. Further, the compromise…

The problem of valid measurement of psychological constructs remains an impediment to scientific progress, and the measurement of executive functions is not an exception. This study examined the statistical and theoretical derivation of a behavioral screener for the estimation of executive functions in children from the well-established Behavior…

Teaching students test wiseness can have a number of positive results, including improving the validity of the tests themselves and improving the scores of minority students on tests. (AEA)

Ss were administered Thinking Creatively in Action and Movement (TCAM), traditional Piagetian measures of conservation of number and mass, modification Piagetian tasks, and the Sequential Assessment Mathematics Inventory. Among findings was that creative thinking ability, as assessed by the TCAM, significantly predicts cognitive performances that…

The Observation Procedure for Technology Education Mental Processes, a computerized assessment tool, was based on duration and frequency of mental processes needed for problem solving. Videotapes of students completing problem-solving activities were used to identify the processes. Interrater reliability tests validated the program. (SK)

This monograph describes the development of the Metaphoric Triads Task (MTT), an instrument designed to assess metaphoric comprehension. Validity and reliability of the instrument are discussed and data for 12 samples of subjects are reported. Sex differences were negligible, but progressive improvement in MTT score with age was noted. Pictorial…