The current study aimed to measure preservice teachers' skills in implementing pedagogical model of collaborative problem solving (CPS) using a more advanced and novel human-to-agent computerized assessment instrument. By doing so, a framework with three major skills in the implementation of CPS and four major individual problem-solving processes…

Assessing complex constructs such as those discussed under the umbrella of 21st century constructs highlights the need for a principled assessment design and validation approach. In our discussion, we made a case for three considerations: (a) taking construct complexity into account across various stages of assessment development such as the…

Background: There is a need for validated, standardised tools for the assessment of executive functions in adults with intellectual disabilities (ID). This study examines the validity of a test of planning and problem solving (Tower of London) with adults with ID. Method: Participants completed an adapted version of the Tower of London (ToL) while…

The problem of valid measurement of psychological constructs remains an impediment to scientific progress, and the measurement of executive functions is not an exception. This study examined the statistical and theoretical derivation of a behavioral screener for the estimation of executive functions in children from the well-established Behavior…

Examines the components required to assess student problem solving in technology environments. Discusses the purposes of testing, provides an example demonstrating the difference between retention and transfer, defines and analyzes problem solving, and explores techniques and standards for measuring the quality of student understanding. Contains…

This study found that the restructured National Board Dental Examination Part II is a reliable test assessing a full range of cognitive behaviors, and a unidimensional test of comprehensive general dentistry, suggesting better testing of knowledge and problem-solving skills than on the traditional examination. Performance on the pilot and…

The Test of Problem Solving (TOPS) was evaluated by 20 speech-language clinicians based on designer claims that the test assesses integration of semantic, linguistic, and reasoning ability and taps skills needed for academic and social acceptance. Results challenged the content validity of the test. (Author/DB)

Discusses applications of the Problem Solving Inventory for counseling and managed health care, career and industrial/organizational issues, training, and academic performance. Examines the role of problem solving in psychological health and describes the inventory, how to administer it, and previous research findings. (RJM)

Tests to assess problem-solving ability being provided for the Air Force are described, and some details on the development and validation of these computer-administered diagnostic achievement tests are discussed. Three measurement approaches were employed: (1) sequential problem solving; (2) context-free assessment of fundamental skills and…

Consistent with its mission of synthesizing available information on performance assessment in a variety of skill areas, the Clearinghouse for Applied Performance Assessment has prepared this summary of the role of performance assessment in selected published tests of problem-solving skill. Performance assessment is defined in terms of assessment…

This report describes a methodology for increasing the validity and reliability of inferences made about the problem-solving ability of science students that is based on performance on different kinds of tests. The generalizable cognitive components of problem solving that might be targeted by assessment are described, and specifications are…

This paper describes the testing and refinement of an instrument for identifying and measuring Problem Formulation and Resolution (PFR) in online asynchronous discussions (OADs). The instrument was used to analyse a transcript of an OAD designed specifically for PFR with 30 participants in an undergraduate course for teachers in training. Results…

Motivating students to perform well on assessment tests is difficult when students know the results have no academic consequence. The present study evaluates the influence of assessment context (graded vs. non-graded) on the reliability of an assessment measure. Results indicate the graded condition produces higher reliability (r = 0.71) than the…

Empathy has been suggested to facilitate effective collaborative problem solving in children. The current study adapted the Interpersonal Reactivity Index (IRI, Davis, 1980), a well-validated empathy measure for adults, for use with children aged 8 and 9 years. Four hundred and thirteen school children aged between 7;11 and 9;11 years completed…

The study developed a Big 6 Information Problem-Solving Scale (B61PS), including the subscales of task definition and information-seeking strategies, information access and synthesis, and evaluation. More than 1,500 fifth and sixth graders in Taiwan responded. The study revealed that the scale showed adequate reliability in assessing the…