Despite substantial evidence for the link between an individual's intelligence and successful life outcomes, questions about what defines intelligence have remained the focus of heated dispute. The most common approach to understanding intelligence has been to investigate what performance on tests of intellect is and is not associated with. This…

Reasoning for complexity is a fundamental competency in these complex times for solutions to social problems and decision-making. The purpose of this paper is to demonstrate the validity and reliability of the eComplexity instrument by presenting its psychometric properties. The instrument consists of a Likert-type scale questionnaire designed to…

The current study investigated how item formats and their inherent affordances influence test-takers' cognition under uncertainty. Adult participants solved content-equivalent math items in multiple-selection multiple-choice and four alternative grid formats. The results indicated that participants' affirmative response tendency (i.e., judge the…

The following report describes an assessment instrument called the Mathematics Performance and Cognition (MPAC) interview. The MPAC interview was designed to measure two outcomes of interest. It was designed to measure first and second graders' mathematics achievement in number, operations, and equality, and it was also designed to gather…

This report provides an overview of the development, implementation, and psychometric properties of a student mathematics interview designed to assess first- and second-grade student achievement and thinking processes. The student interview was conducted with 622 first- or second-grade students in 22 schools located in two public school districts…

Using multitrait, multimethod data, and confirmatory factor analysis, the current study examined the effects of arithmetic item formatting and the possibility that across formats, abilities other than arithmetic may contribute to children's answers. Measurement hypotheses were guided by several leading theories of arithmetic cognition. With a…

The study challenged the current practices in cognitive load measurement involving complex problem solving by manipulating the presence of pictures in multiple rule-based problem-solving situations and examining the cognitive load resulting from both off-line and online measures associated with complex problem solving. Forty-eight participants…

Current assessment practices in the United States are not able to accurately capture the total linguistic, cognitive, and achievement abilities of bilingual learners. There are psychometric complexities involved when assessing and interpreting test results of bilingual students, which impact the validity of this practice. Further, the compromise…

fMRI was used to examine the differential effect of two problem-solving strategies. Participants were trained to use both a pictorial/spatial and a symbolic/algebraic strategy to solve word problems. While these two strategies activated similar cortical regions, a number of differences were noted in the level of activation. These differences…

Just as objectivist theories have provided foundations for traditional tests, constructivist theories can offer foundations for performance assessment design and development methods. The tenets and principles embedded in various learning theories provide a solid foundation that can be combined with psychometric principles to help assessment…

The problem of valid measurement of psychological constructs remains an impediment to scientific progress, and the measurement of executive functions is not an exception. This study examined the statistical and theoretical derivation of a behavioral screener for the estimation of executive functions in children from the well-established Behavior…

The factor structure of several self-report questionnaires assessing depression-relevant cognitions frequently employed in clinical research was examined in a sample of 390 adolescents (M age = 14.54; 216 girls; 74% Caucasian) with current major depressive disorder enrolled in the Treatment of Adolescents with Depression Study. A four-factor…

The purpose of the study is to present research focused on validating the four algebra cognitive models in Gierl, Wang, et al., using student response data collected with protocol analysis methods to evaluate the knowledge structures and processing skills used by a sample of SAT test takers.

QUESTION-STUDY AS A METHOD FOR INTERPRETING AND MEASURING PROBLEM-SOLVING BEHAVIOR WAS STUDIED. DATA WERE OBTAINED FROM A PREVIOUS STUDY (ED 003 005) AND ANALYZED. ANALYSES WERE PERFORMED TO DETERMINE WHETHER QUESTIONS WERE MORE USEFUL FOR ASSESSING PROBLEM-SOLVING BEHAVIOR THAN ANALYSIS OF SOLUTIONS. TECHNIQUES, FORMULAE, AND RESULTS PERTINENT TO…

We propose that researchers should utilize ratio scores when examining the response styles theory rather than examine each of the response styles separately. Higher ratio scores indicate a higher probability of engaging in ruminative, as opposed to distracting and problem solving, behaviors. In Phase One, we examined the factor structure and…