This paper presents the findings of a study that intended to seek the content validity (CV) evidence of an instrument to measure the reading ability of university students in Sri Lanka. The reading passages and items were adapted from CEFR aligned Learning Resource Network (LRN) materials. The items were designed based on the cognitive processing…

Investigating the processes underlying test performance is a major source of data supporting the explanation inference in the validity argument (Chappelle, 2021). One way of modeling the cognitive processes underlying test performance is by constructing a Q-matrix, which is essentially about summarizing the attributes explaining test-takers'…

This study investigates test-takers' processing while completing banked gap-fill tasks, designed to test reading proficiency, in order to test theoretically based expectations about the variation in cognitive processes of test-takers across levels of performance. Twenty-eight test-takers' eye traces on 24 banked gap-fill items (on six tasks) were…

In this article, we highlight the need for a precisely defined construct in score-based validation and discuss the contribution of cognitive theories to accurately and comprehensively defining the construct. We propose a framework for integrating cognitively based theoretical and empirical evidence to specify and evaluate the construct. We apply…

Due to the lack of span test for the use in language-specific and cross-language studies, this study provides L1 and L2 researchers with a reliable language-independent span test (math span test) for the measurement of working memory capacity. It also describes the development, validation, and scoring method of this test. This test included 70…

Objective: The objective of this study is to develop and validate the Chinese Making Sense of Adversity Scale (CMSAS) to measure the cognitive coping strategies that Chinese people adopt to make sense of adversity. Method: A 12-item CMSAS was developed by in-depth interview and item analysis. The scale was validated with a sample of 627 Chinese…

The construct validity of reading comprehension test items was studied in a two-stage process. Five characteristics of task difficulty were defined and a heterogeneous set of 52 items were rated for these characteristics. Then correlations were obtained between ratings and item difficulty data. (CTM)

Procedural documentation is presented for administering, scoring and analyzing data gathered to examine the construct validity of a set of superitems developed to assess student levels of mathematical reasoning ability. Each superitem includes a mathematical situation and a structured set of questions about that situation. The questions were based…

This report is part of a general study of Reference Measures for Cognitive and Noncognitive Factors. The main activity being reported is the development of "factor-referenced" or "marker" tests for several recently identified cognitive factors. A secondary activity involves the study of possible relationships to factors already…

Grounded in a review of existing theories and research on problem solving, the theoretical base and new instrument development efforts discussed in this publication have been sounded against the needs of an innovative, interdisciplinary curriculum project called Unified Science and Mathematics for Elementary Schools (USMES). It is the work on new…

In Piaget's developmental psychology the fourth and highest stage of human cognitive development is that of formal operations. The research on formal thought instruments is outlined. This study was designed to construct and validate paper-and-pencil instruments which could be used to select students capable of abstract conceptualization,…

A model of verbal performance was developed which defined cognitive processes thought to underlie performance on the Word Knowledge and Paragraph Comprehension subtests of the Armed Services Vocational Aptitude Battery (ASVAB). The items from two forms of these ASVAB verbal subtests were rated on five conceptualized cognitive storage processes:…

This brief review explains some alternate scoring procedures to the classical method of summing correct responses. The novel procedures attempt in some way to retrieve and use even the information in the wrong responses. (Author)

The usefulness of studying thought processes in the construct validation of ability tests was examined using a sample consisting of 343 Canadian senior high school students. Four levels of probing were used by the interviewer to examine the students' thinking processes while taking the Test on Appraising Observations: (1) think aloud; (2)…

The purpose of this first phase of a continuing research program was the development of a test of creative problem solving in general design. A design class of 186 members was divided into an experimental and control group; a non-design control group (an educational psychology class) of 45 was also tested. Multivariate interpretation of creative…