Data extraction is a crucial, yet labor-intensive and error-prone part of evidence synthesis. To date, efforts to harness machine learning for enhancing efficiency of the data extraction process have fallen short of achieving sufficient accuracy and usability. With the release of large language models (LLMs), new possibilities have emerged to…

Response styles pose great threats to psychological measurements. This research compares IRTree models and anchoring vignettes in addressing response styles and estimating the target traits. It also explores the potential of combining them at the item level and total-score level (ratios of extreme and middle responses to vignettes). Four models…

In this ITEMS module, we provide a two-part introduction to the topic of reliability from the perspective of "classical test theory" (CTT). In the first part, which is directed primarily at beginning learners, we review and build on the content presented in the original didactic ITEMS article by Traub and Rowley (1991). Specifically, we…

This longitudinal study of 78 Canadian English-speaking students examined the applicability of the stability, cumulative, and compensatory models in reading comprehension development. Archival government-mandated assessments of reading comprehension at Grades 3, 6, and 10, and the Canadian Test of Basic Skills measure of reading comprehension…

This article discusses the role of assessment in a response-to-intervention model. Although assessment represents only 1 component in a response-to-intervention model, a well-articulated assessment system is critical in providing teachers with reliable data that are easily interpreted and used to make instructional decisions. Three components of…

Research indicates that many elementary students do not comprehend that the equal sign is an indication that an equality relation exists between two structures. Instead, they perceive the equal sign as an indication that a particular procedure is to be performed. As students mature, and as their exposure to the equal sign and equality relations in…

Community engagement professionals and partners serve as, work with, study, and build the capacity of boundary spanners. To augment knowledge about these functions, the Weerts-Sandmann Boundary Spanning Conceptual Framework (2010) has been operationalized through a survey instrument to examine community engagement boundary-spanning behaviors by…

The primary purpose of this study was to determine whether the data from the qualitative study fit Rasch model requirements for the definition of a measure, as well as to address concern in the extant literature regarding the appropriate number of items needed in analysis to assure unidimensionality. The self-report victimization scale was…

A study of 3,000 school counselors was undertaken to assess their beliefs about necessary components of a school counseling program. This study was part of the database that the American School Counselor Association used to develop "The ASCA National Model: A Framework for School Counseling Programs." The School Counseling Program Component Scale…

Results of a comparative study of F and Q tests, in a randomized block design with one replication per cell, are presented. In addition to these two procedures, a multivariate test was also considered. The model and test statistics, data generation and parameter selection, results, summary and conclusions are presented. Ten tables contain the…

Increased demands for colleges and universities to engage in outcomes assessment for accountability purposes have accelerated the need to bridge the gap between higher education practice and the fields of measurement, assessment, and evaluation. The "Handbook on Measurement, Assessment, and Evaluation in Higher Education" provides higher…

This paper describes the confirmatory factor analysis, validity, and reliability data collection stage of the development of a scale to measure mainstream teachers' self-efficacy beliefs for teaching ELL (English Language Learner) students. Data were collected from 708 K through 12 teachers and pre-service teachers with varying degrees of…

A Bayesian Model II approach to the estimation of proportions in m groups is extended to obtain posterior marginal distributions for the proportions. The approach is extended to allow greater use of prior information than previously and the specification of this prior information is discussed. (Author/RC)

Describes development of the Kirton Adaption Innovation Inventory (KAI) for rating respondents on a continuum of adaptiveness-innovativeness, discusses tests of the validity and utility of the KAI model, and evaluates the KAI model's characteristics. For availability see EA 507 670. (Author/JG)

This paper tests a central implication of the theory of equalizing differences, that workers sort into jobs with different attributes based on their preferences. We present evidence from four new time-use data sets for the United States and France suggesting that workers who are more gregarious, as revealed by their behavior when they are not…