Generative artificial intelligence (GenAI) has profoundly reshaped how graduate students conceptualise, design and conduct academic research in higher education. While current metrics predominantly focus on technology acceptance and usage patterns, they often neglect the diverse cognitive engagements in graduate students' integration of GenAI…

Background: Schools are increasingly measuring school climate and social emotional learning, yet few measures conduct invariance testing by race, gender, or language despite known differences in perceptions of these constructs based on these identities. Objective: This study reports on the validation process of a school climate and social…

In Gargani and Strong (2014), we describe The Rapid Assessment of Teacher Effectiveness (RATE), a new teacher evaluation instrument. Our account of the validation research associated with RATE inspired a review by Good and Lavigne (2015). Here, we reply to the main points of their review. We elaborate on the validity, reliability, theoretical…

The growing importance of genomics and bioinformatics methods and paradigms in biology has been accompanied by an explosion of new curricula and pedagogies. An important question to ask about these educational innovations is whether they are having a meaningful impact on students' knowledge, attitudes, or skills. Although assessments are…

The Measure of Acceptance of the Theory of Evolution (MATE) was constructed to be a single-factor instrument that assesses an individual's overall acceptance of evolutionary theory. The MATE was validated and the scores resulting from the MATE were found to be reliable for the population of inservice high school biology teachers. However, many…

Standardizing aspects of assessments has long been recognized as a tactic to help make evaluations of examinees fair. It reduces variation in irrelevant aspects of testing procedures that could advantage some examinees and disadvantage others. However, recent attention to making assessment accessible to a more diverse population of students…

This guide is designed to help researchers make sure that their research reports include enough information about study measures so that readers can assess the quality of the study's methods and results. The guide also provides examples of write-ups about measures and suggests resources for learning more about these topics. The guide assumes…

Extended time is one of the most common testing accommodations provided to students with disabilities. It is also controversial; critics of extended time accommodations argue that extended time is used too readily, without concern for how it changes the skills measured by tests, leading to scores that cannot be compared fairly with those of other…

Research supports the connection between engagement, achievement, and school behavior across levels of economic and social advantage and disadvantage. Despite increasing interest and scientific findings, a number of interrelated conceptual and methodological issues must be addressed to advance this construct, particularly for designing…

The content and construct validity and reliability of the Revised Science Attitude Scale for Preservice Teachers as a scale for measuring the attitude of preservice elementary teachers toward the teaching of science were re-examined. The instrument is intended to measure four subcomponents: comfort-discomfort, need, time, and equipment. Data were…

The Pupil Control Ideology Form (PCI) is one of the major instruments used by researchers interested in the study of school climate. Pupil control is a central feature of the organizational life of schools, and each school appears to have a prevailing ideology of pupil control. The PCI is a self-report instrument used to measure an educator's…

With increasing reliance being placed on the results of their surveys, the National Center for Education Statistics (NCES) recognized a need for these survey results to be valid and reliable. As part of the work of the Statistical Analysis Group in Education (SAGE), an effort was undertaken to investigate validity and reliability in survey…

The development and validation of an instrument designated as the Classroom and School Community Inventory (CSCI) are described. Scores on both the classroom form and the school form of the CSCI possess strong content validity, construct validity, internal consistencies, and 2-week test-retest reliability. Using a sample of 341 traditional and…