When evaluating student learning, educators often employ scoring rubrics, for which quality can be determined through evaluating validity and reliability. This article discusses the norming process utilized in a graduate organizational leadership program for a capstone scoring rubric. Concepts of validity and reliability are discussed, as is the…

We evaluated the validity of using the GRE General Test to assist with graduate school admissions for individuals with disabilities. We studied a sample of 16,239 graduate students from 10 U.S. research universities in three groups: students without any reported disabilities, students who reported disabilities and took the computer-delivered GRE…

In considering whether to retain the GRE in graduate school admissions, admissions committees often pursue two objectives: (a) performance in graduate school (e.g., admitting individuals who will perform better in classes and research), and (b) diversity/fairness (e.g., equal selection rates between demographic groups). Drawing upon HR research…

Essay writing is a common type of constructed-response task used frequently in standardized writing assessments. However, the impromptu timed nature of the essay writing tests has drawn increasing criticism for the lack of authenticity for real-world writing in classroom and workplace settings. The goal of this paper is to contribute evidence to a…

The purpose of this research was to determine if the GMAT actually mattered for MBA student performance. A waiver option was recently instituted in our MBA program based on GPA and/or professional experience, providing the ability to compare group differences (GMAT vs non-GMAT students) on several relevant outcome variables, including: (1)…

This study aims to evaluate the individual scales that comprise the School Psychology Cultural Competency Training Scale (SPCCTS), to examine school psychologists' perceptions of the quality of training they received with regard to providing culturally competent services. Individual scales were created so that critical domains of professional…

Educational Testing Service (ETS), working with 21 U.S. law schools, evaluated the predictive validity of the GRE® General Test using a sample of 1,587 current and graduated law students. Results indicated that the GRE is a strong, generalizably valid predictor of first-year law school grades and that it provides useful information even when…

We conducted two studies to replicate and extend, as well as test, the limits of previous findings regarding an apparent disconnect between scientific-reasoning skills in psychological science, on the one hand, and scores on standardized tests of general intelligence, on the other. In Study 1, we examined whether this disconnect would extend…

Graduate admission has become a critical process in tertiary education, whereby selecting valid admissions instruments is key. This study assessed the validity of Graduate Record Examination (GRE) General Test scores for admission to Master's programmes at a technical university in Europe. We investigated the indicative value of GRE scores for the…

This survey study investigated how graduate school admissions committees perceive and use the "GRE"® General Test and "GRE"® Subject Tests after the launch of the "GRE"® revised General Test in August 2011. These perceptions and uses impact the validity of the tests. Prior research about the perceptions and uses of…

The report is the first systematic evaluation of the sentence equivalence item type introduced by the "GRE"® revised General Test. We adopt a validity framework to guide our investigation based on Kane's approach to validation whereby a hierarchy of inferences that should be documented to support score meaning and interpretation is…

Multitiered frameworks of service delivery have traditionally underserved students with mental health needs. Whereas research has supported the assessment and intervention of social and academic behavior across tiers, evidence is limited with regard to mental health concerns including internalizing behaviors (e.g., anxiety and depression). In…

In order to remain relevant and useful, testing programs must periodically update their tests to match shifts in student populations and school curricula. One might think that because the publishers are offering a product, the responsibility for updates rests entirely on them. Publishers conduct studies to assure new content is appropriate. But…

Scores from the "GRE"® revised General Test provide important information regarding the verbal and quantitative reasoning abilities and analytical writing skills of applicants to graduate programs. The validity and utility of these scores depend upon the degree to which the scores predict success in graduate and business school in…

Special preparation for tests has been a relatively contentious issue. The controversy has entailed (a) disagreement over the effectiveness of such preparation, (b) concern over unequal access to it, and (c) worries about its impact on the validity of test scores. This paper provides a brief history of ETS's involvement with, and contribution to,…