This paper is the third in a series of Analytical Insights papers, which provide accessible, up-to-date analysis of educational datasets. The insights in this paper are drawn from the latest National Assessment Program Literacy and Numeracy (NAPLAN) and Longitudinal Literacy and Numeracy in Australia (LLANIA) data to discuss student participation…

One major issue with large-scale assessments is that the respondents might give no responses to many items, resulting in less accurate estimations of both assessed abilities and item parameters. This report studies how the types of items affect the item-level nonresponse rates and how different methods of treating item-level nonresponses have an…

This paper is the first in a series of Analytical Insights papers, which provide accessible, up-to-date analysis of educational datasets. This insights paper draws on the latest National Assessment Program Literacy and Numeracy (NAPLAN) data to discuss student participation and engagement with the tests -- factors which impact the quality and…

There is strong theoretical support for oral reading fluency (ORF) as an essential building block of reading proficiency. The current and standard ORF assessment procedure requires that students read aloud a grade-level passage (˜ 250 words) in a one-to-one administration, with the number of words read correctly in 60 seconds constituting their…

The overall purpose of the research studies described in this report was to investigate the quality of the administration of the Partnership for Assessment of Readiness for College and Careers (PARCC) assessment during its first operational year (2014-2015). Findings from these studies can be used to identify threats to the validity of PARCC test…

At the heart of the No Child Left Behind Act (NCLB) is the call for all students to be "proficient" in reading and mathematics by 2014. Yet the law expects each state to define proficiency as it sees fit and design its own tests. This study investigated three research questions related to this policy: (1) How consistent are various…

Two aspects of criterion referenced testing are discussed: cutting scores and test length. Several practices in determining passing scores are enumerated: (1) setting passing scores so that a predetermined percent of students pass; (2) inspecting each test item to determine how important it is that it be answered correctly; (3) determining the…

The statewide student assessment programs of the 15 member states of the Southern Regional Education Board (SREB) in the 1987-88 school year are described. Individual summaries of the testing programs provide information on the types of tests used in the SREB states--Alabama, Arkansas, Florida, Georgia, Kentucky, Louisiana, Maryland, Mississippi,…

This document is a study of standardized tests by sub-group, ranking the states according to scores divided (in turn) by gender, race and ethnicity, location of school, family income, parental education, teacher qualification and experience, limited English proficiency, special education participation rate, and per-pupil spending. The tests…

The research leading to the decisions to revise the Graduate Record Examination Aptitude Test (GRE) (beginning in October 1981) is reviewed. The issues discussed include the format of the test (the timing of each section and the number of sections, the content of the sections--especially the analytical section), the scoring procedure for the GRE,…

Research and analysis conducted to determine the effects of reducing the administration time for one or more levels of the Basic Occupational Literacy Test (BOLT) are described. The total usable sample consisted of 2,423 subjects. Data were collected from 23 states from 1978 to 1981. Data came from a variety of sources, including schools and…

Some problems associated with the criteria of reproducibility and scalability as they are used in Guttman scalogram analysis to evaluate cumulative, nonparametric scales of dichotomous items are discussed. A computer program is presented which analyzes response patterns elicited by dichotomous scales designed to be cumulative. (Author/DWH)

Examines the question of whether cultural and ethnic groups differ in their extreme response style. Studies questionnaire responses of Hispanic and non-Hispanic male Navy recruits and suggests that differences in extreme response style may be attributable to differences in judgment style across the two cultural groups. (MW)

In spring 1986, new citywide testing programs in both reading and mathematics were implemented by the New York City Board of Education. In those cases where the test had changed, it was necessary to statistically equate the new tests to the old tests, so that comparisons of equated rather than actual scores could be made during the transitional…

This exploration of gender and test fairness first considers ways in which women and men sometimes differ in test performance, and then examines some of the aspects of why they differ, focusing on aspects that have implications for the design of fair tests. The first chapter introduces the context of the topic, the nature of test fairness, and the…