This case study provides an account of my experiences and lessons learned in designing and implementing a survey research. The research was part of my doctoral thesis in educational measurement and quantitative methods. The purpose of the study was to examine the effectiveness of a Completely Structured Training compared with Partially Structured…

For more than four decades the National Assessment of Educational Progress (NAEP) has tracked the achievement of U.S. students in major academic subjects. This national resource is the only assessment that states and now many urban districts can look to as an objective yardstick of their performance over time, relative to national benchmarks, and…

A process for judging the alignment between curriculum standards and assessments developed by the author is presented. This process produces information on the relationship of standards and assessments on four alignment criteria: Categorical Concurrence, Depth of Knowledge Consistency, Range of Knowledge Correspondence, and Balance of…

An explanation of the misuse of statistical significance testing and the true meaning of "significance" is offered. Literature about the criticism of current practices of researchers and publications is reviewed in the context of tests of significance. The problem under consideration occurs when researchers attempt to do more than just establish…

This study examined the impact of rater agreement on decisions concerning the alignment between the "Golden State Examination in High School Mathematics" (California Department of Education, 2001a) and the University of California (UC) "Statement on Competencies in Mathematics Expected of Entering College Students" (Academic…

In 1979, Eric Hanushek pointed out a potential problem in estimating educational production functions, particularly at the precollege level. He observed that it is frequently inappropriate to include school-system variables in equations using the individual student as the unit of observation. This study offers limited evidence supporting this…

The organization of data at the National Assessment of Educational Progress (NAEP) is undergoing a significant transition from a system designed only for national assessment purposes to one designed both for assessment and a variety of academic research interests. The advent of NAEP public-use data files opens up many possibilities for those who…

An alternative method of identifying effective schools, based on the concept of effective schools as statistically atypical, was tested. This paper investigates the issue of consistency of the identification of what is termed "exceptional" schools. The following tests were administered to all first through fourth graders in 431 schools…

An examination of the technical and theoretical strengths and weaknesses of three British research studies on the effectiveness of selective and nonselective schooling shows that the reorganization of British schools has not produced the lowering of educational standards that politically motivated groups would like people to believe. (RM)

An analysis of three research studies which examined the movement towards comprehensive schooling in Great Britain shows that the answer to the question "has it worked" can be yes or no, depending on the selection of data and of statistical techniques. (RM)

Several issues related to the design and reporting of results from the National Assessment of Educational Progress (NAEP) are discussed in the context of current expectations for the NAEP and its origins. These issues include: (1) content coverage and format; (2) estimation procedures; and (3) reporting problems. (SLD)

The main purpose of this article is to generate a functional model of evaluation that EMSs can be able to empower online communications characterized by imperative decision making task. The evaluation process of EMSs must merge the multicultural strategies of the theory of Media Richness, and the ethical concerns of the critical approach. Media…

The main purpose of this article is to generate a functional model of evaluation that EMSs can be able to empower online communications characterized by imperative decision making task. The evaluation process of EMSs must merge the multicultural strategies of the theory of "Media Richness," and the ethical concerns of the critical approach. "Media…

The major finding of the Law-Related Education Evaluation Project report for Year 1 (1981), that law-related education courses can reduce juvenile delinquency, is of limited use to educational decision makers and could be misleading. The research design leaves much to be desired; however, that fact must be considered in light of the difficulty of…

To develop a perspective for assessing the effectiveness of developmental education, we must develop definitions, values, and criteria that permit consistency in analyzing students' learning needs and educational outcomes and in comparing research on developmental education. Research literature shows that a lack of consistent perspectives for…