Some of the challenges that test publishers face in constructing educational assessments that meet high technical quality as prescribed in the "Standards for Educational and Psychological Testing" (AERA, APA, NCME, 1999) are examined. Federal educational initiatives are used to illustrate demands on technical quality that challenge the efforts of…

Several different methodological approaches that have been used in studying language in children with autism are outlined. In classic studies, children with autism are compared to comparison groups typically matched on age, IQ, or mental age in order to identify which aspects of language are uniquely impaired in autism. Several methodological…

Is reflexivity the condition of taking account of the personality and presence of the researcher within the investigation? Some argue that it is and it is necessary because self-examination is commonplace in society today. Improving and building are common goals, and within education we are committed to questioning in order to examine, build, and…

Little is known about effective eHealth recruitment methods. This paper presents recruitment challenges associated with enrolling African-American girls aged 8-10 years in an eHealth obesity prevention program, their effect on the recruitment plan, and potential implications for eHealth research. Although the initial recruitment strategy was…

The present study investigated the phenomenon of sudden gains in 107 participants with social phobia (social anxiety disorder) who received either cognitive-behavioral group therapy or exposure group therapy without explicit cognitive interventions, which primarily used public speaking situations as exposure tasks. Twenty-two out of 967…

Does the name of the special interest group, "The Experimental Analysis of Human Behavior," imply that those who analyze the behavior of human animals must organize themselves apart from those who analyze the behavior of nonhuman animals? Is the use of nonhumans in experiments really not relevant to the analysis of the behavior of humans? If so,…

This article examines the effectiveness of incentives in improving survey response rates of school counselors and compares the findings with those of previously researched populations. A $1 cash incentive increased response rates for a one-wave mailing of a questionnaire, while a raffle opportunity did not. The number and length of optional…

Among the varied analytical challenges institutional researchers face, examining faculty pay may be one of the most vexing. Although the literature on faculty compensation analysis dates back to the 1970s (Loeb and Ferber, 1971; Gordon, Morton, and Braden, 1974; Scott, 1977; Braskamp and Johnson, 1978; McLaughlin, Smart, and Montgomery, 1978),…

This paper discusses 10 reasons why outdoor education research needs more and better methods and measures. These reasons encompass the following areas of discussion: (1) the researcher's theories and values influence the research methods and measures chosen; (2) measurement must be relevant to the phenomenon measured, and multilevel phenomena may…

Educational assessment concerns inference about students' knowledge, skills, and accomplishments. Because data are never so comprehensive and unequivocal as to ensure certitude, test theory evolved in part to address questions of weight, coverage, and import of data. The resulting concepts and techniques can be viewed as applications of more…

By focusing on "appropriateness" and "adequacy" of inference and action, unified validity may be misused in rejecting valid test outcomes. The notion of levels of validity is challenged, the necessity of assumption is argued, and experience is proposed as the basis of validity. "Consequential validity" is interpreted as an optional predictive…

Fred N. Kerlinger has been hailed as having contributed to the transformation of the way that behavioral scientists and educators read research reports, design and execute research, and draw conclusions about research. In 1960 he introduced the notion that educational research is fraught with mythology. Three of the research myths that he…

Robert L. Stevenson recently described the problems facing international communications researchers: the field has no common focal variable, no common method, and no common literature--despite this, he professed pleasure at the state of the field. This paper takes Stevenson as a starting point to analyze international communications through a case…

This paper described an interdisciplinary course on the interaction between prejudice and the conduct of science. Scientists often possess the same prejudices as others in their culture. Students learn how subtle prejudice can affect the processes of science. This course examines major scientific endeavors that have been influenced by the…

Three criticisms of overreliance on results from statistical significance tests are noted. It is suggested that: (1) statistical significance tests are often tautological; (2) some uses can involve comparisons that are not completely sensible; and (3) using statistical significance tests to evaluate both methodological assumptions (e.g., the…