This study is the National Board of Medical Examiners exploration of content-based techniques (standard-setting techniques in which pass/fail decisions are based upon the performance of examinees in relation to test content). Two content-based techniques (Angoff and Ebel) and three methods of evaluating examinee performance were studied. (MLW)

The cognitive structure of an algebra test was defined and validated using the linear logistic test model (LLTM) and quadratic assignment (QA). A 29-item test was administered to 235 ninth graders. Results suggest the benefits of applying both LLTM and QA to test construction and analysis. (SLD)

Discusses validity issues associated with three popular content-general reading college placement tests and then presents a theoretical argument to support an alternative placement procedure using content-specific testing. Proposes that content-specific tests would have improved content-related and construct-related validity. States that more…

Content analysis scales apply rigorous measurement to verbal communications and make possible the quantification of text in counseling research. The limitations of the Origin and Pawn Scales (M. T. Westbrook & L. L. Viney, 1980), the Positive Affect Scale (M. T. Westbrook, 1976), the Content Analysis Scales of Psychosocial Maturity (CASPM; L.…

The application of scientific tools to analyse the use of Internet-based e-learning tools in academic settings is in general an ignored area. E-learning tools are actually an emergent topic as a result of the new ideas introduced by the European Higher Education Area. Lifelong learning, or the promotion of student initiative, is the new paradigm…

The objectives of this study were: (1) to examine the psychometric properties of the Assessment of Life Habits (LIFE-H) for children; and (2) to draw a profile of the level of participation among children of 5 to 13 years of age with various impairments. The research team adapted the adult version of the LIFE-H in order to render it more…

The "Social-Communication Assessment Tool" (S-CAT) was created as a direct observation instrument to quantify specific social and communication deficits of children with autism spectrum disorders (ASD) within educational settings. In this pilot study, the instrument's content validity and interrater reliability were investigated to determine the…

While most organizations rely on cutting scores to screen job applicants, little research and few accepted methods exist to help practitioners identify cutting scores that will be job-related. This paper describes how the Work Keys system job analysis process was used to provide job-related, content-valid cutting scores. Using job analysis results…

A study involving 234 Texas college students was undertaken to develop and test the validity and reliability of an instrument designed to measure college students' attitudes toward alcohol. Special attention was given to the content and construct validity of the instrument. Subjects ranged in age from 18 to 24 years. The mapping sentence served as…

With increasing reliance being placed on the results of their surveys, the National Center for Education Statistics (NCES) recognized a need for these survey results to be valid and reliable. As part of the work of the Statistical Analysis Group in Education (SAGE), an effort was undertaken to investigate validity and reliability in survey…

Early National Teacher Examinations test-appraisal studies focused only on the extent to which the content covered on a test matched the content of teacher education curricula. Recently, there has been a shift in emphasis from adequacy-of-preparation, which is now seen by many as irrelevant to establishing the appropriateness of a teacher…

The development and tryout of an instrument designed to measure college students' attitudes toward alcohol demonstrate the utility of Guttman's facet analysis for developing and validating instruments. Findings from the survey, administered to 1,049 students, support the construct validity of the instrument. (SLD)

Testing and assessment in English-for-Academic-purposes (EAP) contexts has traditionally been carried out as a needs analysis of learners or a content analysis of courses. This article reassesses this approach to the development and validation of EAP tests on the basis of a theoretical model and recent research into content specificity. (VWL)

Evaluated distance students' ratings of the importance of strategies to facilitate self-directed learning in the National Open University, Taiwan. Topics include content validity; differences between current and inactive students, including motivation; institutional support services; orientation programs; instructional styles; course design; and…

This study was undertaken, in conjunction with other studies field-testing prototype tasks for a new TOEFL, to evaluate the content validity, perceived authenticity and educational appropriateness of these prototype tasks. We interviewed seven highly experienced instructors of English as a Second Language (ESL) at three universities, asking them…