This bulletin addresses all concerned with examinations for the Certificate of Secondary Education, particularly teachers, with suggestions to improve the efficiency and fairness of examining. The bulletin is divided into two parts: Part I - Examining Techniques: General Principles, covers such major subjects as objectives of the course, analysing…

Analyses preparatory to construction of a suitable file for generating a system of future performance trend indicators are described. Such a system falls into the category of a current value approach to human resources accounting. It requires that there be a substantial body of data which: (1) uses the work group or unit, not the individual, as…

A multi-faceted Rasch measurement (MFRM) approach was used to analyze clinical performance ratings of 24 first-year residents in one surgery residency program in Thailand to investigate three types of rater effects: leniency, rater inconsistency, and restriction of range. Faculty from 14 surgical services rated the clinical performance of…

A multi-faceted Rasch measurement (MFRM) model was used to analyze a clinical skills assessment of 173 fourth-year medical students in a Midwestern medical school to investigate four types of rater errors: leniency, inconsistency, halo, and restriction of range. Each student performed six clinical tasks with six standardized patients (SPs), who…

Normative data for the Wechsler Memory Scale-Revised were derived empirically using a sample of 50 volunteers between 25 and 34 years of age, who matched U.S. Census data on demographic characteristics. Differences between these empirical norms and published norms that were estimated statistically appear clinically significant. (SLD)

Administers an experimental college version of the Musical Aptitude Profile (CMAP) and 2 motivation measures to 187 nonmusic majors in a music appreciation course. Eliminates CMAP results from analysis resulting from low reliability. Includes data table that were significantly related. (NL)

Investigated reliability of the Family Narrative Consortium (FNC) scales for measuring the effect of social context on construction of family narratives. Analyzed data from four FNC studies to determine reliability of scale dimensions of narrative coherence, narrative interaction, and relationship beliefs. Found that the scale was a set of…

Researchers sometimes need a statistical test of the hypothesis that two values of Cronbach's alpha reliability coefficient are equal. The situation may involve scores from two different measures administered to independent random samples or from the same measure administered to random samples from two different populations. Feldt derived a test…

Cudeck and Browne (1983) proposed using cross-validation as a model selection technique in structural equation modeling. The purpose of this study is to examine the performance of eight cross-validation indices under conditions not yet examined in the relevant literature, such as nonnormality and cross-validation design. The performance of each…

We examined underlying mechanisms for comprehension differences across expository and narrative text while controlling for factors confounded in the extant literature. Fourth grade students (n=32) read both an expository and a narrative text, and completed both a local comprehension assessment, and a global retelling assessment for each text.…

The purpose of this study was to collect reliability and validity data on the School Characteristics Inventory (SCI), a quantitative measure based on Sternberg's (2000) theory of contextual modifiability. Data were collected from a national sample of middle school teachers and from teachers participating in a 3-year study investigating teachers'…

This paper represents Part I of a two-part study examining preservice teachers' development of a personalized, research-based Science Teaching Rationale (STR). Researchers have historically documented the application of the "rationale paper" (Clough, 1992; Veronesi, 1998) using qualitative methodologies. Since the rationale paper continues to…

This paper deals with the problems that arise in performance assessment from the granularity that results from having a small number of tasks or prompts and raters of responses to these tasks or prompts. Two problems are discussed in detail: (1) achieving a satisfactory degree of reliability; and (2) equating or adjusting for differences of…

The Netherlands' secondary education system is highly differentiated, with four different school types for four scholastic ability levels. Final examinations must accommodate these four levels, and require a test-independent definition of the intended final ability levels as well as a sample-free evaluation of the range of ability levels at which…

The reliability of item bias estimates was studied for four methods: (1) the transformed delta method; (2) Shepard's modified delta method; (3) Rasch's one-parameter residual analysis; and (4) the Mantel-Haenszel procedure. Bias statistics were computed for each sample using all methods. Data were from administration of multiple-choice items from…