This study examined the difficulty level of essay topics used in the large-scale assessment of writing in relation to five different scoring models, and sought to determine what effects the scoring models would have on passing rates. In model one, examinee's score is the direct result of a score assigned by the reader or the sum of scores assigned…

Efficient methods of using the Statistical Package for the Social Sciences (SPSS) to analyze National Assessment of Educational Progress (NAEP) data files are discussed. One error in the NAEP SPSS file is discussed, and another error (which may be system-dependent) is mentioned. In addition, purely mathematical methods are used to address the…

Three methods of item selection were used to select sets of 38 items from a 50-item verbal analogies test and the resulting item sets were compared for internal consistency, standard errors of measurement, item difficulty, biserial item-test correlations, and relative efficiency. Three groups of 1,500 cases each were used for item selection. First…

Six approaches to assessing test item bias were examined: transformed item difficulty, point biserial correlations, chi-square, factor analysis, one parameter item characteristic curve, and three parameter item characteristic curve. Data sets for analysis were generated by a Monte Carlo technique based on the three parameter model; thus, four…

Unlike the past models guiding cross-cultural psychological research, a new paradigm facilitates multiple level investigations by incorporating both culture-specific (nested) and culture-general (crossed) independent variables within its partially-hierarchical framework. Based upon the generalizability analysis, this model generates sequential…

This paper reports the results of an evaluative statistical analysis of the instrument employed for student evaluation of faculty at Oakton Community College (Illinois). The analysis was performed because the locally devised instrument had never been subjected to systematic study of reliability or validity, and because a review of pertinent…

The Beginning Teacher Evaluation Study (BTES), Phase II, was a research project on effective teaching behavior--what teachers do that significantly affects what and how pupils learn. The purposes of Phase II were to (1) develop an assessment system for measuring teacher and pupil behaviors and other factors which could influence each of them and…

The effects of the protocol film series, Concepts and Patterns in Teacher-Pupil Interaction, were measured by a film-based test after the test had undergone validation. The test, Categorizing Teacher Behavior, evidenced a high level of reliability and validity in a graduate level course in educational psychology. The test was judged valid by a…

The purpose of this study was to develop and assess the psychometric properties of a measure of teacher value systems. Three value systems were defined as values associated with (1) the pursuit of truth, (2) social and interpersonal relations, and (3) authority and its exercise. The scale was taken through three stages of development and field…

A diagnostic test in English as a second language should be a series of miniature tests on specific problems. Subscores in each area should be considered rather than a total score. The results should be used to probe mastery in an area rather than provide the means for comparing one student against another. The statistical reliability of the…

Factor analysis was used to summarize the interrelationships between a large and varied collection of measures. Data for 500 third grade students assigned to either an experimental or a comparison condition were obtained. The data covered scores for the first 28 items of the Student Affective Behavior Checklist, (2) 9 nonmathematics subtests of…

This report is the initial overall summary of a comprehensive analysis of children's logical concept attainments and memoric abilities and deals exclusively with the initial and second year's assessment data. The focal point for this normative investigation is the concrete operations period spanning the years of middle childhood. The measurement…

A study compared a Modified Area Skill Survey (MASS) with a Modified Industry/Occupation Matrix (MIOM) method of projecting manpower demand. The comparison was made with regard to the bias and precision of the estimates of the two projection methods on populations of varying size. To achieve the comparison, each method was applied to the same…

Based on statistics from the first few administrations of the SAT writing section, the test is performing as expected. The reliability of the writing section is very similar to that of other writing assessments. Based on preliminary validity research, the writing section is expected to add modestly to the prediction of college performance when…

Investigates factors influencing Japanese university students' expository writing in English. Quantitative analysis revealed that students' second-language (L2) proficiency, first-language writing ability, and metaknowledge were significant in explaining L2 writing ability variance. An explanatory model for writing ability in English as a Foreign…