Two methods of researching second language learning are described, analyzed, and compared: student diaries giving a first-person account of the second language learning experience; and participant observation, in which the observer is in the language learning situation recording in descriptive terms all possible data about the situation.…

The reliability, validity, and score discrepancies of 94 expository essays scored in conference versus remote settings were studied. Focus was on comparing holistic ratings obtained in both settings. Essays written by college freshmen on two different topics were scored by readers working in a conference setting and by different readers working in…

Criterion-referenced evaluation (CRE) describes achievement in performance terms, whereas norm-referenced evaluation (NRE) compares the performance of one individual to that of others with respect to a given evaluation instrument. Vocational educators who base their programs on behaviorism commonly evaluate student performance from a CRE…

To compare the relative reliable uses and cost effectiveness of the analytic, the holistic, and the primary trait scoring methods, an inquiry was conducted in which a group of raters scored a large number of secondary school students' essays according to each of the scoring methods. Raters were nine graduate students in English who were trained in…

The overall purpose of this research was to compare a maximum likelihood based tailored testing procedure to a Bayesian tailored testing procedure. The results indicated that both tailored testing procedures produced equally reliable ability estimates. Also an analysis of test length indicated that reasonable ability estimates could be obtained…

Comparisons of corresponding values of phi and kappa coefficients were made for 270 instances of data generated by a Monte Carlo technique to simulate a test-retest situation. Data were generated for distributions with the same mean but three different levels of standard deviation, standard error of measurement and cutting score. Ten samples of…

The effects of varying the formats of behavior rating scale items on teacher ratings of student hyperactivity were investigated. Two hundred forty-two teachers were asked to rate a variety of children; some had been identified as hyperactive by physicians, parents, or teachers; some were not considered hyperactive; and others were randomly…

It was wished to determine the relative reliabilities of graphic and semantic differential factors to evaluate applicability of two rival models to the measurement of pupil attitudes. Data was collected from a sample of sixth grade pupils on both abstract graphic and typical semantic differential scales. Reliability estimates were constructed from…

An assessment of the reliability of the followup questionnaire given to 715 graduates of the postsecondary Minnesota Area Vocational-Technical Institutes is presented. The questionnaire was designed to gather information that would facilitate decision making concerning vocational programs. Reliability was based on the consistency of group…

The reliability of a criterion referenced test was defined as a measure of the degree to which the test discriminates between an individual's level of performance and a predetermined criterion level. The variances of observed and true scores were defined as the squared deviation of the score from the criterion. Based on these definitions and the…

This paper describes and evaluates a new abstract form of the Purdue Elementary Problem-Solving Inventory. The new test parallels a shortened form of the original Inventory, but presents problems verbally rather than through slides. Both forms were given to advantaged and disadvantaged second- and fourth-graders. For the total sample, the slide…

This paper provides substantial evidence in favor of the continued use of conventional objective testing procedures in lieu of either the Coombs' cross-out technique or the Dressel and Schmid free-choice response procedure. From the studies presented in this paper, the tendency is for the cross-out and the free choice methods to yield a decrement…

Using the assumption of randomly parallel tests and concepts from generalizability theory, three signal/noise ratios for domain-referenced tests are developed, discussed, and compared. The three ratios have the same noise but different signals depending upon the kind of decision to be made as a result of measurement. (Author/JKS)

Students were evaluated in five categories: fund of knowledge, medical skills, problem-solving, professional standards, and reliability. The results indicate that the students performed equally well in most areas, and little difference in clinical performance could be demonstrated between the groups. (Editor/LBH)

Two studies investigated the functional equivalence of three different scoring systems used to assess the child's ability to understand and carry out multiplicative classification tasks. All three scoring criteria produced reliable and homogeneous tests. Their factor matrices were similar, and the corresponding factor structures were invariant…