To determine if individuals other than first-line supervisors could be used as expert judges in making estimates of job performance worth when conducting a utility analysis, this study compared the estimates of experienced job incumbents with those of supervisors. The job class investigated was that of eligibility technician, who performs varied…

Pronunciation is an important subskill in second language learning, therefore worth evaluating. Its quality is commonly assessed in a global, impressionistic way by having learners read aloud. While this allows comparison of examinees' skills, ability to read aloud is a possible confounding variable. An alternative method is to have learners read…

To test the validity of the Watson-Barker Listening Test (WBLT), a study was conducted based on the hypothesis that there is a curvilinear relationship between receiver apprehension and listening ability. Subjects, 120 undergraduate speech students, completed the Receiver Apprehension Test (RAT) and the WBLT. Analysis of the data revealed a…

To date, the majority of computerized adaptive testing (CAT) systems for achievement and aptitude testing have been based on the dichotomous item response models. However, current research with polychotomous model-based CATs is yielding promising results. This study extends previous work on nominal response model-based CAT (NR CAT) and compares…

The Matrix Analogies Test-Expanded Form (MAT-EF) and Kaufman Assessment Battery for Children (K-ABC) were administered in counterbalanced order to two randomly selected samples of students in grades 2 through 5. The MAT-EF was recently developed to measure non-verbal reasoning. The samples included 26 non-handicapped second graders in a rural…

A study assessed the applicability of the American Institutes for Research (AIR) procedures' Performance-Against-Standard form for use in personnel evaluation by the Ohio Cooperative Extension Service. The study also compared relevant test construction approaches identified in the literature to those used in the AIR study in attempting to confirm…

The effect on children's test scores of different item formats used in standardized mathematics achievement tests was investigated. In a Utah school, 40 second grade students completed a mathematics computation test using eight different formats derived from five standardized achievement tests. Identical content, taken from the most frequently…

There are four reasons why comparative data is needed for student ratings of faculty performance: (1) the considerable inflation of student ratings; (2) the great variability in the way students rate different items; (3) because student rating systems must be flexible and comparable; and (4) because of factors (such as student motivation, class…

It was hypothesized in this document that lowered self-concept would be associated with children exhibiting problems such as delinquency or childhood depression. The differences in self-concept between 97 clinic and 485 nonclinic children were investigated by administration of the Piers-Harris Children's Self Concept Scale. The reported…

This study compares the validity of three cloze procedures (traditional, limited, and least-major-constituent limited) when reading comprehension is defined as cognitive change. Over 400 seventh and eighth graders from public schools in North Carolina and Arizona were randomly assigned to one of the three cloze formats for either fiction or…

Instructors who develop classroom examinations that require students to provide a numerical response to a mathematical problem are often very concerned about the appropriateness of the multiple-choice format. The present study augments previous research relevant to this concern by comparing the difficulty and reliability of multiple-choice and…

The purpose of the investigation was to obtain some relationships among (1) test lengths, (2) shape of domain-score distributions, (3) advancement scores, and (4) several criterion-referenced test score reliability and validity indices. The study was conducted using computer simulation methods. The values of variables under study were set to be…

A neurological examination has been developed to discover children with physiologically based learning problems who do not manifest asymmetrical functioning. This study attempts to determine the validity of this examination by its accuracy in predicting the performance of children in a summer Head Start program. Validity was determined by…

An analysis was made of quality ratings of elementary level standardized tests. Applying multidimensional scaling to intercorrelations of quality ratings, it was found that the criterion of content and construct validity was a central element in the evaluation of elementary tests. In addition, several types of validity and reliability were found…

This study empirically determined the optimizing weight to be applied to the Wrongs Total Score in scoring rubrics of the general form = R - kW, where S is the Score, R the Rights Total, k the weight and W the Wrongs Total, if reliability is to be maximized. As is well known, the traditional formula score rests on a theoretical framework which is…