The curriculum innovations in chemistry are often designed to address the important goals of improving student understanding and attitude, with assessment to determine the effects of these innovations. These analyses are psychometrically weak for several reasons, one reason being that the ability to look for the changes over time or for…

The purpose of this investigation was to test the age-related measurement invariance and temporal stability of the 13-item version of Antonovsky's Sense of Coherence Scale (SOC). Multigroup structural equation modeling of longitudinal data from the Canadian National Population Health Survey was used to examine the measurement invariance across 3…

A study investigated 42 native English-speakers' (NSs) perceptions of the pragmatic appropriateness of refusal statements. The NSs rated the appropriateness of 24 written statements in 4 different refusal scenarios, which were collected from both native speakers and non-native speakers. Four weeks later, as a reliability check, the subjects rated…

Special problems confront the researcher measuring the attitudes of young children who cannot readily make cognitive judgments associated with conventional psychometric scales, such as Likert scales. One measurement strategy, called the method of paired comparisons, can overcome these difficulties. The method is explained in this paper. A small…

Two analyses of variance (ANOVA) models for item scores are compared. The first is an items by subject random effect ANOVA. The second is a mixed effects ANOVA with items fixed and subjects random. Comparisons regarding reliability, Cronbach's alpha coefficient, psychometric inference, and inter-item covariance structure are made between the…

Since speech communication evaluators are beginning to adapt the analytic and holistic instruments and methods used for rating written products to oral products and performance, this research review investigated: (1) what the labels "analytic" and "holistic" mean; (2) the theoretical bases of the two scoring approaches; and (3)…

First-, second-, and third-year students enrolled in an introductory educational psychology class at Texas A&M University in College Station were administered either a pencil-and-paper or computerized version of the Strong-Campbell Interest Inventory. The same or other version of the test was administered after 2 weeks. Focus is on equivalence…

To determine if there is a distinction between the forensics community's idea of quality and that of the general population, tournament rankings of forensics judges and those of a lay audience were compared. Undergraduate students enrolled in a variety of speech related courses were asked to attend rounds of competition at a midwest collegiate…

A study was conducted at Stark Technical College to compare a normative-referenced test for mathematics placement with a criterion-referenced test that had been used by the college. The study sought to compare statistically the scores of 165 students on the Mathematics Inventory Test (MIT--a criterion-referenced test that had been developed…

A study examined the nature of the questions contained in two major standardized reading comprehension tests in terms of their centrality to the text. It was hypothesized that the use of a discrimination index for item selection would tend to favor relatively trivial questions. Half the reading selections from the Stanford Diagnostic Reading Test…

As part of the Final Report of the National Study of American Indian Education, this paper reports on the reliability of rating scales used in analyzing the interviews conducted during the study. Approximately 4,000 interviews, which covered "adequate samples of people in the schools and communities" that were studied, were deemed valid as a…

Five-hundred dichotomously scored response patterns were generated with sequentially independent (SI) items and 500 with dependent (SD) items for each of thirty-six combinations of sampling parameters (i.e., three test lengths, three sample sizes, and four item difficulty distributions). KR-20, KR-21, and Split-Half (S-H) reliabilities were…

Four new methods of item analysis were used to select subsets of items which would yield measures of attitude change. The sample consisted of 263 students at Michigan State University who were tested on the Inventory of Beliefs as freshmen and retested on the same instrument as juniors. Item change scores and total change scores were computed for…

The problem of the comparability of change scores is investigated. Change quotients and residual change scores are evaluated as alternative approaches and methods for estimating the true change and true score residual, the reliability of change scores and residuals, and procedures for constructing confidence intervals for residuals are explored.…

Differential Aptitude Test (DAT) scores of 2,622 students who were tested in the 8th, 9th, or 10th grades and who later entered a Minnesota area vocational-technical school were analyzed to determine the relationships between test scores and training program entered. Results are presented. (Author)