The aim of this study is to investigate the impact of different logistic regression estimators applied to RDS studies via simulation and the analysis of empirical data. Four simulated populations were created with different connectivity characteristics. Each simulated individual received two attributes, one of them associated to the infection…

The objectives of this research on Cognitive Technology for Academic Counselling in the New Normal were (1) to design an architecture of cognitive technology for academic counselling in the new normal, (2) to develop a system of cognitive technology for academic counselling in the new normal, (3) to assess the academic performance of students…

Purpose: The purpose of this paper is to investigate Chinese teachers' attitudes toward performance pay. Specifically, this study examined the extent to which Chinese teachers supported performance-pay programs. The study also examined the effects of these programs on teachers, particularly on their levels of collaboration, work motivation, and…

Translators differ from each other in many ways in terms of their knowledge and professional conditions that may directly influence their translation. The present study aimed at investigating the impact of translators' academic experience on their translation quality. Following a "causal-comparative study", a sample of 100 male and…

Reports a reanalysis of data collected in a person x task x occasion rater or method G-study design (M. Ruiz-Primo and others, 1993), and brings this reanalysis to bear on the interpretation of task-sampling variability and the convergence of different performance-assessment methods. (SLD)

This study examined the percentage of task-sampling variability in performance assessment via a meta-analysis. In total, 50 studies containing 130 independent data sets were analyzed. Overall results indicate that the percentage of variance for (a) differential difficulty of task was roughly 12% and (b) examinee's differential performance of the…

Studied the sampling variability of estimated variance components using data collected over several years for a listening and writing performance assessment and evaluated the stability of estimated measurement precision. Results indicate that the estimated variance components varied from one year to another and suggest that the measurement…

The zeitgeist for reform in education precipitated a number of changes in assessment. Among these are performance assessments, sometimes linked to "high stakes" accountability decisions. In some instances, the trustworthiness of these decisions is based on variance components and error variances derived through generalizability theory.…

Not infrequently, investigators assume that reliability for groups is greater than reliability for persons, or that the error variance for groups is less than that for persons. Using generalizability theory, it is shown that this "conventional wisdom" is not necessarily true. Examples are provided from the course-evaluation and the…

This study examined matrix sampling of test content, the practice of giving various students in the same school differing test questions. This often-used approach to large-scale assessment allows for relatively broad coverage of the curriculum, but with fewer comparable individual student scores than a conventional test. One can be sure that…

This paper is based on guidelines developed in 1989 for training workshops for state and local educators to demonstrate the processes by which performance assessments could be created, validated, and used in statewide assessment programs. These guidelines are based on work with the National Assessment of Educational Progress and several statewide…

One of the benefits of performance based assessment is its allowance for the teacher to gather information about how the student understands and applies knowledge. In this Digest, the basic steps a teacher should take to plan and execute effective performance-based assessment are outlined. Coverage includes the steps of planning and executing…

Describes the teacher-developed California Assessment Program (CAP) writing measure, designed to support California's reform curriculum and based on matrix sampling techniques. This program will be supplemented by literature and mathematics assessments. The greatest challenge is designing an assessment to match the state's new history and social…

The use of the Work Keys Listening and Writing Assessment, part of an assessment system of the generic employability skills of individuals, needs to be accompanied by systematic evaluation of its technical qualities. This study examined sampling variability and generalizability of Listening and Writing scores when multiple forms, raters, and…

This literature review discusses the match between tests and curricula, measurement validity and instructional utility when sampling student performance in general and advantages/disadvantages of sampling performance in the curriculum. It concludes that sampling from the curriculum is not essential and outlines three critical features ensuring the…