Several state policies link high-stakes consequences to teacher evaluations, which tend to be heavily weighted by observation scores. However, research has only recently investigated the validity of these scores in field settings. This study examines the sensitivity of teacher observation scores to the number of observations assigned by state…

Database files and additional log files of Learning Management Systems (LMSs) contain an enormous volume of data which usually remain unexploited. A new methodology is proposed in order to analyse these data both on the level of both the courses and the learners. Specifically, "regression analysis" is proposed as a first step in the…

This article examines the significance of information literacy self-assessments in higher education with a special focus on situational conditions increasing their explanatory power. First, it was hypothesised that self-assessments of information literacy correlate higher with factual information literacy if measured after the administration of…

The Early Childhood Environment Rating Scale-Revised (ECERS-R) is widely used to associate child care quality with child development, but its validity for this purpose is not well established. We examined the validity of the ECERS-R using the multidimensional Rasch partial credit model (PCM), factor analyses, and regression analyses with data from…

Smoking, drinking, and illicit drug use are leading causes of morbidity and mortality, both during adolescence as well as later in life. The determination of how well national and local policy and intervention efforts address teen substance use depends largely on the collection of valid and accurate data. Assessments of substance use rely heavily…

Teachers are now experiencing the age of quantitative test-driven assessment, in which there is little weight accorded to teacher-based judgement about student progress. In the Australian context, the NAPLaN test has become a driving force in school and teacher accountability. The language of NAPLaN is one of bands and numerical scores and…

CoLiDeS + Pic is a cognitive model of web-navigation that incorporates semantic information from pictures into CoLiDeS. In our earlier research, we have demonstrated that by incorporating semantic information from pictures, CoLiDeS + Pic can predict the hyperlinks on the shortest path more frequently, and also with greater information scent,…

This article aims to examine the predictive relationships of self-evaluation capacity and staff competency on the effect of strategic planning in aided secondary schools in Hong Kong. A quantitative questionnaire survey was compiled to collect data from principals of the participating schools. Confirmatory factor analysis and reliability tests…

"The Measures of Success" (MoS) project set out to develop, implement, and present the results of an evaluation model that could assess longer-term outcomes of workplace education programs for increasing literacy and Essential Skills. The model was tested at 18 work sites in Manitoba and Nova Scotia and included training programs that…

The purpose of this study was to test whether the web version is an alternative to the paper version of the short version of the World Health Organization Quality of Life assessment (WHOQOL-BREF). Two studies were conducted. Study 1 used crossover self-controlled trials with 80 participants to compare the web and paper versions and to determine…

Estimates of the criterion-related validity for the National Teacher Examinations (NTE) in mathematics and science were determined empirically. Results suggest that the science tests are not as useful as the mathematics tests as indicators of subject knowledge. (GK)

Purpose: The purpose of this research is to examine the construct and predictive ability of a German version of the Learning Transfer Systems Inventory (GLTSI), an instrument designed to assess a constellation of 16 factors known to influence the transfer of training in work settings. Design/methodology/approach: The survey data for this study was…

Many programs designed to compute the readability of texts are narrowly based on surface-level linguistic features and take too little account of the processes which a reader brings to the text. This study is an exploratory examination of the use of Coh-Metrix, a computational tool that measures cohesion and text difficulty at various levels of…

The regression trunk approach (RTA) is an integration of regression trees and multiple linear regression analysis. In this paper RTA is used to discover treatment covariate interactions, in the regression of one continuous variable on a treatment variable with "multiple" covariates. The performance of RTA is compared to the classical…

Meta-analytic methods were used to synthesize research on the relationship between student ratings of instruction and student achievement. Results provide strong support for the validity of student ratings as measures of teaching effectiveness. (Author/GK)