This paper describes the development of an instrument--The Reflective Supervisor Questionnaire (RSQ). The RSQ maps the domain of research supervisory practice as a facilitative process involving educational tasks and activities. It is designed to assist research supervisors explore, by means of self-reflection and reflection on feedback from…

Single equation regression models have been used rather extensively to test the effectiveness of Supplemental Instruction (SI). This approach, however, fails to account for the possibility that SI attendance and the outcome of SI attendance are jointly determined endogenous variables. Moreover, the standard approach fails to account for the fact…

School-wide behavior support has experienced recent interest among educators. This approach has been embraced because of its potential for decreasing school violence and improving school climate. In this paper we examine issues related to construct, internal, external, and social validity of school-wide support as it has been conceptualized in…

The purpose of this paper is to introduce the Teacher Performance Rate and Accuracy Scale (TPRA) which is a method of direct teacher observation used in the teacher evaluation and training component of the Comprehensive Application of Behavior Analysis to Schooling (CABAS [R]) model of schooling. The TPRA builds on the concept of academic engaged…

In September 2005 the National Foundation for Educational Research (NFER) in association with the Department for Education and Skills (DfES), the Sutton Trust and the College Board, began a five-year research study to examine the validity of an aptitude test in higher education admissions. This report describes and explores the relationships…

Valid measurement of physical activity is important for studying the risks for morbidity and mortality. The purpose of this study was to examine evidence of construct validity of two similar single-response items assessing physical activity via self-report. Both items are based on the stages of change model. The sample was 687 participants (men =…

Problems of scale typically arise when comparing test score trends, gaps, and gap trends across different tests. To overcome some of these difficulties, we can express the difference between the observed test performance of two groups with graphs or statistics that are metric-free (i.e., invariant under positive monotonic transformations of the…

A 2003 review of the literature shows a lack of formal institutional research focusing on the development of critical thinking as a situated experience--occurring in a specific context with a complex set of dynamics. Rather, much of the emphasis has been on learning outcomes as measured by various psychometric-approaches or an instructor's…

Introduction: Solo and nonurban practice, nonmembership of a professional group, and aging are all associated with underperformance and may be indicators of professional isolation. Although it may lead to underperformance in physicians, there are no clear measures to assess professional isolation. Methods: By mailed questionnaire, experienced…

Little is known about environmental concerns and attitudes among people in former Soviet bloc countries in Eastern Europe despite widespread perceptions of severe environmental problems. The authors addressed this gap by examining Bulgarians' environmental concerns with a focus on whether the new environmental paradigm (NEP) scale can reliably…

The development of the DETECT procedure marked an important advancement in nonparametric dimensionality analysis. DETECT is the first nonparametric technique to estimate the number of dimensions in a data set, estimate an effect size for multidimensionality, and identify which dimension is predominantly measured by each item. The efficacy of…

Exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) have contributed to test development and validation in counseling psychology, but additional applications have not been fully realized. The author presents an overview of the goals, terminology, and procedures of factor analysis; reviews best practices for extracting,…

Researchers sometimes need a statistical test of the hypothesis that two values of Cronbach's alpha reliability coefficient are equal. The situation may involve scores from two different measures administered to independent random samples or from the same measure administered to random samples from two different populations. Feldt derived a test…

Cudeck and Browne (1983) proposed using cross-validation as a model selection technique in structural equation modeling. The purpose of this study is to examine the performance of eight cross-validation indices under conditions not yet examined in the relevant literature, such as nonnormality and cross-validation design. The performance of each…

In low-stakes testing, the motivation levels of examinees are often a matter of concern to test givers because a lack of examinee effort represents a direct threat to the validity of the test data. This study investigated the use of response time to assess the amount of examinee effort received by individual test items. In 2 studies, it was found…