When data are collected via anonymous Internet surveys, particularly under conditions of obligatory participation (such as with student samples), data quality can be a concern. However, little guidance exists in the published literature regarding techniques for detecting careless responses. Previously several potential approaches have been…

Systematic reviews are used to inform practice, and develop guidelines and protocols. A questionnaire to quantify the risk of bias in systematic reviews, the review paper assessment (RPA) tool, was developed and tested. A search of electronic databases provided a data set of review articles that were then independently reviewed by two assessors…

The purpose of this study was to create a valid and reliable instrument to measure teacher perceived barriers to the adoption of games and simulations in instruction. Previous research, interviews with educators, a focus group, an expert review, and a think aloud protocol were used to design a survey instrument. After finalization, the survey was…

This report highlights 10 of the most advanced and talked-about teacher evaluation systems nationally: Delaware; Rhode Island; Tennessee; Hillsborough County, Florida; Houston, Texas; New Haven, Connecticut; Pittsburgh, Pennsylvania; Washington, DC (referred to throughout just as Washington); Achievement First (a charter management organization,…

Notwithstanding broad utility of COPs (classroom observation protocols), there has been limited documentation of the psychometric properties of even the most popular COPs. This study attempted to fill this void by closely examining the item and domain-level IRR (inter-rater reliability) of a COP that was used in a federally funded striving readers…

In this technical report, we present the results of a reliability study of the second-grade multiple choice reading comprehension measures available on the easyCBM learning system conducted in the spring of 2011. Analyses include split-half reliability, alternate form reliability, person and item reliability as derived from Rasch analysis,…

In this paper, we describe the initial stage of reliability and validity testing for the Mathematics Education of English Learners Scale (MEELS), which is designed to measure preservice teachers' beliefs about the mathematics education of English learners. To address the content validity, we consulted with experts within the field of mathematics…

The graduate experience is a critical time for development of academic faculty, but often there is little preparation for teaching during the graduate career. Teaching self-efficacy, an instructor's belief in his or her ability to teach students in a specific context, can help to predict teaching behavior and student achievement, and can be used…

The empirical literature investigating general and domain-specific self-concepts of adults with learning disabilities was examined using meta-analytic techniques. Eight inclusion criteria were developed to evaluate this literature and led to the inclusion of 22 studies. Results indicated that adults with learning disabilities reported lower…

Although direct observation is one of the most frequently used assessment methods by school psychologists, studies have shown that the number of observations needed to obtain a dependable estimate of student behavior may be impractical. Because direct observation may be used to inform important decisions about students, it is crucial that data be…

A preschooler's ability to delay gratification in the waiting task is predictive of several developmental outcomes, despite this task's relatively low reliability level. Success in this task depends on the use of distraction strategies. The new Watch-and-Wait Task (WWT) has been developed to enhance reliability and to investigate whether the…

This article reports on the development and piloting of a vocabulary recognition test designed for Indigenous Australian children. The research is both application oriented and development oriented. The aims of the article are to determine how well the test is used as a test instrument and the extent to which children recognize vocabulary items in…

In this paper I explore how Margaret Beier, Lesley Miller, and Shu Wang make claims for the validity and reliability of the instrument they developed to explore the construct of "possible selves" as described in their manuscript, "Science Games and the Development of Scientific Possible Selves."

The Short-Term Assessment of Risk and Treatability (START; C. D. Webster, M. L. Martin, J. Brink, T. L. Nicholls, & S. L. Desmarais, 2009; C. D. Webster, M. L. Martin, J. Brink, T. L. Nicholls, & C. Middleton, 2004) is a relatively new structured professional judgment guide for the assessment and management of short-term risks associated…

Using a school-based (N = 1,060) and clinic-referred (N = 303) youth sample, the authors developed a 25-item shortened version of the Revised Child Anxiety and Depression Scale (RCADS) using Schmid-Leiman exploratory bifactor analysis to reduce client burden and administration time and thus improve the transportability characteristics of this…