Manipulation checks are an essential component of quality experimental design in motor learning. Guided by the Preferred Reporting Items for Systematic Reviews and Meta-Analyses framework, this methodological systematic review examined the utilization of manipulation checks in focus of attention research. Seventy-eight protocols from four…

While there has been a lot of debate over the impact of online and remote learning on mental health and well-being, there has been no systematic syntheses or reviews of the research on this particular issue. In this paper, we review the research on the relationship between mental health/well-being and online or remote learning. Our review shows…

The growing importance of genomics and bioinformatics methods and paradigms in biology has been accompanied by an explosion of new curricula and pedagogies. An important question to ask about these educational innovations is whether they are having a meaningful impact on students' knowledge, attitudes, or skills. Although assessments are…

Literature shows that most researchers are unaware of some of the characteristics of reliability. This paper clarifies some misconceptions by describing the procedures, benefits, and limitations of reliability generalization while using it to illustrate the nature of score reliability. Reliability generalization (RG) is a meta-analytic method…

Reviews research on two measures of transference: Q-sort questionnaire measures and psychotherapy process measures. Q-sort, although reliable, lacks validity information. Psychotherapy process measures have reliability and validity. Considerable comparability was found between process measures and operationalized propositions from Freud's…

Addresses generalizability theory (GT), which offers a flexible framework for assessing dependability of measurement. GT allows for consideration of multiple sources of error, allowing investigators to assess the overall impact of measurement error. Illustrative analyses demonstrate the special advantages of GT for planning studies in which…

Discusses research in creativity with particular emphasis on the problems encountered in assessing creativity from a life-span developmental framework. Alternative developmental models and measures are discussed as future research recommendations for the assessment of life-span creativity. (Author/RH)

Supports arguments against general use of change scores and recommends the Lord/McNemar estimates of true change. Provides a numerical example illustrating the reliability problem and the problem of the prediction of true change from various linear composites of initial and final measures. (Author)

The clinical inquiry approach to classroom research is seen as a desirable alternative to traditional educational research methods. (LH)

Assesses techniques used by researchers to collect and analyze data on how people with visual impairments or blindness learn, understand, and think about geographic space. Recommendations are made for increasing the validity of studies, including the use of multiple, mutually supportive tests; larger samples; and real-world environments.…

A review of studies on effective principals reveals that a number of methodological problems have prevented the accumulation of findings adequate to producing well developed models of instructional leadership and its effects on school outcomes. Problems of measurement and research design in the existing literature are reviewed and suggestions for…

This article discusses evidence for functional behavioral assessment (FBA) procedures in terms of the meaning and interpretation of different forms of reliability and validity in FBA. It concludes that additional research needs to be conducted with various target behaviors across different settings to support the continued use of FBA. (Contains…

Examines Jones's and Nisbett's (1971, 1972) hypothesis that people generally attribute the actions of others to stable trait dispositions but see their own behavior as relatively more influenced by specific environmental circumstances. Discusses methodological problems in studies examining this hypothesis, suggesting ways they might be overcome.…

Research on teacher evaluation and teacher effectiveness indicates that there are serious problems with the reliability of presage, process, and product findings. Quality in teaching can best be assessed by measuring process in the classroom and by using observation instruments which record the occurrence of specific, well-defined behaviors. (PP)

The purpose of this paper is to discuss ways in which developmental psychology suffers from the lack of an appropriate technology of measurement and statistical analysis. The paper begins by noting that developmental psychology is the study of change; that individuals develop through a succession of "stages" which are separated by…