ERIC Number: EJ1465562
Record Type: Journal
Publication Date: 2025
Pages: 19
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-2325-3193
EISSN: EISSN-2325-3215
Available Date: 0000-00-00
Manipulation Checks in Focus of Attention Research: A Methodological Systematic Review
Philip E. Kearney; Niamh Curran; Frank J. Nugent
Journal of Motor Learning and Development, v13 n1 p17-35 2025
Manipulation checks are an essential component of quality experimental design in motor learning. Guided by the Preferred Reporting Items for Systematic Reviews and Meta-Analyses framework, this methodological systematic review examined the utilization of manipulation checks in focus of attention research. Seventy-eight protocols from four scientific databases from September 2021-September 2023 were evaluated. A secondary analysis was conducted on 10 data sets where manipulation check failures had not been explicitly considered. No manipulation check was used in 53% of protocols, where a manipulation check was used: 19% used a single rating question, 11.5% used multiple questions, 11.5% used open questions, and 5% used other forms. When manipulation checks were utilized in studies, 68% of experiments did not report if any participants failed the manipulation check or not; the remaining reports either analyzed the failures (11%), excluded the failures (8%), ran multiple analyses (8%), or stated that no participants failed (5%). In the secondary analysis of data, when participants who failed manipulation checks were excluded, the interpretation of results changed in two of the 10 reanalyzed sources when compared with the original analysis. We conclude with recommendations on how researchers can optimize their use of manipulation checks within focus of attention research in both the collection and analysis of data.
Descriptors: Attention Control, Attention Span, Motor Development, Psychomotor Skills, Manipulative Materials, Research Design, Research Methodology, Research Administration, Research Problems, Data Collection, Data Analysis, Compliance (Psychology), Test Reliability, Measurement Techniques
Human Kinetics, Inc. 1607 North Market Street, Champaign, IL 61820. Tel: 800-474-4457; Fax: 217-351-1549; e-mail: info@hkusa.com; Web site: https://journals.humankinetics.com/view/journals/jmld/jmld-overview.xml
Publication Type: Journal Articles; Information Analyses
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A