Manipulation Checks in Focus of Attention Research: A Methodological Systematic Review.

Bibliographic Details
Title: Manipulation Checks in Focus of Attention Research: A Methodological Systematic Review.
Authors: Kearney, Philip E.1,2 (AUTHOR) kearneype@gmail.com, Curran, Niamh3 (AUTHOR), Nugent, Frank J.1 (AUTHOR)
Source: Journal of Motor Learning & Development. Apr2025, Vol. 13 Issue 1, p17-35. 19p.
Subject Terms: *MANIPULATION checks (Research), *SCIENCE databases, *MOTOR learning, *EXPERIMENTAL design, *RESEARCH personnel
Abstract: Manipulation checks are an essential component of quality experimental design in motor learning. Guided by the Preferred Reporting Items for Systematic Reviews and Meta-Analyses framework, this methodological systematic review examined the utilization of manipulation checks in focus of attention research. Seventy-eight protocols from four scientific databases from September 2021—September 2023 were evaluated. A secondary analysis was conducted on 10 data sets where manipulation check failures had not been explicitly considered. No manipulation check was used in 53% of protocols, where a manipulation check was used: 19% used a single rating question, 11.5% used multiple questions, 11.5% used open questions, and 5% used other forms. When manipulation checks were utilized in studies, 68% of experiments did not report if any participants failed the manipulation check or not; the remaining reports either analyzed the failures (11%), excluded the failures (8%), ran multiple analyses (8%), or stated that no participants failed (5%). In the secondary analysis of data, when participants who failed manipulation checks were excluded, the interpretation of results changed in two of the 10 reanalyzed sources when compared with the original analysis. We conclude with recommendations on how researchers can optimize their use of manipulation checks within focus of attention research in both the collection and analysis of data. [ABSTRACT FROM AUTHOR]
Copyright of Journal of Motor Learning & Development is the property of Human Kinetics Publishers, Inc. and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Academic Search Complete
More Details
ISSN:23253193
DOI:10.1123/jmld.2024-0069
Published in:Journal of Motor Learning & Development
Language:English