Submit a preprint

44

Cumulative evidence synthesis and consideration of "research waste" using Bayesian methods: An example updating a previous meta-analysis of self-talk interventions for sport/motor performanceuse asterix (*) to get italics
Hannah Corcoran, James SteelePlease use the format "First name initials family name" as in "Marie S. Curie, Niels H. D. Bohr, Albert Einstein, John R. R. Tolkien, Donna T. Strickland"
2024
<p>In the present paper we demonstrate the application of methods for cumulative evidence synthesis including Bayesian meta-analysis, and exploration of questionable research practices such as publication bias or <em>p</em>-hacking, in the sport and exercise sciences for the evaluation of experimental interventions. The use of such methods can aid in study planning and avoid "research waste". In demonstrating and discussing these methods we use the example of self-talk interventions and their effects upon sport/motor performance given a quantitative evidence synthesis has not been conducted on this topic, to the best of our knowledge, since 2011 when Hatzigeorgiadis et al. (2011) conducted their systematic review and meta-analysis. As such, this topic is ripe to use in demonstrating cumulative methods such as Bayesian updating. Therefore, our aim was to conduct an updated systematic review and Bayesian meta-analysis replicating the search, inclusion, and models of Hatzigeorgiadis et al. (2011) and demonstrate the application of cumulative evidence synthesis methods including; consideration of the initial probability that a new study of the effects of self-talk interventions would shift our prior belief in their effectiveness, the application of priors taken from the previous meta-analysis to be updated by new studies identified to a new posterior estimate of effect, and consideration of other possible sources of research waste from questionable research practices such as publication bias and <em>p</em>-hacking. Such methods as those demonstrated here, when used prospectively, can aid researchers in determining whether further research of a particular experimental intervention is in fact warranted. Considering the limited resources and time for conducting research we hope that highlighting the application of these methods might help researchers in the field to avoid research waste and more productively direct their research efforts.</p>
https://osf.io/dqwh5/You should fill this box only if you chose 'All or part of the results presented in this preprint are based on data'. URL must start with http:// or https://
https://osf.io/dqwh5/You should fill this box only if you chose 'Scripts were used to obtain or analyze the results'. URL must start with http:// or https://
https://You should fill this box only if you chose 'Codes have been used in this study'. URL must start with http:// or https://
psychological interventions, cumulative evidence synthesis, research waste
NonePlease indicate the methods that may require specialised expertise during the peer review process (use a comma to separate various required expertises).
Exercise & Sports Psychology, Meta-Science in Health & Movement
Professor Emily Oliver emily.oliver@newcastle.ac.uk, Dr Zachary Zenko zzenko@csub.edu, Dr Matthew Grainger matthew.grainger@nina.no, Zachary Zenko suggested: I am sorry that I am not currently available for review. Please contact me again in two weeks if you haven't found a suitable reviewer. I'd like to suggest:, Zachary Zenko suggested: Amanda Rymal (arymal@csusb.edu), Zachary Zenko suggested: Matthieu Hoffman (matthoffman@fullerton.edu), Zachary Zenko suggested: Jenny O (jenny.o@csueastbay.edu), Chris Englert [englert@sport.uni-frankfurt.de] suggested: sorry, do not have the time right now. I recommend Sterling Archer, Emily Oliver [emily.oliver@newcastle.ac.uk] suggested: Apologies I am currently on maternity leave , Denver Brown suggested: Jeffrey Graham, Ontario Tech University
e.g. John Doe john@doe.com
No need for them to be recommenders of PCI Health & Mov Sci. Please do not suggest reviewers for whom there might be a conflict of interest. Reviewers are not allowed to review preprints written by close colleagues (with whom they have published in the last four years, with whom they have received joint funding in the last four years, or with whom they are currently writing a manuscript, or submitting a grant proposal), or by family members, friends, or anyone for whom bias might affect the nature of the review - see the code of conduct
e.g. John Doe john@doe.com
2023-11-27 10:06:36
Wanja Wolff
Maik Bieleke, Anonymous