Same data, different analysts: variation in effect sizes due to analytical decisions in ecology and evolutionary biology

Authors: Elliot Gould, Hannah S. Fraser, Timothy H. Parker, Shinichi Nakagawa, Simon C. Griffith, Peter A. Vesk, Fiona Fidler, Daniel G. Hamilton, Robin N. Abbey-Lee, Jessica K. Abbott, Luis A. Aguirre, Carles Alcaraz, Irith Aloni, Drew Altschul, Kunal Arekar, Jeff W. Atkins, Joe Atkinson, Christopher M. Baker, Meghan Barrett, Kristian Bell, Suleiman Kehinde Bello, Iván Beltrán, Bernd J. Berauer, Michael Grant Bertram, Peter D. Billman, Charlie K. Blake, Shannon Blake, Louis Bliard, Andrea Bonisoli-Alquati, Timothée Bonnet, Camille Nina Marion Bordes, Aneesh P. H. Bose, Thomas Botterill-James, Melissa Anna Boyd, Sarah A. Boyle, Tom Bradfer-Lawrence, Jennifer Bradham, Jack A. Brand, Martin I. Brengdahl, Martin Bulla, Luc Bussière, Ettore Camerlenghi, Sara E. Campbell, Leonardo L. F. Campos, Anthony Caravaggi, Pedro Cardoso, Charles J. W. Carroll, Therese A. Catanach, Xuan Chen, Heung Ying Janet Chik, Emily Sarah Choy, Alec Philip Christie, Angela Chuang, Amanda J. Chunco, Bethany L. Clark, Andrea Contina, Garth A. Covernton, Murray P. Cox, Kimberly A. Cressman, Marco Crotti, Connor Davidson Crouch, Pietro B. D’Amelio, Alexandra Allison de Sousa, Timm Fabian Döbert, Ralph Dobler, Adam J. Dobson, Tim S. Doherty, Szymon Marian Drobniak, Alexandra Grace Duffy, Alison B. Duncan, Robert P. Dunn, Jamie Dunning, Trishna Dutta, Luke Eberhart-Hertel, Jared Alan Elmore, Mahmoud Medhat Elsherif, Holly M. English, David C. Ensminger, Ulrich Rainer Ernst, Stephen M. Ferguson, Esteban Fernandez-Juricic, Thalita Ferreira-Arruda, John Fieberg, Elizabeth A. Finch, Evan A. Fiorenza, David N. Fisher, Amélie Fontaine, Wolfgang Forstmeier, Yoan Fourcade, Graham S. Frank, Cathryn A. Freund, Eduardo Fuentes-Lillo, Sara L. Gandy, Dustin G. Gannon, Ana I. García-Cervigón, Alexis C. Garretson, Xuezhen Ge, William L. Geary, Charly Géron, Marc Gilles, Antje Girndt, Daniel Gliksman, Harrison B. Goldspiel, Dylan G. E. Gomes, Megan Kate Good, Sarah C. Goslee, J. Stephen Gosnell, Eliza M. Grames, Paolo Gratton, Nicholas M. Grebe, Skye M. Greenler, Maaike Griffioen, Daniel M. Griffith, Frances J. Griffith, Jake J. Grossman, Ali Güncan, Stef Haesen, James G. Hagan, Heather A. Hager, Jonathan Philo Harris, Natasha Dean Harrison, Sarah Syedia Hasnain, Justin Chase Havird, Andrew J. Heaton, María Laura Herrera-Chaustre, Tanner J. Howard, Bin-Yan Hsu, Fabiola Iannarilli, Esperanza C. Iranzo, Erik N. K. Iverson, Saheed Olaide Jimoh, Douglas H. Johnson, Martin Johnsson, Jesse Jorna, Tommaso Jucker, Martin Jung, Ineta Kačergytė, Oliver Kaltz, Alison Ke, Clint D. Kelly, Katharine Keogan, Friedrich Wolfgang Keppeler, Alexander K. Killion, Dongmin Kim, David P. Kochan, Peter Korsten, Shan Kothari, Jonas Kuppler, Jillian M. Kusch, Malgorzata Lagisz, Kristen Marianne Lalla, Daniel J. Larkin, Courtney L. Larson, Katherine S. Lauck, M. Elise Lauterbur, Alan Law, Don-Jean Léandri-Breton, Jonas J. Lembrechts, Kiara L’Herpiniere, Eva J. P. Lievens, Daniela Oliveira de Lima, Shane Lindsay, Martin Luquet, Ross MacLeod, Kirsty H. Macphie, Kit Magellan, Magdalena M. Mair, Lisa E. Malm, Stefano Mammola, Caitlin P. Mandeville, Michael Manhart, Laura Milena Manrique-Garzon, Elina Mäntylä, Philippe Marchand, Benjamin Michael Marshall, Charles A. Martin, Dominic Andreas Martin, Jake Mitchell Martin, April Robin Martinig, Erin S. McCallum, Mark McCauley, Sabrina M. McNew, Scott J. Meiners, Thomas Merkling, Marcus Michelangeli, Maria Moiron, Bruno Moreira, Jennifer Mortensen, Benjamin Mos, Taofeek Olatunbosun Muraina, Penelope Wrenn Murphy, Luca Nelli, Petri Niemelä, Josh Nightingale, Gustav Nilsonne, Sergio Nolazco, Sabine S. Nooten, Jessie Lanterman Novotny, Agnes Birgitta Olin, Chris L. Organ, Kate L. Ostevik, Facundo Xavier Palacio, Matthieu Paquet, Darren James Parker, David J. Pascall, Valerie J. Pasquarella, John Harold Paterson, Ana Payo-Payo, Karen Marie Pedersen, Grégoire Perez, Kayla I. Perry, Patrice Pottier, Michael J. Proulx, Raphaël Proulx, Jessica L Pruett, Veronarindra Ramananjato, Finaritra Tolotra Randimbiarison, Onja H. Razafindratsima, Diana J. Rennison, Federico Riva, Sepand Riyahi, Michael James Roast, Felipe Pereira Rocha, Dominique G. Roche, Cristian Román-Palacios, Michael S. Rosenberg, Jessica Ross, Freya E. Rowland, Deusdedith Rugemalila, Avery L. Russell, Suvi Ruuskanen, Patrick Saccone, Asaf Sadeh, Stephen M. Salazar, Kris Sales, Pablo Salmón, Alfredo Sánchez-Tójar, Leticia Pereira Santos, Francesca Santostefano, Hayden T. Schilling, Marcus Schmidt, Tim Schmoll, Adam C. Schneider, Allie E. Schrock, Julia Schroeder, Nicolas Schtickzelle, Nick L. Schultz, Drew A. Scott, Michael Peter Scroggie, Julie Teresa Shapiro, Nitika Sharma, Caroline L. Shearer, Diego Simón, Michael I. Sitvarin, Fabrício Luiz Skupien, Heather Lea Slinn, Grania Polly Smith, Jeremy A. Smith, Rahel Sollmann, Kaitlin Stack Whitney, Shannon Michael Still, Erica F. Stuber, Guy F. Sutton, Ben Swallow, Conor Claverie Taff, Elina Takola, Andrew J. Tanentzap, Rocío Tarjuelo, Richard J. Telford, Christopher J. Thawley, Hugo Thierry, Jacqueline Thomson, Svenja Tidau, Emily M. Tompkins, Claire Marie Tortorelli, Andrew Trlica, Biz R. Turnell, Lara Urban, Stijn Van de Vondel, Jessica Eva Megan van der Wal, Jens Van Eeckhoven, Francis van Oordt, K. Michelle Vanderwel, Mark C. Vanderwel, Karen J. Vanderwolf, Juliana Vélez, Diana Carolina Vergara-Florez, Brian C. Verrelli, Marcus Vinícius Vieira, Nora Villamil, Valerio Vitali, Julien Vollering, Jeffrey Walker, Xanthe J. Walker, Jonathan A. Walter, Pawel Waryszak, Ryan J. Weaver, Ronja E. M. Wedegärtner, Daniel L. Weller, Shannon Whelan, Rachel Louise White, David William Wolfson, Andrew Wood, Scott W. Yanco, Jian D. L. Yen, Casey Youngflesh, Giacomo Zilio, Cédric Zimmer, Gregory Mark Zimmerman, Rachel A. Zitomer

Source: BMC Biology, Vol 23, Iss 1, Pp 1-36 (2025)

Subject Terms: Analytical heterogeneity, Metascience, Many-analyst, Replication crisis, Reproducibility, Biology (General), QH301-705.5

File Description: electronic resource

Relation: https://doaj.org/toc/1741-7007

Access URL: https://doaj.org/article/de5863fbbfd4411f8ee09e352a483284

Poor hypotheses and research waste in biology: learning from a theory crisis in psychology

Authors: Shinichi Nakagawa, David W. Armitage, Tom Froese, Yefeng Yang, Malgorzata Lagisz

Source: BMC Biology, Vol 23, Iss 1, Pp 1-13 (2025)

Subject Terms: Questionable research practice, Replication crisis, Credibility revolution, Team science, SORTEE, Biology (General), QH301-705.5

File Description: electronic resource

Relation: https://doaj.org/toc/1741-7007

Access URL: https://doaj.org/article/d6ca6a4d5e604d6d96208b38adc94f8c

What is the evidence for the impact of ocean warming on subtropical and temperate corals and coral reefs? A systematic map

Authors: Man Lim Ho, Malgorzata Lagisz, Shinichi Nakagawa, Sarah Perkins-Kirkpatrick, Paige Sawyers, Charlotte Page, Bill Leggat, Troy Gaston, Alistair J. Hobday, Zoe Richards, Tracy Ainsworth

Source: Environmental Evidence, Vol 13, Iss 1, Pp 1-28 (2024)

Subject Terms: Coral, Coral reefs, Scleractinian, High latitude, Marginal, Ocean warming, Environmental sciences, GE1-350

File Description: electronic resource

Relation: https://doaj.org/toc/2047-2382

Access URL: https://doaj.org/article/e3bf4543523a48c8bf36d59ce35957e3

Transparent reporting items for simulation studies evaluating statistical methods: Foundations for reproducibility and reliability

Authors: Coralie Williams, Yefeng Yang, Malgorzata Lagisz, Kyle Morrison, Lorenzo Ricolfi, David I. Warton, Shinichi Nakagawa

Source: Methods in Ecology and Evolution, Vol 15, Iss 11, Pp 1926-1939 (2024)

Subject Terms: meta‐research, Monte Carlo simulation, replicability, reporting checklist, reporting quality, reproducibility, Ecology, QH540-549.5, Evolution, QH359-425

File Description: electronic resource

Relation: https://doaj.org/toc/2041-210X

Access URL: https://doaj.org/article/b40427ef995b4d9ba023e06e587204e5

Robust point and variance estimation for meta‐analyses with selective reporting and dependent effect sizes

Authors: Yefeng Yang, Malgorzata Lagisz, Coralie Williams, Daniel W. A. Noble, Jinming Pan, Shinichi Nakagawa

Source: Methods in Ecology and Evolution, Vol 15, Iss 9, Pp 1593-1610 (2024)

Subject Terms: effect size, evidence synthesis, meta research, meta‐analysis, mixed‐effects model, publication bias, Ecology, QH540-549.5, Evolution, QH359-425

File Description: electronic resource

Relation: https://doaj.org/toc/2041-210X

Access URL: https://doaj.org/article/458ac4d5b1ad4014bb2fef554c709940

A systematic review and meta-analysis of eyespot anti-predator mechanisms

Authors: Ayumi Mizuno, Malgorzata Lagisz, Pietro Pollo, Yefeng Yang, Masayo Soma, Shinichi Nakagawa

Source: eLife, Vol 13 (2024)

Subject Terms: aves, butterfly, caterpillar, interspecific communication, predator-prey interaction, warning signal, Medicine, Science, Biology (General), QH301-705.5

File Description: electronic resource

Relation: https://elifesciences.org/articles/96338; https://doaj.org/toc/2050-084X

Access URL: https://doaj.org/article/2681f89246b14087ad5d81dda33b5914

A research synthesis of humans, animals, and environmental compartments exposed to PFAS: A systematic evidence map and bibliometric analysis of secondary literature

Authors: Lorenzo Ricolfi, Catharina Vendl, Jennifer Bräunig, Matthew D. Taylor, Daniel Hesselson, G. Gregory Neely, Malgorzata Lagisz, Shinichi Nakagawa

Source: Environment International, Vol 190, Iss , Pp 108860- (2024)

Subject Terms: PFOA, PFOS, Forever chemicals, Systematic review, Health, Ecotoxicology, Environmental sciences, GE1-350

File Description: electronic resource

Relation: http://www.sciencedirect.com/science/article/pii/S016041202400446X; https://doaj.org/toc/0160-4120

Access URL: https://doaj.org/article/eb4faed9fa14400ba5f516171c1eb235

Collaboration and term usage dynamics in agricultural buffer strip research: Research weaving

Authors: Sarah Young, Malgorzata Lagisz, Max W. Callaghan, Shinichi Nakagawa, Neal R. Haddaway

Source: Ecological Solutions and Evidence, Vol 5, Iss 3, Pp n/a-n/a (2024)

Subject Terms: bibliographic coupling, bibliometrics, buffer strips, co‐authorship networks, evidence synthesis, research weaving, Environmental sciences, GE1-350, Ecology, QH540-549.5

File Description: electronic resource

Relation: https://doaj.org/toc/2688-8319

Access URL: https://doaj.org/article/8d068278850a4808b98ce668fac7be53

Four principles for improved statistical ecology

Authors: Gordana Popovic, Tanya Jane Mason, Szymon Marian Drobniak, Tiago André Marques, Joanne Potts, Rocío Joo, Res Altwegg, Carolyn Claire Isabelle Burns, Michael Andrew McCarthy, Alison Johnston, Shinichi Nakagawa, Louise McMillan, Kadambari Devarajan, Patrick Leo Taggart, Alison Wunderlich, Magdalena M. Mair, Juan Andrés Martínez‐Lanfranco, Malgorzata Lagisz, Patrice Pottier

Source: Methods in Ecology and Evolution, Vol 15, Iss 2, Pp 266-281 (2024)

Subject Terms: HARKing, model assumptions, p‐hacking, pre‐registration, p‐values, questionable research practices, Ecology, QH540-549.5, Evolution, QH359-425

File Description: electronic resource

Relation: https://doaj.org/toc/2041-210X

Access URL: https://doaj.org/article/34314350f79a4ffa95dd5ca7959103ef

Realism and robustness require increased sample size when studying both sexes

Authors: Szymon M. Drobniak, Malgorzata Lagisz, Yefeng Yang, Shinichi Nakagawa

Source: PLoS Biology, Vol 22, Iss 4 (2024)

Subject Terms: Biology (General), QH301-705.5

File Description: electronic resource

Relation: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11008793/?tool=EBI; https://doaj.org/toc/1544-9173; https://doaj.org/toc/1545-7885

Access URL: https://doaj.org/article/23427aa382fe46d4af9fe7a02a6a54bd

orchaRd 2.0: An R package for visualising meta‐analyses with orchard plots

Authors: Shinichi Nakagawa, Malgorzata Lagisz, Rose E. O'Dea, Patrice Pottier, Joanna Rutkowska, Alistair M. Senior, Yefeng Yang, Daniel W. A. Noble

Source: Methods in Ecology and Evolution, Vol 14, Iss 8, Pp 2003-2010 (2023)

Subject Terms: caterpillar plot, credibility interval, credible interval, evidence synthesis, graphical tools, meta‐regression, Ecology, QH540-549.5, Evolution, QH359-425

File Description: electronic resource

Relation: https://doaj.org/toc/2041-210X

Access URL: https://doaj.org/article/9617578f254146c98c5c5456f2b6d2a3

Finding the right power balance: Better study design and collaboration can reduce dependence on statistical power.

Authors: Shinichi Nakagawa, Malgorzata Lagisz, Yefeng Yang, Szymon M Drobniak

Source: PLoS Biology, Vol 22, Iss 1, p e3002423 (2024)

Subject Terms: Biology (General), QH301-705.5

File Description: electronic resource

Relation: https://doaj.org/toc/1544-9173; https://doaj.org/toc/1545-7885

Access URL: https://doaj.org/article/7cd0d1f394354071a34082ccea864202

Profiling research on PFAS in wildlife: Systematic evidence map and bibliometric analysis

Authors: Catharina Vendl, Matthew D. Taylor, Jennifer Bräunig, Lorenzo Ricolfi, Radiah Ahmed, Maegan Chin, Matthew J. Gibson, Daniel Hesselson, G. Gregory Neely, Malgorzata Lagisz, Shinichi Nakagawa

Source: Ecological Solutions and Evidence, Vol 5, Iss 1, Pp n/a-n/a (2024)

Subject Terms: evidence synthesis, persistent organic pollutants, research synthesis, science mapping, systematic review, Environmental sciences, GE1-350, Ecology, QH540-549.5

File Description: electronic resource

Relation: https://doaj.org/toc/2688-8319

Access URL: https://doaj.org/article/29222177586a42a1a99c4604f61c6cbd

A systematic map of studies testing the relationship between temperature and animal reproduction

Authors: Liam R. Dougherty, Fay Frost, Maarit I. Maenpaa, Melissah Rowe, Benjamin J. Cole, Ramakrishnan Vasudeva, Patrice Pottier, Eva Schultner, Erin L. Macartney, Ina Lindenbaum, Jamie L. Smith, Pau Carazo, Marco Graziano, Hester Weaving, Berta Canal Domenech, David Berger, Abhishek Meena, Tom Rhys Bishop, Daniel W. A. Noble, Pedro Simões, Julian Baur, Merel C. Breedveld, Erik I. Svensson, Lesley T. Lancaster, Jacintha Ellers, Alessio N. De Nardo, Marta A. Santos, Steven A. Ramm, Szymon M. Drobniak, Matteo Redana, Cristina Tuni, Natalie Pilakouta, Z. Valentina Zizzari, Graziella Iossa, Stefan Lüpold, Mareike Koppik, Regan Early, Clelia Gasparini, Shinichi Nakagawa, Malgorzata Lagisz, Amanda Bretman, Claudia Fricke, Rhonda R. Snook, Tom A. R. Price

Source: Ecological Solutions and Evidence, Vol 5, Iss 1, Pp n/a-n/a (2024)

Subject Terms: climate change, egg, evidence map, sperm, sterility, systematic review, Environmental sciences, GE1-350, Ecology, QH540-549.5

File Description: electronic resource

Relation: https://doaj.org/toc/2688-8319

Access URL: https://doaj.org/article/1dcf45e0c07a4f36a5466ba83ffc46ca

The influence of immune challenges on the mean and variance in reproductive investment: a meta-analysis of the terminal investment hypothesis

Authors: Yong Zhi Foo, Malgorzata Lagisz, Rose E. O’Dea, Shinichi Nakagawa

Source: BMC Biology, Vol 21, Iss 1, Pp 1-24 (2023)

Subject Terms: Life-history theory, Phenotypic plasticity, Fecundity compensation, Reproduction, Trade-offs, Biology (General), QH301-705.5

File Description: electronic resource

Relation: https://doaj.org/toc/1741-7007

Access URL: https://doaj.org/article/d2270ecb95da45e493b69a3496bf1a18

Next steps after airing disagreement on a scientific issue with policy implications: a meta-analysis, multi-lab replication and adversarial collaboration

Authors: Shinichi Nakagawa, Malgorzata Lagisz

Source: BMC Biology, Vol 21, Iss 1, Pp 1-4 (2023)

Subject Terms: Replication crisis, Null hypothesis significance testing, Statistics, Team science, Open science, Reproducibility, Biology (General), QH301-705.5

File Description: electronic resource

Relation: https://doaj.org/toc/1741-7007

Access URL: https://doaj.org/article/d1ec7ecdb52843a0bc80f5e18578549f

Method Reporting with Initials for Transparency (MeRIT) promotes more granularity and accountability for author contributions

Authors: Shinichi Nakagawa, Edward R. Ivimey-Cook, Matthew J. Grainger, Rose E. O’Dea, Samantha Burke, Szymon M. Drobniak, Elliot Gould, Erin L. Macartney, April Robin Martinig, Kyle Morrison, Matthieu Paquet, Joel L. Pick, Patrice Pottier, Lorenzo Ricolfi, David P. Wilkinson, Aaron Willcox, Coralie Williams, Laura A. B. Wilson, Saras M. Windecker, Yefeng Yang, Malgorzata Lagisz

Source: Nature Communications, Vol 14, Iss 1, Pp 1-5 (2023)

Subject Terms: Science

File Description: electronic resource

Relation: https://doaj.org/toc/2041-1723

Access URL: https://doaj.org/article/ccaef5860ea54a3b97ab70c62404704e

Publication bias impacts on effect size, statistical power, and magnitude (Type M) and sign (Type S) errors in ecology and evolutionary biology

Authors: Yefeng Yang, Alfredo Sánchez-Tójar, Rose E. O’Dea, Daniel W. A. Noble, Julia Koricheva, Michael D. Jennions, Timothy H. Parker, Malgorzata Lagisz, Shinichi Nakagawa

Source: BMC Biology, Vol 21, Iss 1, Pp 1-20 (2023)

Subject Terms: Open science, Replicability, Reproducibility, Transparency, Selective reporting, Questionable research practices, Biology (General), QH301-705.5

File Description: electronic resource

Relation: https://doaj.org/toc/1741-7007

Access URL: https://doaj.org/article/2a4b1025b77e4f01bb81524558a5b0fd

Quantitative evidence synthesis: a practical guide on meta-analysis, meta-regression, and publication bias tests for environmental sciences

Authors: Shinichi Nakagawa, Yefeng Yang, Erin L. Macartney, Rebecca Spake, Malgorzata Lagisz

Source: Environmental Evidence, Vol 12, Iss 1, Pp 1-19 (2023)

Subject Terms: Hierarchical models, Robust variance estimation, Spatial dependency, Variance–covariance matrix, Meta-analysis of variance, Missing data, Environmental sciences, GE1-350

File Description: electronic resource

Relation: https://doaj.org/toc/2047-2382

Access URL: https://doaj.org/article/d71046bff5074056816375e94a377f23

Evidence base for non-genetic inheritance of environmental exposures in non-human animals and plants: a map of evidence syntheses with bibliometric analysis

Authors: Erin L. Macartney, Szymon M. Drobniak, Shinichi Nakagawa, Malgorzata Lagisz

Source: Environmental Evidence, Vol 12, Iss 1, Pp 1-16 (2023)

Subject Terms: Environmental effects, Scoping review, Inter-generational inheritance, Trans-generational inheritance, Maternal effects, Paternal effects, Environmental sciences, GE1-350

File Description: electronic resource

Relation: https://doaj.org/toc/2047-2382

Access URL: https://doaj.org/article/51c96d0a93b241f58912c62e9c84bde8