Everything Hertz

We chat about two new studies that took different approaches for evaluating the impact of paying reviewers on peer review speed and quality. Links * James' 450 movement proposal (https://jamesheathers.medium.com/the-450-movement-1f86132a29bd) * The paper (https://journals.lww.com/ccmjournal/fulltext/9900/effect_of_monetary_incentives_on_peer_review.488.aspx) from Critical Care Medicine * The preprint (https://www.biorxiv.org/content/10.1101/2025.03.18.644032v1) from Biology Open Other links - Dan on Bluesky (https://bsky.app/profile/dsquintana.bsky.social) - James on Bluesky (https://bsky.app/profile/jamesheathers.bsky.social) - Everything Hertz on Bluesky (https://bsky.app/profile/hertzpodcast.bsky.social) Citation Quintana, D. S., & Heathers, J. (2025, April 2). 190: What happens when you pay reviewers?, Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/PHQ2K

Dan and James discuss a recent piece that proposes a post-publication review process, which is triggered by citation counts. They also cover how an almetrics trigger could be alternatively used for a more immediate post-publication critique. Links * The Chonicle piece (https://www.chronicle.com/article/social-science-is-broken-heres-how-to-fix-it?sra=true) by Andrew Gelman and Andrew King [Free to read with email registration] * The paper (https://psycnet.apa.org/fulltext/2022-14587-001.html) by Peder Isager and collegues on how to decide what papers we should replicate. Here is the preprint (https://files.de-1.osf.io/v1/resources/2gurz/providers/osfstorage/5f4f4314a392b9002f1d9576?action=download&direct&version=2). * The ERROR project (https://error.reviews/about/) Other links Everything Hertz on Bluesky - Dan on Bluesky (https://bsky.app/profile/dsquintana.bsky.social) - James on Bluesky (https://bsky.app/profile/jamesheathers.bsky.social) - Everything Hertz on Bluesky (https://bsky.app/profile/hertzpodcast.bsky.social) Citation Quintana, D. S., & Heathers, J. (2025, Mar 2). 189: Crit me baby, one more time, Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/3X5UR

Dan and James discuss a recent editorial which argues that double-blind peer review is detrimental to scientific integrity. Links * The editorial from Christopher Mebane: https://doi.org/10.1093/etojnl/vgae046 Other links Everything Hertz on Bluesky - Dan on Bluesky (https://bsky.app/profile/dsquintana.bsky.social) - James on Bluesky (https://bsky.app/profile/jamesheathers.bsky.social) - Everything Hertz on Bluesky (https://bsky.app/profile/hertzpodcast.bsky.social) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Citation Quintana, D. S., & Heathers, J. (2025, Jan 30). Double-blind peer review vs. scientific integrity, Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/6XS29

We chat about the events that started the replication crisis in psychology and Dorothy Bishop's recent resignation from the Royal Society Links * The resignation blogpost (http://deevybee.blogspot.com/2024/11/why-i-have-resigned-from-royal-society.html) from Dorothy Bishop * The bluesky post (https://bsky.app/profile/sarahwieten.bsky.social/post/3lbtsqc6jcs2z) from Sarah Weiten that asked the question, "If you had to cite an event that opened the "replication crisis" era, what would you point to?" * The "Year of Horrors" paper (https://www.ejwagenmakers.com/2012/Wagenmakers2012Horrors.pdf) from Eric-Jan Wagenmakers Other links Everything Hertz on Bluesky - Dan on Bluesky (https://bsky.app/profile/dsquintana.bsky.social) - James on Bluesky (https://bsky.app/profile/jamesheathers.bsky.social) - Everything Hertz on Bluesky (https://bsky.app/profile/hertzpodcast.bsky.social) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Citation Quintana, D. S., & Heathers, J. (2024, Dec 3). 187: What started the replication crisis era?, Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/EC7QH

In this episode we chat about a Nordic approach for evaluating the journal quality and how we should be teaching undergraduates to evaluate journal and article quality Links * The Norwegian journal register (https://kanalregister.hkdir.no/en/informasjonsartikler/about-the-norwegian-register) * The Finnish journal register (https://julkaisufoorumi.fi/en/publication-forum) * Episode 22 (https://everythinghertz.com/22), where we played "Pokemon or Cholesterol medication?" Other links Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Citation Quintana, D. S., & Heathers, J. (2024, Nov 13). 186: Evaluating journal quality, Everything Hertz [Audio podcast], https://doi.org/10.17605/OSF.IO/KB37U

We discuss the recent retraction of a paper that reported the effects of rigour-enhancing practices on replicability. We also cover James' new estimate that 1 out of 7 scientific papers are fake. Links * The story (https://www.nature.com/articles/d41586-024-02907-3) about data integrity concerns in 130 women's health papers * James' new preprint (https://osf.io/23zcr) with the estimate that 1 out of 7 scientific papers are fake * The retracted paper in Nature Human Behavior (https://www.nature.com/articles/s41562-023-01749-9) by Protzko and coworkers * The Matters Arising article (https://rdcu.be/dVXN8) from Bak-Coleman and Devezer, who initially raised concerns about the paper from Protzko and coworkers. * The Everything Hertz merch store (https://everything-hertz-podcast.creator-spring.com) * The paper (https://journals.sagepub.com/doi/10.1177/0165551507086261) about puns/jokes in paper titles * The "Everything Hertz" paper (https://www.frontiersin.org/journals/physiology/articles/10.3389/fphys.2014.00177/full) from James * Dan's only paper (https://www.biologicalpsychiatryjournal.com/article/S0006-3223(15)00528-4/abstract) with a pun in the title Other links Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Citation Quintana, D. S., & Heathers, J. (2024, Oct 4). 185: The Retraction, Everything Hertz [Audio podcast], https://doi.org/10.17605/OSF.IO/528SF

Open access articles have democratized the availability of scientific research, but are author-paid publication fees undermining the quality of science? The preprint by Morgan and Smaldino - https://osf.io/preprints/osf/3ez9v Paul Smaldino's text book - Modeling social behavior (https://press.princeton.edu/books/paperback/9780691224145/modeling-social-behavior) Main edisode takeaways (AI-assisted summary) There is a wide variability in the quality of papers published in gold open access journals and a wide variate of open access journals, some of which prioritise quality research Diamond open access and green open access are alternative models to consider. The publishing industry needs more transparency and mandatory reporting of data. The pressure to publish more can lead to a crowding out problem and a focus on quantity over quality. Determining the quality of journals and papers is challenging, and there are varying levels of quality within different tiers of journals. Fraudulent publishing practices, such as paper mills and fake papers, can be facilitated by the market for publishing. The Publons service (R.I.P) and similar platforms can improve the transparency of peer review and provide a record of reviewers' contributions. Society journals may offer a better publishing model as they have a reputation to maintain and are less likely to prioritize quantity over quality. Other links Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Citation Quintana, D. S., & Heathers, J. (2024, Sept 5). 184: A race to the bottom, Everything Hertz [Audio podcast], https://doi.org/10.17605/OSF.IO/3MUJV

Dan and James discuss a paper describing a journal editor's efforts to receive data from authors who submitted papers with results that seemed a little too beautiful to be true Main edisode takeaways (AI generated summary) * This editorial on the reproducibility crisis emphasizes the importance of providing raw data in scientific publications and highlights the need for transparency and accountability in the research process * The lack of oversight and the discrepancy between the amount of data required for scientific statements and what is often provided in academic publishing is a cause for concern. * Ensuring the integrity of scientific research requires the active involvement of editors, reviewers, and researchers in promoting transparency and upholding ethical standards. The scientific publishing process lacks oversight and accountability, leading to potential issues with the accuracy and trustworthiness of published papers. * Journals should prioritize maintaining high standards and ensuring that papers are thoroughly reviewed and validated before publication. * Changing behaviors within the scientific community, such as pledging to publish in open access journals, can promote positive change and improve research integrity. * There is a need for active maintenance and improvement of the systems and parameters of scientific research to prevent potential negative consequences. Links for papers we mentioned * The Molecular Brain editorial by Miyakawa: https://doi.org/10.1186/s13041-020-0552-2 * The STALT preprint: https://osf.io/6hste Other links Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Citation Quintana, D. S., & Heathers, J. (2024, Aug 3). 183: Too beautiful to be true Everything Hertz [Audio podcast], https://doi.org/10.17605/OSF.IO/JF5MS

Dan and James answer a listener question on what practices should the behavioural sciences borrow (and ignore) from other research fields. Here are the main takeaways: Keeping laboratory records and using electronic lab management software is beneficial practices biology that would benefit the behavioral sciences The rate of pre-registration of meta-analysis in psychology is low, unlike other fields, which have a higher pre-registration rate. Here is the preprint on pre-registration of psychology meta-analyses that was mentioned: https://doi.org/10.31222/osf.io/627a4 Case studies (somewhat common in medicine) can provide valuable insights, especially when there is aggressive sampling and oversampling of single points Double-blinded should not be adopted. as these can be challenging to implement effectively and may not always work as intended Philosophers often (but not always) have a clear writing style and structure their arguments well, which can be enjoyable to read and should be more widely adopted The publishing industry needs more innovation, particularly in the areas of peer review and editorial processes Other links Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Citation Quintana, D. S., & Heathers, J. (2024, July 2). 182: What practices should the behavioural sciences borrow (and ignore) from other research fields? Everything Hertz [Audio podcast], https://doi.org/10.17605/OSF.IO/XN8DT

We discuss how following citation chains in psychology can often lead to unexpected places, and how this can contribute to unreplicable findings. We also discuss why team science has taken longer to catch on in psychology compared to other research fields. Here is the preprint that we mentioned authored by Andrew Gelman and Nick Brown - https://osf.io/preprints/psyarxiv/ekmdf Our episode with Nick Brown - https://everythinghertz.com/44 Other links Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Citation Quintana, D.S., Heathers, J.A.J. (Hosts). (2024, June 3) "181: Down the rabbit hole", Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/C7F9N

Dan and James discuss why innovation in scientific publishing is so hard, an emerging consortium peer review model, and a recent replication of the 'refilling soup bowl' study. Other things they cover and links: * Which studies should we spend time replicating? * The business models of for-profit scientific publishers * How many tacos can you buy with the money it costs to publish open access in Nature? * The original soup bowl study: https://doi.org/10.1038/oby.2005.12 * The replication study: https://doi.org/10.1037/xge0001503 * The Peer Community In initiative: https://peercommunityin.org/ * Stuart Buck's newsletter: https://goodscience.substack.com Other links Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Citation Quintana, D.S., Heathers, J.A.J. (Hosts). (2024, May 2) "180: Consortium peer reviews", Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/24FMP

Dan and James discuss how scientific research often neglects the importance of maintenance and long-term access for scientific tools and resources. Other things they cover: Should there be an annual limit on publications (even if this were somehow possible)? The downsides of PhD by publication The Gates Foundation's new Open Access policy Other links Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Citation Quintana, D.S., Heathers, J.A.J. (Hosts). (2024, April 3) "179: Discovery vs. maintenance", Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/KS8PV

Dan and James discuss the Retractobot service, which emails authors about papers they've cited that have been retracted. What should authors do if they discover a paper they've cited has been retracted after they published their paper? Other things they chat about A listener question about including examiner's comments in thesis The different types of retractions and thier impact Why aren't versioning systems more common in scientific publishing? Other links Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Citation Quintana, D.S., Heathers, J.A.J. (Hosts). (2024, February 29) "178: Alerting researchers about retractions", Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/T8HRD

We discuss two recent plagiarism cases, one you've probably heard about and another that you probably haven't heard about if you're outside Norway. We also chat about the parallels between plagiarism and sports doping—would people reconsider academic dishonesty if they were reminded that future technology may catch them out? Here are some of the takeaways from the episode (generated with the help of AI): Plagiarism cases can range from minor academic practice issues to more serious instances of copying verbatim The detection and punishment of plagiarism can vary depending on the context, such as academic journals or internal university issues. The mindset and motivations behind plagiarism can differ between athletes and students, with athletes often driven by intense competition. Long-term detectability and the potential consequences of cheating are factors that may discourage individuals from engaging in plagiarism. Addressing plagiarism requires a balance between identifying genuine cases and avoiding ideological biases. Other links Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Citation Quintana, D.S., Heathers, J.A.J. (Hosts). (2024, January 31) "177: Plagiarism", Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/4M3F2

We chat about a paper on the invisible workload of open science and why academics are so bad at tracking their workloads. This episode was originally recorded in May 2023 in a hotel room just before our live recording of Episode 169, which is why we refer to the paper as a 'new' paper near the start of the episode. Links * The paper (https://journal.trialanderror.org/pub/the-invisible-workload/release/1) on the invisible workload of open research * Our live and in-person episode (https://everythinghertz.com/169) with Sandra Matz on using big data to understand behavior Other links Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Citation Quintana, D.S., Heathers, J.A.J. (Hosts). (2023, December 29) "176: Tracking academic workloads", Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/U84JC

We chat about a recent blogpost from Dorothy Bishop, in which she proposes a Master course that will provide training in fraud detection—what should such a course specifically teach and where would these people work to apply their training? We also discuss whether open science is a cult that has trouble seeing outward. Links * The blog post (https://deevybee.blogspot.com/2023/11/defence-against-dark-arts-proposal-for.html) on the Master in dark arts defence from Dorothy Bishop * The blog post (https://statmodeling.stat.columbia.edu/2023/11/29/why-i-continue-to-support-the-science-reform-movement-despite-its-flaws/) on whether open science is a cult from Andrew Gelman Other links Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Citation Quintana, D.S., Heathers, J.A.J. (Hosts). (2023, December 7) "175: Defending against the scientific dark arts", Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/K2J7N

James proposes proposes a new type of consortium paper that could provide collaborative opportunities for researchers from countries that are underrepresented in published research papers. We also talk about computational reproducibility and paper publication bonuses. Links The paper from Steve Lindsay on computational reproducbility: A Plea to Psychology Professional Societies that Publish Journals: Assess Computational Reproducibility (https://doi.org/10.15626/MP.2023.4020) Other links Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Citation Quintana, D.S., Heathers, J.A.J. (Hosts). (2023, October 31) "174: Smug missionaries with test tubes", Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/FBHRZ

Dan and James discuss a recent paper that investigated how science journalists evaluate psychology papers. To answer this question, the researchers presented science journalists with fictitious psychology studies and manipulated sample size, sample representativeness, p-values, and institutional prestige Links * The paper (https://doi.org/10.1177/25152459231183912) on how science journalists evaluate psychology papers * The preprint paper (https://www.biorxiv.org/content/10.1101/2023.09.19.558509v1) on small samples * Laboratory Life (https://press.princeton.edu/books/paperback/9780691028323/laboratory-life) by Bruno Latour Other links Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Citation Quintana, D.S., Heathers, J.A.J. (Hosts). (2023, September 30) "173: How do science journalists evaluate psychology papers?", Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/SG4BM

Dan and James discuss a recent proposal to do away with discussion sections and suggest other stuff they'd like to get rid of from academic publishing. Links * The paper (https://doi.org/10.1007/s11229-023-04267-3) on the proposed elimiation of the discussion section * The paper (https://doi.org/10.1177/2515245920970949) on machine readable hypothesis tests * Our episodes (https://everythinghertz.com/guests/daniel-lakens) with Daniel Lakens * Our episode (https://everythinghertz.com/78) with Lisa DeBruine Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Citation Quintana, D.S., Heathers, J.A.J. (Hosts). (2023, August 31) "172: In defence of the discussion section", Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/N3SFT

We chat with Daniel Simons and Christopher Chabris about the science of cons and how we can we can avoid being taken in. We also cover the fate of the gorilla suit from the 'invisible gorilla' study, why scientists are especially prone to being fooled, plus more! Buy Daniel and Christopher's new book, Nobody's fool, from your favourite bookseller here (https://www.hachettebookgroup.com/titles/daniel-simons/nobodys-fool/9781541602236/). Other links Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Citation Quintana, D.S., Heathers, J.A.J. (Hosts). (2023, July 20) "171: The easiest person to fool is yourself (with Daniel Simons and Christopher Chabris)", Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/F8SMR Special Guests: Christopher Chabris and Daniel Simons.

We discuss evidence of data tampering in a series of experiments investigating dishonesty revealed via excel spreadsheet metadata and how traditional peer review is not suited for the detection of data tampering. Links Data colada post 1 (https://datacolada.org/109) The conceptual replication attempt (https://www.mdpi.com/2076-328X/7/2/28) in Guatemalan taxpayers The paper (https://rdcu.be/dfdS8) on using caution when applying behavioural science to policy Data colada post 2 (https://datacolada.org/110) The carthorse child (https://hackernoon.com/introducing-sprite-and-the-case-of-the-carthorse-child-58683c2bfeb#.o9um9unoj) Other links Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Citation Quintana, D.S., Heathers, J.A.J. (Hosts). (2023, June 23) "170: Holy Sheet", Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/DW2C7

In our first ever live and in-person episode, we chat with Sandra Matz about the opportunities and challenges for using big data to understand human behavior Links Everybody lies book (https://www.amazon.com/Everybody-Lies-Internet-About-Really/dp/0062390856), by Seth Stephens-Davidowitz A paper (https://link.springer.com/article/10.3758/s13428-015-0630-z) on "Born open" data Other links Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Citation Quintana, D.S., Heathers, J.A.J. (Hosts). (2023, May 31) "169: Using big data to understand behavior (Live episode with Sandra Matz)", Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/JDXHF Special Guest: Sandra Matz.

Dan and James discuss a new paper that reviews potential issues in metascience practices. They also talk about their upcoming live show in May in Frankfurt. Links Our upcoming show on May 8th, which will be a part of the at the 4th symposium on big data and research syntheses in psychology symposium (https://conference-service.com/ressyn-bigdata-2023/xpage.html?xpage=243&lang=en) to be held in Frankfurt, Germany The paper (https://journal.trialanderror.org/pub/questionable-metascience-practices/release/3) we discuss from Mark Rubin Peder Isager and team's paper on what to replicate (https://pubmed.ncbi.nlm.nih.gov/34928679/) Other links Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Citation Quintana, D.S., Heathers, J.A.J. (Hosts). (2023, April 26) "168: Meta-meta-science", Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/CSJ3X

Dan and James chat about a new study that uses homeopathy studies to evaluate bias in biomedical research, a new-ish type of authorship fraud, and the potential for Chat GPT peer-review. Links The Chat GPT paper library tweet (https://twitter.com/michelnivard/status/1625786225725526016?s=20) The Homeopathy paper (https://www.jclinepi.com/article/S0895-4356(23)00010-0/fulltext) The David Grimes paper (https://doi.org/10.1111/j.2042-7166.2012.01162.x) British dental journal paper on fraud (https://doi.org/10.1038/s41415-023-5514-5) The AHealthcareZ YouTube channel (https://www.youtube.com/@ahealthcarez) The FittDesign Studio YouTube channel (https://www.youtube.com/@fittdesign.studio) Other links Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Citation Quintana, D.S., Heathers, J.A.J. (Hosts). (2023, March 16) "167: Diluted effect sizes", Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/H847F

Dan and James discuss a recent paper that claims that science is becoming less disruptive over time and the suggested causes for this decline. Links * Our prior episode (https://everythinghertz.com/165), which discussed PhD defences * The paper (https://www.nature.com/articles/s41586-022-05543-x) on disruption in science * The news piece (https://www.nature.com/articles/d41586-022-04577-5) on the paper Other links Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Citation Quintana, D.S., Heathers, J.A.J. (Hosts). (2023, January 25) "166: Is science becoming less disruptive over time?", Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/X6YS5

Dan and James chat about self-promotion in academia, how they both wish they had doctoral defences (these aren't a thing in Australia), and replacing error bars with the letter "t". Links and stuff * The now retracted paper (https://www.hindawi.com/journals/amse/2022/3802603/) with the error bars as "t"s * A direct link (https://www.hindawi.com/journals/amse/2022/3802603/fig9/) to the figure * The blog post on self-promotion, titled "The End of Decency: When Self-Promotion Goes Too Far" https://www.insidehighered.com/advice/2022/12/09/why-too-much-public-self-promotion-academics-damaging-opinion Other links Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Citation Quintana, D.S., Heathers, J.A.J. (Hosts). (2022, December 30) "165: Self-promotion", Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/U2N9Q

James and Dan discuss the recent migration of scientists from Twitter to Mastodon and the pros and cons of sharing the prior submission history of manuscripts The Mastodon thread (https://mas.to/@SteinbockGroup/109385540133459884) discussion the submission history policy in American Chemical Society Journals The "Weekend at Bernies" film (https://en.wikipedia.org/wiki/Weekend_at_Bernie%27s) Our new Mastodon account: @hertzpodcast@mas.to (https://mas.to/@hertzpodcast) James' leaf blower man haiku (https://techhub.social/@jamesheathers/109394055056309720) Other links Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Citation Quintana, D.S., Heathers, J.A.J. (Hosts). (2022, November 28) "164: The great migration", Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/ZBJQS

Dan and James discuss eLife's new peer review model, in which they no longer make accept/reject decisions at the end of the peer-review process. Instead, papers invited for peer review will receive an assessment from eLife and the peer reviews will be shared on eLife's website. It's up to author if they would like revise their manuscript or publish their paper as the version of record. eLife's announment (https://elifesciences.org/inside-elife/54d63486/elife-s-new-model-changing-the-way-you-share-your-research) A editorial (https://elifesciences.org/articles/83889) from Michael Eisen and team Episode 122 (https://everythinghertz.com/122): Reoptimizing scientific publishing for the internet age (with Michael Eisen) Episode 123 (https://everythinghertz.com/123): Authenticated anonymity (with Michael Eisen) A paper (http://www.ejwagenmakers.com/2009/IversonEtAl2009Agony.pdf) describing p-rep Other links Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Citation Quintana, D.S., Heathers, J.A.J. (Hosts). (2022, November 7) "163: eLife's new peer review model", Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/XYBU5

We chat about a recent preprint describing an experiment on the role of author status in peer-review, dodgy conference proceedings journals, and authorships for sale. Links * James' blogpost (https://jamesheathers.medium.com/publication-laundering-95c4888afd21) on conference proceedings journals * The preprint/working paper (https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4190976) on status bias Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Citation Quintana, D.S., Heathers, J.A.J. (Hosts). (2022, October 17) "162: Status bias in peer review", Everything Hertz [Audio podcast], DOI: 110.17605/OSF.IO/WX2A7

Dan and James are joined by Brian Nosek (Co-founder and Executive Director of the Center for Open Science) to discuss the recent White House Office of Science Technology & Policy memo ensuring free, immediate, and equitable access to federally funded research. They also cover the implications of this memo for scientific publishing, as well as the mechanics of culture change in science. Open Science Framework hits half a million users (https://www.cos.io/blog/celebrating-a-global-open-science-community) The White house memo (https://www.whitehouse.gov/wp-content/uploads/2022/08/08-2022-OSTP-Public-Access-Memo.pdf) Brian on Twitter (https://twitter.com/BrianNosek) Other links Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Citation Quintana, D.S., Heathers, J.A.J. (Hosts). (2022, August 31) "161: The memo (with Brian Nosek)", Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/A7D86 Special Guest: Brian Nosek.

Dan and James share ten rules for whistleblowing academic misconduct. The Safe Faculty Project (https://www.safefacultyproject.org/) website SLAPP statues https://en.wikipedia.org/wiki/Strategiclawsuitagainstpublicparticipation Other links Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month

Dan and James are joined by Saloni Dattani for a chat about the history of peer review, a reimagination of what peer review could look like, what happens when you actually pay peer reviewers, peer reviewer specialisation, post publication peer review, annual paper limits for authors, automation in peer review, and Big Cheese. Links * Works in Progress magazine (https://www.worksinprogress.co/) * One of the many news stories (https://www.euronews.com/next/2022/08/04/this-cheese-could-be-the-latest-superfood-with-unique-properties-to-improve-bone-health) about the Jarsberg cheese study * The actual study (https://nutrition.bmj.com/content/early/2022/06/29/bmjnph-2022-000424) * Saloni's peer review piece (https://www.worksinprogress.co/issue/real-peer-review/) * The F1000 format (https://f1000research.com/) * Our episode (https://everythinghertz.com/74) with Elisabeth Bik * PCI registered reports (https://rr.peercommunityin.org/) * Saloni on Twitter (https://twitter.com/salonium) Other links Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Special Guest: Saloni Dattani.

By popular demand, Dan and James chat about journal word and page limits.They also the debate around a recent meta-analysis on nudge interventions. Links * The PNAS nudge meta-analysis (https://doi.org/10.1073/pnas.2107346118) * The response letter (https://doi.org/10.1073/pnas.2200300119) * The paper (https://link.springer.com/article/10.1007/s11192-022-04453-z) on adjectives and adverbs in life sciences Other links Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month

Dan and James discuss a new preprint that examined the types of limitations authors discuss in their published articles and whether these limitation types has changed over the past decade, especially in light of methodological reform efforts. Links * The Genetic Lottery (https://press.princeton.edu/books/hardcover/9780691190808/the-genetic-lottery)by Kathryn Paige Harden * The limitations preprint (https://psyarxiv.com/n4eq7/) by Beth Clarke and collegues * Simine Vazire's episode (https://everythinghertz.com/58) (also known as the one where Dan's wife starts going into labor) * The heartbeat paper (https://www.sciencedirect.com/science/article/pii/S0010945222000685) from Galvez-Pol and collegues * Rand Wilcox and robust statistical methods (https://link.springer.com/article/10.3758/s13428-019-01246-w#article-info) * The tweet thread explainer (https://twitter.com/bethclarke_/status/1544646323684917248) from Beth Clarke Other links Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month

Dan and James discuss a recent paper that concluded (again) that most researchers aren't compliant with their published data sharing statement and whether torrents (remember them?) are a viable alternative for sharing large datasets. Links * The data request paper (https://www.sciencedirect.com/science/article/abs/pii/S089543562200141X) * The paper (https://onlinelibrary.wiley.com/doi/full/10.1111/psyp.13688) Dan and James co-authored led by Julian Koenig * Our episode (https://everythinghertz.com/79) with Henry Drysdale * Our episode (https://everythinghertz.com/56) with Chris Chambers * The meta-psychology journal Other links Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) ​ Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! ​ - $1 per month: A 20% discount on Everything Hertz merchandise, a monthly newsletter, access to the occasional bonus episode, and the the warm feeling you're supporting the show - $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month

We chat about appeals to authority when responding to scientific critique, university ranking systems, Goodhart's law (and its origin), and private institutional review boards. Links * The history (https://en.wikipedia.org/wiki/Goodhart%27s_law) of Goodhart's law * The original (https://rdcu.be/cOraY) psychadelics paper in Nature Medicine * The critique (https://psyarxiv.com/a25wb/) * The response (https://psyarxiv.com/pdbf5/) to the critique Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, a monthly newsletter, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month

We chat about the Theranos story and the parallels with academic research, as well as Twitter's new owner and whether academics will actually leave the platform Links * Mastodon (https://en.wikipedia.org/wiki/Mastodon_(band)) (the band) * Elon Musk's Onion article (https://www.theonion.com/please-like-me-1848674003) * The Dropout podcast (https://abcaudio.com/podcasts/the-dropout/) * The Juicero (https://en.wikipedia.org/wiki/Juicero) * Bad Blood: The Final Chapter (https://podcasts.apple.com/us/podcast/bad-blood-the-final-chapter/id1575738174) podcast by John Carreyrou *  "Macho Man" Randy Savage (https://en.wikipedia.org/wiki/Randy_Savage) Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, a monthly newsletter, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month

We discuss a journal's new "wall of shame" page, which details unethical behaviours in an effort to discourage future misconduct. We also cover scientific ideas that won't die (but one idea that HAS died), and ECNP's "negative data" prize The audio quality of this recording isn't up to our usual standards as we were both travelling and without our normal recording gear. We'll be back with our normal gear next episode! Links * James' letter to the editor/obituary (https://physoc.onlinelibrary.wiley.com/doi/full/10.1113/expphysiol.2011.063867) on sympathovagal balance * The Mirror neuron book (https://www.amazon.com/Myth-Mirror-Neurons-Neuroscience-Communication/dp/0393089614) that Dan mentioned * The Wall of Shame (https://www.cureus.com/wall_of_shame) page * An archive (https://web.archive.org/web/20220412151018/https://www.cureus.com/wall_of_shame) of the Wall of Shame page if it gets taken down * A story (https://www.science.org/content/article/paul-brookes-surviving-outed-whistleblower) from 2014 on Paul Brooks and his Science Fraud website * Another story (https://retractionwatch.com/2014/03/11/so-what-happened-after-paul-brookes-was-forced-to-shut-down-science-fraud-org/) on Paul Brooks from Retraction Watch * News story: Missing Australian 'fraudster' could have cut off her own FOOT (https://www.dailymail.co.uk/news/article-9338203/Missing-Australian-fraudster-cut-FOOT.html) to trick police into thinking she is dead, cops say after body part is found * Best Negative Data Prize (https://www.ecnp.eu/research-innovation/awards/best-negative-data-prize) Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, a monthly newsletter, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month

James and Dan chat about apologies vs. non-apologies, how to decide when to call it quits on a paper, and governments vetoing research proposals recommended by their own funding agencies Links for stuff we mention * The tweet (https://twitter.com/seis_matters/status/1504456677176840195?s=20&t=26p1PhsNiUOaCVyAToadpg) from Chris Jackson that started it all * Chris Jackson's Hertz episode on the cumulative advantage of academic capital (https://everythinghertz.com/111) * The Science Diagrams that Look Like Shitposts twitter account (https://twitter.com/scienceshitpost) Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, a monthly newsletter, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month

Dan and James discuss a new preprint that details twelve p-hacking strategies and simulates their impact on false-positive rates. They also discuss the Great Resignation in academia and the academic job market. Links * The twitter discussion (https://twitter.com/EikoFried/status/1504374568357617666?s=20&t=u5-8GBwxmEyxOUGbHjt9cw) on Associate editor pay kicked off by Eiko Fried * The p-hacking paper (https://psyarxiv.com/xy2dk/) from Angelika Stefan and Felix Schönbrodt * The sample size preprint (https://psyarxiv.com/9d3yf/) from Daniel Lakens Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, a monthly newsletter, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month

We discuss the latest paper to seriously use the Kardashian index, which is the discrepancy between a scientist's publication record and social media following, and a listener question on whether original authors should get the last word when a comment on an article is submitted Links * The paper (https://bmjopen.bmj.com/content/12/2/e052891) on citation impact and social media visibility of Great Barrington and John Snow signatories for COVID-19 strategy * The Rapid Responses (https://bmjopen.bmj.com/content/12/2/e052891.responses) comments on the paper * The peer review reports (https://bmjopen.bmj.com/content/bmjopen/suppl/2022/02/15/bmjopen-2021-052891.DC1/bmjopen-2021-052891.RH.pdf) for the paper * Send us an audio question (https://everythinghertz.com/audio-question)! * About (https://pubpeer.com/static/about) PubPeer Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, a monthly newsletter, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month

Dan and James chat with cardiologist Rohin Francis about medical misinformation and how he uses YouTube for science communication via his 'Medlife Crisis' channel. Links to stuff that was mentioned: Rohin's YouTube channel (https://www.youtube.com/channel/UCgRBRE1DUP2w7HTH9j_L4OQ) Rohin on Twitter (https://mobile.twitter.com/medcrisis) Can you be so fit that you die video (https://youtu.be/hT8GZlBBv5k)? Why does getting in the water want to make you pee video (https://youtu.be/A-1hPjGvf3U) What is the stupidest nerve in the body video (https://youtu.be/wzIXF6zy7hg) Can you legally buy a human skeleton video (https://youtu.be/QcudPWsyxzk) The Tibbies YouTube channel (https://www.youtube.com/channel/UC52kszkc08-acFOuogFl5jw) Up and atom YouTube Channel (https://www.youtube.com/c/UpandAtom) Belinda Carr YouTube Channel (https://www.youtube.com/c/BelindaCarr) Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, a monthly newsletter, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Episode citation Quintana, D.S., Heathers, J.A.J. (Hosts). (2022, February 14) "149: Medical misinformation (with Rohin Francis)", Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/7RCMN Special Guest: Rohin Francis.

Dan and James chat about why academic reference letters are terrible, a recent position statement on preprints, and whether the "great resignation" is also happening in academia. Links to stuff that was mentioned: The tweet (https://twitter.com/eblissmoreau/status/1481784305911169027?s=20) from Dr. Eliza Bliss-Moreau on acedemic reference letter The tweet (https://twitter.com/giladfeldman/status/1483973974032007169?s=20&t=xVaPpN8q1v_bHNTvn-xrdQ) from Gilad Feldman about the 100 references he's submitted in 2020 alone The AMWA-EMWA-ISMPP joint position statement paper (https://doi.org/10.1080/03007995.2021.1900365) on medical publications, preprints, and peer review, Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, a monthly newsletter, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Episode citation Quintana, D.S., Heathers, J.A.J. (Hosts). (2022, January 31) "148: Academic reference letters", Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/VZ67

We discuss the $7000 'accelerated publication' option for some Taylor & Francis journals that promises 3-5 week publication and a novel type of research fellowship. Details (https://taylorandfrancis.com/partnership/commercial/accelerated-publication/) for the accelerated publication The New Science 2022 Summer Fellowship (https://newscience.org/summer-fellowship/) We have new merch (https://everything-hertz-podcast.creator-spring.com/listing/metal-7594)! Use the discount code 'METAL' to get 20% off (valid until January 31st, 2022). Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, a monthly newsletter, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Episode citation Quintana, D.S., Heathers, J.A.J. (Hosts). (2022, January 17) "147: The $7000 golden ticket", Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/VNPBJ

We answer a series of questions from a listener on whether to start a PhD, what to ask potential supervisors, the financial perils of being a PhD student, the future of higher education, the importance of skills, what keeps us going, and more. Here are the specific questions that we answered in this episode (the background to these questions is shared in the episode): Would you have any advice on how I can even decide whether to commence a PhD? Are there any questions in particular that you think are important to ask prospective supervisors? How do people make PhDs work financially? You are supposed to treat the degree like a regular 40 hour/ week job (and students commonly fail to do so). However, what full-time job pays ~$540 per week and expects this?! You are not supposed to work > 8 hours/ week outside of this?! I thought I could at least work 2-3 full days a week if I needed to. Why do people generally leave academia, or not continue, after their PhD, despite obvious potential? In what form do you think universities will be around in 5 and 10 years? Are one-year progress reports from the PhD committee enough to stay on track? What utility do PhDs hold inside and outside of academia? Apparently, skills matter more than a topic, and you have a better chance of getting a postdoc etc... if you have worked on a hot topic with a well-known supervisor. How can one start the PhD prepared enough to finish it on time and earlier? I am wondering what keeps academics going. I may be jaded, but lab environments don't seem collaborative, and academics seem to be ruled by the admin people and hedge fund managers (or whoever). They also seem to make their money off students (i.e., the customer). I see a reverence for science and people trying to game the system, but not people wanting to seek truth in science. I now wonder how much of academia is motivated by pride, comfort, and not knowing what else to do. In my mind (and I am exaggerating a little), the PhD journey is coming to resemble an abusive relationship between the student and the uni, facilitated by the supervisor who hopefully gets something out of it. I assume it only gets worse from here. I have been told that the PhD is the only program that offers solid research training and the ability to do your original research (something an industry job does not offer). Even if I accept those premises, I now wonder what it is all for. Where do you both see yourselves in 5 and 10 years? What keeps you both going? We have new merch (https://everything-hertz-podcast.creator-spring.com/listing/metal-7594)! Use the discount code 'METAL' to get 20% off (valid until January 31st, 2022). Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, a monthly newsletter, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Episode citation Quintana, D.S., Heathers, J.A.J. (Hosts). (2021, December 27) "146: Skills pay bills", Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/PUW6N

We discuss the results from the cancer biology reproducibility project, the inevitable comparisons with reproducibility in psychology, and authorship expectations for posting public datasets. Links * The paper (https://elifesciences.org/articles/71601) investigating the replicability of preclinical cancer biology * The paper (https://academic.oup.com/ej/article-abstract/131/635/1250/5824166) on the impact of alphabetical order on career outcomes in economics (whose authorship order are determinedby alphabetical order * That human sports science paper (https://pubpeer.com/publications/28EA24F1ABCFF6CD121B167A9A68BB) that inlcluded a cranionotomy Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, a monthly newsletter, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Episode citation Quintana, D.S., Heathers, J.A.J. (Hosts). (2021, December 13) "145: Our boat is sinking slightly slower", Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/634QJ

If your child asked you whether they should pursue a career in academia, what would you say? We discuss this question plus three more quick-fire topics: the death of expertise, memorable presentations, and including internships in more graduate programs Links * Get a 30% discount on a Scite subscription for a year, just use the coupon code EVERYTHINGHERTZ via this link (https://scite.ai/?via=everythinghertz) * The “Remind me of this later” twitter bot (https://twitter.com/remindme_ofthis) * The Chase, Chance, and Creativity book (https://www.amazon.com/Chase-Chance-Creativity-Lucky-Novelty/dp/0262511355) Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, a monthly newsletter, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Episode citation Quintana, D.S., Heathers, J.A.J. (Hosts). (2021, November 15) "144: The role of luck in academia", Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/BKAH6

Dan and James discuss the differences between 'talk' and 'action' in scientific reform and why reforms are taking such a long time to be realised. They also chat about whether messy (but correct) code is worse than no code at all, and revisit the grad student who never said "no" (https://web.archive.org/web/20170312041524/http:/www.brianwansink.com/phd-advice/the-grad-student-who-never-said-no). Other links * Get a 30% discount on a Scite subscription for a year, just use the coupon code EVERYTHINGHERTZ via this link (https://scite.ai/?via=everythinghertz) * James' blog post on why he loves preprints (https://jamesheathers.medium.com/why-i-love-pre-prints-9d727eeb22b8) * The grad student who never said "no" (archived) blog post (https://web.archive.org/web/20170312041524/http:/www.brianwansink.com/phd-advice/the-grad-student-who-never-said-no) Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, a monthly newsletter, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Episode citation Quintana, D.S., Heathers, J.A.J. (Hosts). (2021, November 1) "143: A little less conversation, a little more action", Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/X75SZ

In this live episode, Dan and James discuss red flags in academia, in terms of research fields, papers, and individuals. Thanks to everyone that participated in this live event! Links to stuff that was mentioned Get a 30% discount on a Scite subscription for a year, just use the coupon code EVERYTHINGHERTZ via this link (https://scite.ai/?via=everythinghertz) The p-hacker app (https://shinyapps.org/apps/p-hacker/) Burro racing on Wikipedia (https://en.wikipedia.org/wiki/Pack_burro_racing) Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, a monthly newsletter, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Episode citation Quintana, D.S., Heathers, J.A.J. (Hosts). (2021, October 18) "142: Red flags in academia [Live episode]", Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/3YB47

We chat with Sakshi Ghai (University of Cambridge) about why we should diversify sample diversity and retire the Western, educated, rich, industrialized and democratic (WEIRD) dichotomy in the behavioral sciences Links to stuff we discuss: Sakshi's piece (https://rdcu.be/cyKEQ) in Nature Human Behavior Many Labs 2 paper (https://journals.sagepub.com/doi/full/10.1177/2515245918810225) The ‘helicopter' research piece (https://www.nature.com/articles/d41586-021-01795-1) Joseph Heinrich's recent book, The WEIRDest People in the World (https://www.amazon.com/WEIRDest-People-World-Psychologically-Particularly-ebook/dp/B07RZFCPMD) Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, a monthly newsletter, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Music credits Our outro music is by Lee Rosevere (https://freemusicarchive.org/music/Lee_Rosevere/) Episode citation Quintana, D.S., Heathers, J.A.J. (Hosts). (2021, September 20) "141: Why we should diversify study samples (with Sakshi Ghai)", Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/J9E6W Special Guest: Sakshi Ghai.

James proposes that peer review reports should be published as their own citable objects, provided that the manuscript author thinks that the peer review report is of sufficient quality and the peer reviewers agree Other links and things we discuss * An update on James' start up job * The American service industry * Dan's first outing since the pandemic started * The villlage of Hell (https://en.wikipedia.org/wiki/Hell,_Norway), in Norway * The villiage of Fucking (https://en.wikipedia.org/wiki/Fugging,_Upper_Austria) (now changed to Fugging) in Austria * The Hertz long term archive (https://osf.io/zj7y3/) on Open Science Framework * We're up for doing a syllabus episodes that you can assign to your classes * Dan's recent piece (https://rdcu.be/cx3H0) in Nature Human Behavior on replication projects for undergraduate research theses * What about a replication study as part of a PhD thesis? * The trope of, “future replications are needed' * Collaborative Replications and Education Project (CREP (https://osf.io/wfc6u/)) * Daniel Lakens mentioning (https://twitter.com/lakens/status/1435696324708642816?s=20) that his paper might be the most cited Frontiers article ever * How thorough should peer review be? * James' new articles isn't online yet, but he will pin it to his Twitter profile as soon as it is * The Julian Koenig-led paper (https://onlinelibrary.wiley.com/doi/full/10.1111/psyp.13688) James mentioned (that Dan and James are co-authors on) * The Psychophysiology liviing meta-analysis (https://onlinelibrary.wiley.com/doi/full/10.1111/psyp.13933) article Other links Everything Hertz on social media - Dan on twitter (https://www.twitter.com/dsquintana) - James on twitter (https://www.twitter.com/jamesheathers) - Everything Hertz on twitter (https://www.twitter.com/hertzpodcast) - Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/) Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, a monthly newsletter, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Music credits Our outro music is by Lee Rosevere (https://freemusicarchive.org/music/Lee_Rosevere/) Episode citation Quintana, D.S., Heathers, J.A.J. (Hosts). (2021, September 20) "140: You can't buy cat biscuits with ‘thank you' emails", Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/BW65N