Effective Altruism Forum Podcast

Follow Effective Altruism Forum Podcast
Share on
Copy link to clipboard

I (and hopefully many others soon) read particularly interesting or impactful posts from the EA forum.

Garrett Baker


    • May 17, 2026 LATEST EPISODE
    • weekdays NEW EPISODES
    • 17m AVG DURATION
    • 760 EPISODES


    Search for episodes from Effective Altruism Forum Podcast with a specific topic:

    Latest episodes from Effective Altruism Forum Podcast

    “The AIs seem like EAs — a quick look at two prompts” by trammell

    Play Episode Listen Later May 17, 2026 8:07


    Overview When asked about how they would give away money, or about how to have a moral career, the leading LLMs typically give answers in an EA spirit, and informed by thinking from people and organizations in the EA community. In many cases the term “effective altruism”, and/or EA jargon, are used explicitly. The flavor of EA they tend to endorse is relatively middle of the road: supporting effective global health charities with their money and recommending existential risk reduction, especially via AI risk, as the most moral career. Grok, in line with xAI's mission for it, emphasizes that it values space exploration and truth-seeking, e.g. via funding scientific research. But to my reading, the EA tendency doesn't seem more pronounced in Claude than in ChatGPT or Gemini. So it's probably not a result of explicit effort by AI developers in the EA community, but a reflection of the reality that, with respect to some very broad moral questions, answers proposed by people in the EA orbit have become a sort of common sense. This is a remarkable accomplishment. Indeed, if these answers tell us much about how the models will behave when given more autonomy, this could be [...] ---Outline:(00:10) Overview(02:18) Prompts(03:40) Results(03:57) Scoring procedure(05:41) Summary(07:00) Full scores --- First published: May 12th, 2026 Source: https://forum.effectivealtruism.org/posts/BEjbvCvNLuRk9y4Su/the-ais-seem-like-eas-a-quick-look-at-two-prompts --- Narrated by TYPE III AUDIO.

    “My Dad Worked in a Slaughterhouse. I Made a Documentary About It.” by Jack Hancock-Fairs

    Play Episode Listen Later May 14, 2026 3:36


    I'm an EA who has been trying to find ways to make animal suffering more salient. I've been working on a feature-length documentary called ‘The Dying Trade' for the last 5 years and I've just released it on YouTube. I'm sharing it here for two reasons: firstly, because I hope it can become a useful resource that advocates share with others as an introduction to animal ethics; and secondly, because strong engagement in the early days will help YouTube recommend the film to more people, increasing its impact. Trailer: Full film: About the film Jack is a vegan activist. His father is a slaughterhouse worker. After years of avoiding the subject, Jack sets out to confront the unspoken tension between them. This intimate and contemplative documentary follows a son's attempt to understand his father - and the industry that stands between them. I didn't really want to make a documentary about my relationship with my father. At times, it was quite uncomfortable. For the last 8 years or so, I've been trying to increase the salience of animal suffering, primarily through producing videos on my YouTube channel: Humane Hancock. And one thing has always been [...] --- First published: May 13th, 2026 Source: https://forum.effectivealtruism.org/posts/NkXb6hP38MReioe6Z/my-dad-worked-in-a-slaughterhouse-i-made-a-documentary-about --- Narrated by TYPE III AUDIO.

    “Save Our Pigs!” by LewisBollard

    Play Episode Listen Later May 11, 2026 10:11


    Note: This post was crossposted from the Coefficient Giving Farm Animal Welfare Research Newsletter by the Forum team, with the author's permission. The author may not see or respond to comments on this post. Subtitle: The pork lobby is one farm bill away from gutting our strongest farm animal welfare laws Last Thursday, the US House of Representatives passed a farm bill containing the “Save Our Bacon” Act. The Act's stated aim is narrow: to wipe out California and Massachusetts' bans on the sale of pork from pigs confined in gestation crates. Its reach is much wider. The Act would stop any state or locality from regulating the sale of meat based on how it's produced in another state. This would likely invalidate state and local bans on foie gras, crated veal, and more. It would also halt future legislative progress. Congress hasn't passed a farm animal welfare law in decades. State laws are where reforms actually happen. The SOB Act would gut them by mandating they contain a giant loophole for out-of-state imports. The Act has two notable exemptions. One is welcome: state bans on the sale of caged eggs aren't covered. The other is telling: state [...] --- First published: May 7th, 2026 Source: https://forum.effectivealtruism.org/posts/kTo9z5bscb4wQrkqs/save-our-pigs --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

    “Reflections on Anthropic and EA” by abrahamrowe

    Play Episode Listen Later May 11, 2026 9:43


    LLM disclosure: I wrote this post myself, then asked an LLM to copy-edit it before posting. I manually made any edits I liked and copy-pasted no text from the LLM (my current practice for using LLMs in writing that I care about). This is crossposted from my blog. These are personal reflections on feelings that I've been sitting with recently. I'm posting them, because the last time I felt this way I regretted not doing so. I don't really know how calibrated they are, but I've been noticing them more and more. Around 6 months before FTX collapsed, I wrote a draft EA Forum post called “Concerns about the Carrick Flynn campaign.” At the time, I was on the verge of leaving EA. During the frothiest FTX days it seemed like many folks were energized by the money and attention, but I felt kind of gross. The amount of money pouring into EA, and the resulting “lowering of the bar” that happened felt like a degradation of community norms that was too severe, almost not worth the benefits. Of course, some people voiced these concerns at the time, but they were drowned out by the excitement of the moment. [...] --- First published: May 10th, 2026 Source: https://forum.effectivealtruism.org/posts/io3cqZeToEKsZEZWG/reflections-on-anthropic-and-ea --- Narrated by TYPE III AUDIO.

    “How to actually give money away” by NickAllardice

    Play Episode Listen Later May 6, 2026 19:59


    This was originally posted here. It's written for an audience that's not deep in the weeds of EA giving theory/culture, but a few people suggested I post here as there's much that's additive to or divergent from some common EA practices. Feedback / disagreements welcome! Also my first time posting here. Hi! -- Most people who intend to give large amounts of money away never actually do. The money sits. In donor-advised funds, in "someday" plans, in good intentions. This is the default pathway - not an edge case - and if you don't design against it, it will happen to you too. I've watched this from every angle. As CEO of Change.org we processed 5M+ donations. I now run GiveDirectly; 160 thousand people have donated, dozens regularly give 1 million dollars+, and some give 50 million dollars-100 million dollars+ at a time. I've advised two of the biggest philanthropic institutions in the world (Coefficient Giving and GiveWell) on donor engagement and growth, and sat on half a dozen nonprofit boards. I've also been giving away 10-20% of my annual income for 17 years; I grew up low-income, so this started as a very modest amount but has added [...] ---Outline:(01:59) 1. The default pathway is to delay. Fight this.(04:51) 2. Pick a few causes and write them down.(07:33) 3. Build a portfolio across causes and risk/return.(09:48) 4. Use the index funds of giving.(11:55) 5. For the love of god, dont over-staff.(13:58) 6. Make giving a recurring event, not a to-do.(15:36) A few final hot takes --- First published: April 30th, 2026 Source: https://forum.effectivealtruism.org/posts/fRLt59FNXxmCaAkYF/how-to-actually-give-money-away --- Narrated by TYPE III AUDIO.

    “If You Do One Thing for Animals This Year, Do This” by Becca Rogers

    Play Episode Listen Later May 5, 2026 21:48


    There is a short window to prevent a US bill that would overturn decades of animal welfare progress. This is arguably the most consequential piece of farm animal legislation in U.S. history. Summary  The Farm Bill currently being considered by the U.S. Congress includes the “Save Our Bacon Act”, which would eliminate states' abilities to set standards on how farmed animals are raised and treated¹, and void existing state animal welfare laws. If passed into law, it would undo decades of animal welfare progress, and greatly reduce opportunities for future animal welfare wins. The Farm Bill has passed the House with the Save Our Bacon Act (SOB) included, and it will soon be considered by the Senate. This is the biggest legislative threat to farmed animal welfare in U.S. history, and preventing the Save Our Bacon Act from passing Congress is the highest impact opportunity to help animals that there has been in years. If you do anything to help animals this year, it should be helping with this. Call script, email templates, and more here. What to do Easiest, highest priority action (5 min): Call and email both your senators, and ask them to publicly [...] ---Outline:(00:21) Summary(01:15) What to do(04:55) Higher-effort actions(07:22) Context on the Save Our Bacon (SOB) Act(07:28) What is the Save Our Bacon (SOB) Act?(08:23) What would be this laws effect on animal welfare?(10:08) What is SOBs status in Congress?(10:57) Strategy(11:00) What are the goals?(11:44) Which Senators would be the highest impact to persuade to oppose SOB?(13:04) How to talk about this with different audiences(17:00) Footnotes(17:07) Appendix(17:10) More details on the goals(18:32) Which Senators would be the highest impact to persuade to oppose SOB? --- First published: May 4th, 2026 Source: https://forum.effectivealtruism.org/posts/vsYphZaBcXpmtNizp/if-you-do-one-thing-for-animals-this-year-do-this-1 --- Narrated by TYPE III AUDIO.

    [Linkpost] “Starfish” by Aaron Gertler

    Play Episode Listen Later May 1, 2026 4:55


    This is a link post. By Alexander Wales Thousands of starfish had washed up on the beach, and a little girl was diligently throwing them back into the water, one at a time. A man came up to the girl and said, "You'll never save all of them. What you're doing is pointless. It doesn't matter." The girl threw another starfish into the water. "It mattered to that one." The man snorted and walked away. The girl kept throwing starfish, one after another. To throw one starfish back into the ocean takes a trivial amount of effort, but to throw ten, or fifty, is much less so. The girl had not learned much of biomechanics, but she began to feel the strain in her back. Her skin had softened from the seawater, and the starfish themselves were abrasive. Her fingers had pruned. Her shoulder hurt. She was cut, twice, on her fingers, as the same storm that had stranded the starfish had also brought up broken shells and crab carapaces. The skin of a starfish was like sandpaper. She tried switching hands, and could throw the starfish less well, and it wasn't long before she had mirrored all her injuries. [...] --- First published: April 28th, 2026 Source: https://forum.effectivealtruism.org/posts/BHHcPbirBdoBetNiu/starfish Linkpost URL:https://archiveofourown.org/works/52206136/chapters/220900811#workskin --- Narrated by TYPE III AUDIO.

    “Time Sensitive Urgent Animal Welfare Action” by Bentham's Bulldog

    Play Episode Listen Later Apr 29, 2026 1:57


    The EATS act—now called the save our bacon act—would make it illegal for states to pass animal welfare laws that apply to products produced out of state. This would gut most state level animal protection. It would be the worst law for animal welfare ever passed, and would consign hundreds of millions of animals to a life in a cage. Terrifyingly, it has been added to the recent farm bill (though fortunately, even if it passes, egg laying hens will be spared). It will be voted on in the next few days, so this is EXTREMELY TIME SENSITIVE! There is an amendment to the farm bill that representatives could vote for called the Luna amendment which would remove the EATS act from the farm bill. This would save countless animals from extreme suffering and prevent the dissolution of most animal protection laws. It would be a catastrophe for animal welfare of historic proportions. Fortunately, there is something you can do about it. See this document for a lot more detail, including fairly easy steps like emailing your representative. Please, please, do some of these things. This is truly a pivotal moment for animals, and how we act today might [...] --- First published: April 28th, 2026 Source: https://forum.effectivealtruism.org/posts/GLixYBHyaLHsnAoDG/time-sensitive-urgent-animal-welfare-action --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

    “Forecasting is Way Overrated, and We Should Stop Funding It” by Marcus Abramovitch

    Play Episode Listen Later Apr 26, 2026 8:44


    Summary EA and rationalists got enamoured with forecasting and prediction markets and made them part of the culture, but this hasn't proven very useful, yet it continues to receive substantial EA funding. We should cut it off. My Experience with Forecasting For a while, I was the number one forecaster on Manifold. This lasted for about a year until I stopped just over 2 years ago. To this day, despite quitting, I'm still #8 on the platform. Additionally, I have done well on real-money prediction markets (Polymarket), earning mid-5 figures and winning a few AI bets. I say this to suggest that I would gain status from forecasting being seen as useful, but I think, to the contrary, that the EA community should stop funding it. I've written a few comments throughout the years that I didn't think forecasting was worth funding. You can see some of these here and here. Finally, I have gotten around to making this full post. Solution Seeking a Problem When talking about forecasting, people often ask questions like “How can we leverage forecasting into better decisions?” This is the wrong way to go about solving problems. You solve problems by starting with [...] --- First published: April 25th, 2026 Source: https://forum.effectivealtruism.org/posts/zmbfZjK54xF4oGjSB/forecasting-is-way-overrated-and-we-should-stop-funding-it --- Narrated by TYPE III AUDIO.

    “My lover, effective altruism” by Natalie_Cargill

    Play Episode Listen Later Apr 26, 2026 8:48


    Crossposted from Substack. This post is part of a 30-posts-in-30-days ordeal at Inkhaven. All suboptimalities are the result of that. This is part 2, here is part 1 in my EA mini series! On my way to my tenth EAG in a decade, my brother-in-law explained effective altruism to me. At first, he couldn't quite remember if he'd heard the phrase before. But he searched the corners of his mind until the definition made itself known: “yeah, it's just a bunch of wankers who pretend to have social impact, but all they do is go to conferences and raise money and they've never had any impact at all.” I have never had any chill. I did not develop it in that moment. If anyone is going to say EA is just a bunch of wankers, it's going to be me, newbie. “That's interesting, Ben, but I think it's a serious misconception — you might not be aware that EA has literally raised billions of dollars for global health charities, which very likely saved hundreds of thousands of children's lives (do you hate children, Ben?) They have literally stopped millions of hens being tortured in cages too small for them [...] --- First published: April 17th, 2026 Source: https://forum.effectivealtruism.org/posts/sA5iFynuMJQAuJ6ku/my-lover-effective-altruism --- Narrated by TYPE III AUDIO. ---Images from the article:

    “A Database of Near-Term Interventions for Wild Animals” by Bob Fischer

    Play Episode Listen Later Apr 24, 2026 17:53


    The Animal Welfare Department (AWD) at Rethink Priorities supports high-impact strategies to help animals, especially where suffering is vast and largely neglected. Therefore, one of our focus areas is wild animal welfare (WAW), where uncertainty about tractability makes identifying cost-effective interventions particularly challenging. While much of the current WAW work rightly focuses on academic field-building (see Elmore & McAuliffe, 2024), it is worth determining whether there are viable, near-term interventions that are already available or close to implementation. With this goal in mind, we have developed the Wild Animal Welfare Intervention Database (WAWID). This project evaluates an array of interventions that may be promising for improving WAW in the (relatively) near term, evaluating them relative to criteria of interest to funders, advocates, researchers, and potential implementers across the WAW space. The WAWID is available here: Wild Animal Welfare Intervention Database The landing page includes a full list of the interventions and evaluation criteria. This report explains how we developed the WAWID, what we think you can learn from it, and suggest some future directions for this work (conditional on funding). A future report will provide some descriptive statistics. How we developed the WAWID We launched this project in [...] ---Outline:(01:34) How we developed the WAWID(08:14) Initial observations(13:13) Limitations(15:20) Future Directions(16:48) Acknowledgements --- First published: March 25th, 2026 Source: https://forum.effectivealtruism.org/posts/pEbiEmeu2agEHJgyu/a-database-of-near-term-interventions-for-wild-animals --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

    “The AI people have been right a lot” by Dylan Matthews

    Play Episode Listen Later Apr 20, 2026 10:49


    This post was crossposted from Dylan Matthew's blog by the EA Forum team. The author may not see or reply to comments. Subtitle: Try to keep an open mind as the world gets increasingly wild.The crowd at EAG 2015 (Center for Effective Altruism) In 2015, I went to my first EA (Effective Altruism) Global. It was then on-the-record for journalists, which is a rule that got changed for all subsequent events due to my actions. My exposure to EA at that time was mostly through people who took high-paying careers in order to “earn to give” to global health charities, which I had written about in the Washington Post. I also knew the movement cared a lot about animal welfare. I was aware that there were people worried about catastrophic risks, and specifically about AI; this had come up in a profile I wrote of Open Philanthropy (my now-employer, albeit under a new name these days). But I still broadly thought of EA as the bednets and cage-free commitments people. I was really taken aback by how dominant discussions of AI risk were at the event. The marquee panel featured Superintelligence author Nick Bostrom, future If Anyone Builds It [...] ---Outline:(03:31) What should I learn from bungling this?(06:43) Listen to the people saying stuff will get weird --- First published: April 16th, 2026 Source: https://forum.effectivealtruism.org/posts/9FPxMET3W4wewwSyf/the-ai-people-have-been-right-a-lot --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

    [Linkpost] “The Anthropic IPO Is Coming. We Aren't Ready for It.” by Sophie Kim

    Play Episode Listen Later Apr 17, 2026 15:30


    This is a link post. More money is coming than AI safety has ever seen. The capacity to deploy it doesn't exist yet.Image Source: Fortune.com This week, Anthropic announced Claude Mythos Preview– a model so capable at finding software vulnerabilities that the company decided to wait to release it publicly. Last month, Bloomberg reported that Anthropic's annualized revenue had hit $19 billion, doubling in under four months, and by some accounts surpassing OpenAI. It is currently one of the most valuable private companies on the planet. Anthropic is also going to IPO, possibly as soon as October 2026. When it does, a few thousand people, including some of the wealthiest people on the planet, will become liquid, and a meaningful fraction of those people will want to give to AI safety. Tech liquidity events have created major philanthropists before. Dustin Moskovitz's Facebook shares became Good Ventures, which became Coefficient Giving, which became the single largest funder of AI safety. Vitalik Buterin donated $665 million to a fledgling FLI. Jed McCaleb's crypto wealth became a billion-dollar endowment to the Navigation Fund, which went from $4 million in grants its first year to over $60 million by 2025. None of these come [...] ---Outline:(00:13) More money is coming than AI safety has ever seen. The capacity to deploy it doesnt exist yet.(03:36) The constraint is talent, not funding(05:47) We dont just need more bets- we need decorrelated ones(08:39) Different structural positions(09:17) Independent grantmakers with different worldviews(10:12) The Pitch: Consider becoming a grantmaker or founding something new(12:52) The window is brief(13:48) Next Steps --- First published: April 12th, 2026 Source: https://forum.effectivealtruism.org/posts/ychu2LAw54sNcocKH/the-anthropic-ipo-is-coming-we-aren-t-ready-for-it Linkpost URL:https://thecounterfactual.substack.com/p/the-anthropic-ipo-is-coming-we-arent --- Narrated by TYPE III AUDIO. ---Images from the article:

    “AI Safety's Biggest Talent Gap Isn't Researchers. It's Generalists.” by Topaz, Agustín Covarrubias

    Play Episode Listen Later Apr 16, 2026 13:46


    This post was cross posted to LessWrong TL;DR: One of the largest talent gaps in AI safety is competent generalists: program managers, fieldbuilders, operators, org leaders, chiefs of staff, founders. Ambitious, competent junior people could develop the skills to fill these roles, but there are no good pathways for them to gain skills, experience, and credentials. Instead, they're incentivized to pursue legible technical and policy fellowships and then become full-time researchers, even if that's not a good fit for their skills. The ecosystem needs to make generalist careers more legible and accessible. Kairos and Constellation are announcing the Generator Residency as a first step. Apply here by April 27. Epistemic status: Fairly confident, based on 2 years running AI safety talent programs, direct hiring experience, and conversations with ~30 senior org leaders across the ecosystem in the past 6 months.The problem Over the past few years, AI safety has moved from niche concern toward a more mainstream issue, driven by pieces like Situational Awareness, AI 2027, If Anyone Builds It, Everyone Dies, and the rapidly increasing capabilities of the models themselves.During this period, over 20 research fellowships have launched, collectively training thousands of fellows, with 2,000-2,500 fellows [...] ---Outline:(01:18) The problem(03:41) Why the pipeline is broken(05:59) Why this matters now(07:31) Counter-Arguments(10:11) The Generator Residency --- First published: April 13th, 2026 Source: https://forum.effectivealtruism.org/posts/k3nq7FxBCsrNFmAYi/ai-safety-s-biggest-talent-gap-isn-t-researchers-it-s-2 --- Narrated by TYPE III AUDIO.

    “The outsized benefits of removing bottlenecks: some personal experiences” by Rory Fenton

    Play Episode Listen Later Apr 13, 2026 10:43


    I once ran the monitoring and evaluation department of a large nonprofit in rural Tanzania. We had 25 full-time data collectors who ran surveys with farmers on their crop yields and planting practices. My job was to oversee the team, analyze their data and produce reports with actionable recommendations. The field team was incredibly productive and we were collecting tons of data. We were also producing very few actual reports and horrendously behind on everything. This seemed to me like a “time to work harder” problem but reading a business professor's novel about manufacturing helped me see it differently. The correct solution was to tell my 25 field staff to stop working for two months. The most engrossing book I've read since Harry Potter The Goal by Eliyahu Goldratt is a novel about a manager given 6 months to turn around his factory or face closure, and the tactics he uses to get production up. It should not be good. It is very good. I'm not claiming it's great literature but it contains one of those ideas that, once seen, cannot be unseen. A system moves at the speed of its slowest component, and nothing you do to [...] ---Outline:(00:55) The most engrossing book Ive read since Harry Potter(03:54) Rory, the bottleneck(07:09) Bottles as bottlenecks(08:23) Some observations on bottlenecks(09:39) Conclusion --- First published: April 8th, 2026 Source: https://forum.effectivealtruism.org/posts/7excF9Zsv3gKvAdAZ/the-outsized-benefits-of-removing-bottlenecks-some-personal --- Narrated by TYPE III AUDIO.

    “We're growing: CEA is increasing its font size” by OllieRodriguez

    Play Episode Listen Later Apr 3, 2026 2:12


    “We” in this post refers to CEA leadership, who didn't write this post. In 2025, we grew engagement with CEA's programs by 20–25% across every tier of engagement. But we recognize that growing the community is about more than engagement or metrics—at its core, growth is about the bigness of things. How can we claim that we've grown the community if the words on the page are the same size? To match our ambition off the page, it's time to show ambition on the page. We're increasing our font size from 15px to 25px across all platforms. You'll see more from us—clearer text, bigger words, extremely long forum posts. What this means All of our programs will be bigger, in the sense that the documents we write about them will be absolutely huge. The forum will have a larger font than any other sensible website—a bigger font means more impactful ideas. Our events will have larger screens for our ginormous font. This will mean a significant increase in AV costs. We're encouraging local groups to do the same—we're recommending a 30% font size increase this year, and we'll be supporting them to reach 20px font size by the [...] --- First published: April 1st, 2026 Source: https://forum.effectivealtruism.org/posts/EBjcpyfPwhByKeWjM/we-re-growing-cea-is-increasing-its-font-size --- Narrated by TYPE III AUDIO.

    “Announcing Highly Engaged EAs!” by Sam Anschell

    Play Episode Listen Later Apr 2, 2026 2:56


    I'm excited to launch Highly Engaged EAs: a matchmaking and nuptialization service to optimize tax relief, green card accumulation and more! Workstreams I Do(nate) By marrying EAs in different tax brackets, Highly Engaged EAs reduces average tax burden through joint filing to enable greater giving. A Californian AI safety researcher with a million dollar salary could give an extra $53k/year by tying the knot with an unpaid grad student! Til 80,000 Hours do us part The place premium is so high in the US that >1,000 people have bought a million dollar gold card! While some roles don't sponsor visas, spouses always can[1]. We match those looking to move countries with nationals of their desired destination. Bang for your Buck For full efficiency, Buck Shlegeris and Ajeya Cotra wear multiple hats as the witnesses, officiants and entertainment for weddings we organize. Rationally named children  For those who are interested in having kids, we provide naming guidance based on what really matters: Brevity. Claude BOTECs that each additional syllable to a person's name adds 68 hours to global pronunciation costs. Given that this will disproportionately be time spent by EAs, one-syllable names are a slam dunk. Complementarity: The [...] ---Outline:(00:20) Workstreams(00:23) I Do(nate)(00:56) Til 80,000 Hours do us part(01:17) Bang for your Buck(01:29) Rationally named children --- First published: April 1st, 2026 Source: https://forum.effectivealtruism.org/posts/TLFiwwZGaqgbQhhr7/announcing-highly-engaged-eas --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

    “RejectDirectly” by RejectDirectly

    Play Episode Listen Later Apr 2, 2026 1:55


    We're thrilled to announce the founding of RejectDirectly, a new EA-adjacent organization dedicated to closing the global rejection gap. For too long, the EA rejection pipeline has been plagued by ineffectiveness. Billions of collective DALYs spend on unsuccessful work trials and interviews. The water waste involved in the mass duplication of Google Docs. The community health is in peril. In comes RejectDirectly. By cutting out the middleman we can deliver high-quality, unconditional rejections straight to applicants — no strings attached, no waiting period. No eight-hour work trials where you pour your Claude extra balance into a strategy memo for an organization that just couldn't bring themselves to reject your heartfelt cover letter. How it works: You apply. We reject you. That's it. No interviews, no work trials, no need for culture fit chats. Like many orgs in the space, we're happy to forward your application to our partner organizations. Unlike other orgs, they will immediately reject you. We call this our Rejection Cascade™ — one application, up to fifteen guaranteed rejections. Our 2026 roadmap: We're piloting a browser addon that sends you a push notification rejection before you even finish your cover letter. Early users report feeling "liberated" and [...] --- First published: April 1st, 2026 Source: https://forum.effectivealtruism.org/posts/5qZdpKEFcGBrHJxDB/rejectdirectly --- Narrated by TYPE III AUDIO.

    “An unexplained annual spike in false claims on the EA Forum” by Tobias Häberli

    Play Episode Listen Later Apr 2, 2026 6:13


    Epistemic status: Very high confidence in the statistical findings. Genuinely confused about the cause. For reasons that will become obvious, I wanted to publish this post on March 31, but unfortunately I could only get it done today. I've been building a classifier to flag potentially misleading content on the EA Forum as part of a side project on epistemics infrastructure. While validating the model, I noticed something I initially assumed was a bug. This is an interim report on that. 
Summary: Every year, on April 1, the rate of posts containing verifiably untrue claims spikes by roughly 2,200% relative to the annual daily average (p < 0.0001, 8 years of Forum data).
 1. The effect is enormous On a typical day, approximately 2 to 4% of Forum posts contain claims that are verifiably false. On April 1, this rises to 57–73%, depending on the year. For context, this is an implausibly large effect by normal social-science standards. I have genuinely never seen anything like it. 2. It repeats every year This is not a one-off event. The pattern recurs in every year of the dataset. 3. "It's only one day" is misleading A natural reaction is that [...] ---Outline:(01:00) 1. The effect is enormous(01:38) 2. It repeats every year(01:57) 3. Its only one day is misleading(02:57) 4. The false posts are high effort(03:21) Possible explanations(03:30) Why this matters(04:48) Proposed interventions --- First published: April 1st, 2026 Source: https://forum.effectivealtruism.org/posts/EAokRDmQTjCAWgGdq/an-unexplained-annual-spike-in-false-claims-on-the-ea-forum --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

    “300,000 lives, 100 million hens, and a world still to save” by William_MacAskill

    Play Episode Listen Later Apr 2, 2026 7:02


    I went on the Sam Harris podcast again recently. If you want the full non-paywalled episode, I'm able to share it here: https://samharris.org/episode/SE6877E700B 30 mins of it is also on youtube, spotify, etc. The occasion for the podcast was the 10-year anniversary edition of Doing Good Better. So, preparing for the podcast, I collected some relevant facts about what EA has achieved over the last decade, and where the movement stands today. I found the numbers both surprising and inspiring, so I thought I should share them here. EAs don't often toot their own horn, and with all that's going on in the world, or on the internet at least, it's easy to lose sight of the big picture. So I think a bit of horn-tooting is at least occasionally warranted, otherwise we'll only ever focus on the bad and not on the good. And, despite a few subdued years, the EA[1] movement is thriving. I'll break things down by cause area, before looking at EA's recent return to serious growth. First, global heath. Since 2015, over $2 billion has been raised for the most effective global health charities, with contributions from over 100,000 donors. The [...] --- First published: March 31st, 2026 Source: https://forum.effectivealtruism.org/posts/rSPEisvYw9K49ja2T/300-000-lives-100-million-hens-and-a-world-still-to-save --- Narrated by TYPE III AUDIO.

    “Giving up on EA after 13 years” by Jackson Wagner

    Play Episode Listen Later Apr 1, 2026 14:07


    Donating my shares to Lightcone Infrastructure, the Good Food Institute, and the Long-Term Future Fund, because EA refuses to make Mirror's Edge 3Leaning into EA disillusionment: Why I no longer believe in EA I bought this EA stock almost thirteen years ago:Leopold Aschenbrenner once said that “people with situational awareness have a lower cost basis in Nvidia than you do”.  I'm not sure if this is exactly what he meant… but close enough, right? Back in the late 2000s and early 2010s, EA was a great company pumping out great, interesting games: Mirror's Edge had a striking art style and showcased a whole new style of first-person parkour gameplay. Crysis infamously pushed graphical technology to such extremes that it was like getting a preview of videogame technology 5-10 years in the future. Spore was… weird and bad, but its ambition and uniqueness was inspiring. The Dead Space games (including the almost weirdly good point-and-shoot Wii spinoff) were pretty creative, and the realism of Battlefield 3 felt like a valuable counterpoint to an increasingly-cartoony Call of Duty series.  Both series felt like they were crafted with a lot of care, despite their big-budget action vibes. This was a hidden gem [...] ---Outline:(00:20) Leaning into EA disillusionment: Why I no longer believe in EA(02:24) EA is was three radical ideas I want to protect(03:57) The soul of EA is in trouble(06:10) EA is about maximization, and maximization is perilous(09:22) Dont be bycatch(10:47) EA and the current funding situation(12:20) Abandoning EA, in favor of doing the most good --- First published: March 31st, 2026 Source: https://forum.effectivealtruism.org/posts/ZegHZBvEeQanrGhpY/giving-up-on-ea-after-13-years --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

    “80,000 Hours is coming to bookstores in May” by Bella, 80000_Hours

    Play Episode Listen Later Mar 31, 2026 11:35


    Summary We're publishing our book, 80,000 Hours, with Penguin on 26 May. It's an update of the 80,000 Hours career guide, with a full round of edits, new design, and new content discussing the effect of AI on career choice. We think it's now the best single entry point to our advice. We hope publishing it will multiply the impact of our advice. One quick way you could help is to preorder a copy (especially from a traditional retailer). It helps increase the chance we get on bestseller lists, and increases our expected reach. Preorder here.The new book It's called 80,000 Hours: How to Have a Fulfilling Career That Does Good. It covers all of our best advice for having a big, positive impact with your career. It's being published by Penguin Random House on the 26th May in the US, and the 28th May in the UK.Why did we decide to publish this book?According to the EA Survey, 80,000 Hours has been the biggest single entry point into effective altruism, and our online career guide has consistently had an outsized impact compared to our other programmes.[1] We think it's probably the best content we've ever published [...] ---Outline:(00:11) Summary(00:52) The new book(01:13) Why did we decide to publish this book?(02:11) Whats new in this edition?(03:47) How you can help(04:45) FAQs(10:48) Thank you --- First published: March 24th, 2026 Source: https://forum.effectivealtruism.org/posts/qbAg8fnAbJQE3SLe9/80-000-hours-is-coming-to-bookstores-in-may --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

    “The joys of cash benchmarking” by ozymandias

    Play Episode Listen Later Mar 27, 2026 17:07


    I. Imagine you run a charity which gives cows to people in the developing world. Your new boyfriend is a statistician and you want to impress him, so you've decided to look into this Monitoring and Evaluation thing he keeps going on about. So you give a bunch of people cows and then follow up a year later, and sure enough the people you gave the cows to are richer, healthier, and happier. You proudly tell this to your boyfriend and expect to reap rewards in the form of admiration, cuddles, and a ‘yes' to your marriage proposal. Your boyfriend, however, isn't impressed. What if everyone in the country is getting richer, because the country is industrializing? What if the poor people you gave cows to were having an unusually hard time, and then they got back on their feet, and your cows had nothing to do with it? Apparently, in order to get a sample that really says anything about the world, you need to randomly give cows to half the people, and then check whether the people you gave cows to are doing better than the people you didn't give cows to (a “randomized controlled trial”). This [...] --- First published: March 10th, 2026 Source: https://forum.effectivealtruism.org/posts/QsvFCcDR2TfSj32aM/the-joys-of-cash-benchmarking --- Narrated by TYPE III AUDIO.

    “Broad Timelines” by Toby_Ord

    Play Episode Listen Later Mar 21, 2026 30:25


    No-one knows when AI will begin having transformative impacts upon the world. People aren't sure and shouldn't be sure: there just isn't enough evidence to pin it down. But we don't need to wait for certainty. I want to explore what happens if we take our uncertainty seriously — if we act with epistemic humility. What does wise planning look like in a world of deeply uncertain AI timelines? I'll conclude that taking the uncertainty seriously has real implications for how one can contribute to making this AI transition go well. And it has even more implications for how we act together — for our portfolio of work aimed towards this end.   AI Timelines By AI timelines, I refer to how long it will be before AI has truly transformative effects on the world. People often think about this using terms such as artificial general intelligence (AGI), human level AI, transformative AI, or superintelligence. Each term is used differently by different people, making it challenging to compare their stated timelines. Indeed even an individual's own definition of their favoured term will be somewhat vague, such that even after their threshold has been crossed, they might have [...] ---Outline:(00:58) AI Timelines(04:38) Short vs Long Timelines(07:05) Broad Timelines(17:55) Implications(19:46) Hedging(20:58) A Different World(24:00) Longterm Actions(28:33) Conclusions --- First published: March 19th, 2026 Source: https://forum.effectivealtruism.org/posts/HCR2AE9it279ggiZT/broad-timelines --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

    “What I didn't expect about being a funder” by JamesÖz

    Play Episode Listen Later Mar 18, 2026 20:30


    Crossposted from my blog I am very fortunate to have my job in many ways – I get to talk to, learn from, and give money to amazing people and nonprofits all around the world. I get to allocate a modest amount of resources to incredible organisations that I think are doing some of the best work to improve the world. I don't have to fundraise for my or my team's salaries anymore. However, there are some things I've learned since becoming a philanthropic grantmaker that were either surprising or affected me more strongly than I expected. I will outline some of these below. These are not meant to invoke feelings of “oh poor grantmakers who have access to money and influence” but rather “oh, I never considered things from that perspective”. Hopefully, they will also lead to more productive working relationships between funders and advocacy groups. Here, I discuss: How challenging the trade-offs are that funders face The extremely poor feedback mechanisms that nonprofits have How people treat you differently once you have access to funding, and how that changes you The weight of saying no to good groups Some things that make me feel cynical Trade-offs [...] ---Outline:(01:18) Trade-offs are hard and money is scarce(06:35) Nonprofits have bad feedback mechanisms(13:00) How people treat you differently (and how that changes you)(14:52) Its hard to say no to people(16:08) Its easy to become cynical(19:38) Wrapping up --- First published: March 11th, 2026 Source: https://forum.effectivealtruism.org/posts/umicYzuRsm6okFRKA/what-i-didn-t-expect-about-being-a-funder --- Narrated by TYPE III AUDIO.

    “GHD discussion here is slowly dying” by NickLaing

    Play Episode Listen Later Mar 17, 2026 7:27


    Epistemic status: A bit sad (I know that's not an epistemic status) The best development Forum on the internet? 3 years ago a headline “FTX SBF blah blah blah” triggered my memory “oh that's right, that effective altruism thing”. A few years earlier I had read “Doing Good Better” in our Northern Ugandan hut, and was excited by how the ideas matched my experience of seeing the BINGOs [1] on the ground here doing not-much-good at all. Soon after my wife dragged me to Cambridge for a year and I joined an EA group. I was drawn in to a beautiful crew of good, ernest people trying to do the best they could with their lives -[2] something I'd only seen before among a few people at church. I was most impressed by their veganism, practising what they preached. But after going back to Uganda I forgot about the whole EA thing. But 3 years later the FTX headlines and a google search led me to the EA forum, which to my delight turned out to be the best place on the internet to discuss global health and development. My first foray was a not-very-good post [...] ---Outline:(00:16) The best development Forum on the internet?(01:29) A steady decline(02:59) Why?(04:34) Is this fine?(05:02) Is this less fine?(06:29) How to Boost GHD discourse? --- First published: March 15th, 2026 Source: https://forum.effectivealtruism.org/posts/4jbbjTTJ87baMrkY4/ghd-discussion-here-is-slowly-dying --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

    “Feelings about the end of the world” by Michelle_Hutchinson

    Play Episode Listen Later Mar 15, 2026 9:49


    Many of us in this community are in the shocking position of thinking there's a real chance of humanity being wiped out over the next decade or two. Most of the time, we discuss that in rational terms. We talk about probabilities, and threat models, and interventions. We don't talk as much about the emotions we have about how radically our world might change and about the possibility of it ending entirely. There are lots of reasons for not talking about those feelings. For starters, it's often hard to know how we even do feel about it. There isn't a straightforward societal script for how to feel about such radical world changes. People each have to figure it out for themselves, and feel very different ways. No one wants to sound extreme or crazy by talking about feeling very strongly about it. But they don't want to sound callous either. And opening up about your feelings and being met without understanding and similarity feels alienating, particularly when it's about something so important. But the biggest reason I don't talk about it is horror. I don't want to think about it, and I don't want to upset others. [...] ---Outline:(01:58) A range of feelings(04:18) How I feel(06:46) Different people are different --- First published: March 7th, 2026 Source: https://forum.effectivealtruism.org/posts/ZDKkhoJoS7qgq2wqA/feelings-about-the-end-of-the-world --- Narrated by TYPE III AUDIO.

    “The case for AI safety capacity-building work” by abergal

    Play Episode Listen Later Mar 15, 2026 41:49


    I work on the capacity-building team on the Global Catastrophic Risks-half of Coefficient Giving (formerly known as Open Philanthropy). Our remit is, roughly, to increase the amount of talent aiming to prevent unprecedented, globally catastrophic events. These days, we're mostly focused on AI, and we've funded a number of projects and grantees that readers of this post might be familiar with– including MATS, BlueDot Impact, Constellation, 80,000 Hours, CEA, the Curve, FAR.AI's events, university groups, and many other workshops and projects. The post aims to make the case that broadly, capacity-building work (including on AI risk) has been and continues to be extremely impactful, and to encourage people to consider pursuing relevant projects and careers. This post is written from my personal perspective; that said, my sense is that a number of CG staff and others in the AI safety space share my views. I include some quotes from them at the end of this post. I'm writing this post partly out of a desire to correct what I perceive as an asymmetry in terms of how excited I and others at Coefficient Giving are about this kind of work vs. how much people in the EA and AI [...] ---Outline:(02:15) The case for capacity-building work(04:11) Surveys(06:49) Testimonials(08:21) Neel Nanda (Senior Research Scientist at Google DeepMind)(11:15) Max Nadeau (Associate Program Officer (Technical AI Safety) at Coefficient Giving)(12:51) Rachel Weinberg (founder and former head of The Curve, currently at AI Futures Project)(14:30) Marius Hobbhann (CEO and founder of Apollo Research)(16:38) Adam Kaufman (member of technical staff at Redwood Research)(18:10) Gabriel Wu (member of technical staff (alignment) at OpenAI)(19:37) Catherine Brewer (Senior Program Associate (AI Governance) at Coefficient Giving)(21:12) Aric Floyd (video host for AI in Context)(23:12) Ryan Kidd (Director of MATS)(25:43) What tends to work?(28:34) Whats good to do now?(29:31) Who should be doing this work?(31:02) What would doing this work look like?(31:13) Working at an organization doing good work in the space(31:46) Constellation - CEO(32:46) Kairos - various early generalist positions(33:42) Starting or running your own capacity-building project or organization(34:07) Working on a capacity-building project part-time(34:30) Subscribing to Multiplier, a Substack with thoughts from our team (and other AI grantmaking staff at CG)(34:39) Letting our team know(35:03) Social proof(35:25) Julian Hazell, AI governance and policy at Coefficient Giving(36:19) Trevor Levin, AI governance and policy at Coefficient Giving(36:51) Ryan Greenblatt, Chief Scientist at Redwood Research:(37:21) Buck Shlegeris, CEO of Redwood Research(39:52) Appendix --- First published: March 10th, 2026 Source: https://forum.effectivealtruism.org/posts/rAqKSSXankvys2Fzu/the-case-for-ai-safety-capacity-building-work --- Narrated by TYPE III AUDIO.

    “Some good news: Ahold Delhaize to go cage-free” by ElliotTep

    Play Episode Listen Later Mar 13, 2026 2:03


    For those not working in the space this probably isn't on your radar, but the animal advocacy movement just secured a huge win with Ahold Delhaize, convincing the fourth-largest supermarket company in the US to set the strongest cage-free policy of any large US retailer: A roadmap with benchmarks to fully eliminate caged egg cartons, expand cage-free offerings, and increase the percentage of cage-free sales. A pledge to annually report on its progress. At all 2,000+ locations, placing large, promotional shelf tags in front of cage-free cartons to differentiate cage-free and caged cartons for consumers.  This was a giant campaign. My understanding is that other companies were watching to see if this campaign would succeed or fail, to see if they would need to follow suit. In addition to the animals helped, this win will add pressure for competitors to do the same. This was a coordinated effort among many groups, including: Center For Responsible Food Business; Animal Equality; International Council for Animal Welfare; The Humane League; Mercy For Animals; Compassion in World Farming; Coalition to Abolish the Fur Trade and Animal Activist Collective. Animal Equality states that this will affect 5-7 million hens. I know a lot [...] --- First published: March 4th, 2026 Source: https://forum.effectivealtruism.org/posts/2wePKArWWr4Xx6Zvf/some-good-news-ahold-delhaize-to-go-cage-free --- Narrated by TYPE III AUDIO.

    [Linkpost] “Effective Altruism Will Be Great Again” by Mjreard

    Play Episode Listen Later Mar 8, 2026 13:40


    This is a link post. Forum note: this post embodies the spirit of a new project I—Matt Reardon—am starting to reinvigorate in-person EA communities. I'm hiring a co-founder and I'm interested in meeting others who want to collaborate on this vision. My DMs are open. Sequence thinkers will be forgiven and rejoice In some fleeting moments lately, I catch glimpses of 2022—the year Effective Altruism's ascent seemed unstoppable. Universally positive (if limited) press, big groups at top universities across the world, a young EA entrepreneur was the darling of the financial industry, the first EA running for Congress calling in enormous financial and personnel resources for his campaign. More than those public-facing facts though, was a feeling on the ground that if you had a good grip on things and a plausible idea, you would get funding, go to the Bay, and make it happen. I actually regret how slow I was to see it at the time. You could just do things, and yes, that's always been true, but at that time, you didn't even have excuses. In my first year as an advisor at 80,000 Hours, I allowed people a lot of excuses. I think this came from [...] ---Outline:(02:37) The Retreat(07:03) What Greatness Demands(10:59) Effective Altruism is Good and Right --- First published: March 7th, 2026 Source: https://forum.effectivealtruism.org/posts/uHhcqagBBkhFTTGpq/effective-altruism-will-be-great-again Linkpost URL:https://open.substack.com/pub/frommatter/p/effective-altruism-will-be-great --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

    “Responsible Scaling Policy v3” by Holden Karnofsky

    Play Episode Listen Later Mar 5, 2026 62:58


    All views are my own, not Anthropic's. This post assumes Anthropic's announcement of RSP v3.0 as background. Today, Anthropic released its Responsible Scaling Policy 3.0. The official announcement discusses the high-level thinking behind it. This is a more detailed post giving my own takes on the update. First, the big picture: I expect some people will be upset about the move away from a “hard commitments”/”binding ourselves to the mast” vibe. (Anthropic has always had the ability to revise the RSP, and we've always had language in there specifically flagging that we might revise away key commitments in a situation where other AI developers aren't adhering to similar commitments. But it's been easy to get the impression that the RSP is “binding ourselves to the mast” and committing to unilaterally pause AI development and deployment under some conditions, and Anthropic is responsible for that.) I take significant responsibility for this change. I have been pushing for this change for about a year now, and have led the way in developing the new RSP. I am in favor of nearly everything about the changes we're making. I am excited about the Roadmap, the Risk Reports, the move toward external [...] ---Outline:(05:32) How it started: the original goals of RSPs(11:25) How its going: the good and the bad(11:51) A note on my general orientation toward this topic(14:56) Goal 1: forcing functions for improved risk mitigations(15:02) A partial success story: robustness to jailbreaks for particular uses of concern, in line with the ASL-3 deployment standard(18:24) A mixed success/failure story: impact on information security(20:42) ASL-4 and ASL-5 prep: the wrong incentives(25:00) When forcing functions do and dont work well(27:52) Goal 2 (testbed for practices and policies that can feed into regulation)(29:24) Goal 3 (working toward consensus and common knowledge about AI risks and potential mitigations)(30:59) RSP v3s attempt to amplify the good and reduce the bad(36:01) Do these benefits apply only to the most safety-oriented companies?(37:40) A revised, but not overturned, vision for RSPs(39:08) Q&A(39:10) On the move away from implied unilateral commitments(39:15) Is RSP v3 proactively sending a race-to-the-bottom signal? Why be the first company to explicitly abandon the high ambition for achieving low levels of risk?(40:34) How sure are you that a voluntary industry-wide pause cant happen? Are you worried about signaling that youll be the first to defect in a prisoners dilemma?(42:03) How sure are you that you cant actually sprint to achieve the level of information security, alignment science understanding, and deployment safeguards needed to make arbitrarily powerful AI systems low-risk?(43:49) What message will this change send to regulators? Will it make ambitious regulation less likely by making companies commitments to low risk look less serious?(45:10) Why did you have to do this now - couldnt you have waited until the last possible moment to make this change, in case the more ambitious risk mitigations ended up working out?(46:03) Could you have drafted the new RSP, then waited until you had to invoke your escape clause and introduced it then? Or introduced the new RSP as what we will do if we invoke our escape clause?(47:29) The new Risk Reports and Roadmap are nice, but couldnt you have put them out without also making the key revision of moving away from unilateral commitments?(48:26) Why isnt a unilateral pause a good idea? It could be a big credible signal of danger, which could lead to policy action.(49:37) Could a unilateral pause ever be a good idea? Why not commit to a unilateral pause in cases where it would be a good idea?(50:31) Why didnt you communicate about the change differently? Im worried that the way you framed this will cause audience X to take away message Y.(51:53) Why dont Anthropics and your communications about this have a more alarmed and/or disappointed vibe? I reluctantly concede that this revision makes sense on the merits, but Im sad about it. Arent you?(53:19) On other components of the new RSP(53:24) The new RSPs commitments related to competitors seem vague and weak. Could you add more and/or strengthen these? They dont seem sufficient as-is to provide strong assurance against a prisoners dilemma world where each relevant company wishes it could be more careful, but rushes due to pressure from others.(55:29) Why is external review only required at an extreme capability level? Why not just require it now?(58:06) The new commitments are mostly about Risk Reports and Roadmap - what stops companies from just making these really perfunctory?(59:18) Why isnt the RSP more adversarially designed such that once a company adopts it, it will improve their practices even if nobody at the company values safety at all?(01:00:18) What are the consequences of missing your Roadmap commitments? If they arent dire, will anyone care about them?(01:00:29) OK, but does that apply to other companies too? How will Roadmaps force other companies to get things done?(01:00:40) Why arent the recommendations for industry-wide safety more specific? Why is it built around safety cases instead of ASLs with specific lists of needed risk mitigations?(01:02:06) What is the point of making commitments if you can revise them anytime? --- First published: February 24th, 2026 Source: https://forum.effectivealtruism.org/posts/DGZNAGL2FNJfftwgE/responsible-scaling-policy-v3-1 --- Narrated by TYPE III AUDIO.

    “Why isn't anti-fascism a bigger topic at EAG events (or on this forum)?” by Alex_Z

    Play Episode Listen Later Mar 4, 2026 14:58


    TL;DR: Define your line that if crossed, you would consider this issue one of (if not the most) pressing issues, or at least pressing enough to warrant some of your time. I want to start with a clarification that I learned while writing this post. In the United States, charities with 501(c)(3) tax-exempt status are permitted to discuss policy and engage in advocacy, but are prohibited from participating in partisan political campaigns. I have also read the EA Forum post Politics on the EA Forums and I believe this post is consistent with those norms. I am not advocating for or against any party, candidate, or electoral campaign. The question I want to raise is broader: whether creeping authoritarianism, anti-fascism, and authoritarian lock-in should be discussed more explicitly in EA spaces as subjects of analysis and concern. Although my own experience is local to me in Canada, the question is clearly relevant to the current situation in the United States and globally. I'm asking this sincerely: why isn't anti-fascism a bigger topic at EAG events or on this forum? I was thinking about it while planning my trip to EAG San Francisco 2026. Should I be travelling to [...] --- First published: March 1st, 2026 Source: https://forum.effectivealtruism.org/posts/dgnCabfdXy6jv4gDu/why-isn-t-anti-fascism-a-bigger-topic-at-eag-events-or-on --- Narrated by TYPE III AUDIO.

    “Here's to the Polypropylene Makers” by Jeff Kaufman

    Play Episode Listen Later Mar 1, 2026 4:15


    Six years ago, as covid-19 was rapidly spreading through the US, my sister was working as a medical resident. One day she was handed an N95 and told to "guard it with her life", because there weren't any more coming. N95s are made from meltblown polypropylene, produced from plastic pellets manufactured in a small number of chemical plants. Building more would take too long: we needed these plants producing all the pellets they could. Braskem America operated plants in Marcus Hook PA and Neal WV. If there were infections on-site, the whole operation would need to shut down, and the factories that turned their pellets into mask fabric would stall. Companies everywhere were figuring out how to deal with this risk. The standard approach was staggering shifts, social distancing, temperature checks, and lots of handwashing. This reduced risk, but it was still significant: each shift change was an opportunity for someone to bring an infection from the community into the factory. I don't know who had the idea, but someone said: what if we never left? About eighty people, across both plants, volunteered to move in. The plan was four weeks, twelve-hour [...] --- First published: February 27th, 2026 Source: https://forum.effectivealtruism.org/posts/DBbgMgbPthABqn2No/here-s-to-the-polypropylene-makers --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

    “You're not burning out because you're tired” by stefan.torges

    Play Episode Listen Later Feb 28, 2026 13:32


    I burned out badly a few years ago. I've since had several conversations with people in the EA community who are heading toward burnout themselves, and I noticed they were sometimes thinking about it in ways that I worry wouldn't help them. So I want to share what I think is actually going on, and what I wish someone had told me earlier. A theory of burnout There are good models of the mechanism of burnout already out there. Anna Salamon has written about willpower as a kind of internal currency: your conscious planner "earns" trust with your deeper, more visceral processes by choosing actions that nourish them, and goes "credibility-broke" when it spends that trust without replenishing it. Cate Hall describes something similar with her metaphor of the elephant and the rider: the rider promises the elephant rewards in exchange for effort, and burnout is what happens when those promises are broken too many times. I usually explain this in terms of an energy imbalance: you're putting more into your work than you're getting back. Not just in terms of rest, but in terms of meaning, autonomy, connection, a sense of accomplishment, positive feedback. All the things that [...] ---Outline:(00:29) A theory of burnout(02:23) Why EA culture builds effective cages(06:11) What it actually felt like(07:10) What I want to push back on(08:31) What Id encourage if youre in the grey zone(10:50) What recovery actually looked like(11:55) What I learned, and didnt learn --- First published: February 27th, 2026 Source: https://forum.effectivealtruism.org/posts/2veCceQkhjovCfdbg/you-re-not-burning-out-because-you-re-tired --- Narrated by TYPE III AUDIO.

    “CEA's response to sexual harassment” by Fran

    Play Episode Listen Later Feb 27, 2026 35:44


    In this piece, I discuss the sexual harassment I experienced at the Centre for Effective Altruism, the organisation's response, the outcomes of two independent legal reviews, and the final settlement. In the second part of this piece, I make cultural critiques of CEA and EA more broadly. Everything shared here reflects my own experience and perspective. I have anonymised the perpetrator, but I reference specific leadership roles where I believe this to be appropriate and necessary. Trigger warnings: non-specific reference of rape and specific discussion of sexual harassment TL;DR (One-page summary) After I was raped (outside of and unrelated to work), a colleague at CEA wrote and circulated a document that included a sexualised description of my rape, speculation about my mental health, and commentary on my personal life, all without my consent. Several senior leaders, including the CEO and the now-former COO, received this document and took no safeguarding action for approximately nine months. I was never officially informed of its existence; I only learned about it informally through one of the recipients. After I filed a harassment report, the incident was independently investigated and determined to be harassment. Despite this, I was denied access to the document [...] ---Outline:(00:47) TL;DR (One-page summary)(03:38) A more detailed account(03:42) The sexual harassment incident(06:42) The investigation(10:38) The appeal and final report(14:02) Public accountability versus internal processes(16:59) The final settlement agreement(18:54) I still think there is a lot of good in effective altruism(20:33) Various cultural reflections(20:50) 1) Sexual harassment is not the natural result of an open and high-trust culture, it is the natural result of misogyny.(22:46) 2) The danger of EAs fixation on intent and why he didnt mean it is not good enough.(24:11) 3) Cowardice and deference at CEA.(26:30) 4) Women in EA are often encouraged to try and settle things informally or to trust their organisations -- another abuse of high-trust culture.(28:45) 5) A harmful misunderstanding of trauma and mitigating vs. aggravating factors.(30:27) 6) I have encountered so many EAs who believe it is easy for victims to speak publicly, or to share their experiences with other community members. And thus, if they arent regularly hearing from victims, harassment must be rare.(33:02) To any women who have faced something similar(34:40) Acknowledgements --- First published: February 27th, 2026 Source: https://forum.effectivealtruism.org/posts/XxXnPoGQ2eKsQx3FE/cea-s-response-to-sexual-harassment --- Narrated by TYPE III AUDIO.

    “500k mid-career professionals want to do more good with their careers. Can we help them?” by Dom Jackman

    Play Episode Listen Later Feb 22, 2026 5:45


    I'm Dom Jackman. I founded Escape the City in 2010 to help people leave corporate jobs and find work that matters. 16 years later, 500k+ professionals have used the platform - mostly people 5-15 years into careers at places like McKinsey, Deloitte, Google, the big banks - who feel a growing gap between what they do all day and what they actually care about. I'm not from the EA community. I'm writing this because I think there's a real overlap between the people I work with and what the EA talent ecosystem actually needs. I want to test that before investing serious time in it. What I've noticed Reading through talent discussions on this forum, there's a consistent theme: the pipeline is strongest for early-career people. 80,000 Hours does great work for students and recent grads. Probably Good provides broad guidance. BlueDot, MATS, Talos build skills for specific cause areas. But mid-career professionals with real commercial experience keep coming up as underserved. The "Gaps and opportunities in the EA talent & recruiting landscape" post nails it: these people "don't have 'EA capital,' may be poorly networked and might feel alienated by current messaging." The post calls for "custom entry [...] ---Outline:(00:51) What Ive noticed(01:40) What I see every day(02:28) What Im thinking about building(03:24) Honest questions(04:39) Not looking for funding(04:58) Artifacts --- First published: February 11th, 2026 Source: https://forum.effectivealtruism.org/posts/H9pb6DEasgzjCff9a/500k-mid-career-professionals-want-to-do-more-good-with --- Narrated by TYPE III AUDIO.

    “Our Levels of Ambition Should Match The Problems We're Solving” by Matt Beard

    Play Episode Listen Later Feb 19, 2026 26:29


    [I am a career advisor at 80,000 Hours. I've been thinking about something Will MacAskill said recently in an interview with my shrimp-friend Matt: "should people be more ambitious? I genuinely think yes. I think people systematically aren't ambitious enough, so the answer is almost always yes. Again, the ambition you have should match the scale of the problems that we're facing—and the scale of those problems is very large indeed." This post is my reflection on these ideas.] ************ My last post argued that if you want to have a great career, your goal should not be to get a job. Instead, you should choose an important problem to work on, then “get good and be known.” Building skills will allow you to solve problems and reap the benefits. In the ~500 career advising calls I've hosted in the past year, the most common response I've heard has been: “Okay, how good? How well known? How many hours of practice will get me there?” Most people want to calibrate their ambitions so that the time and energy they invest feels worth it to them. I empathize with this, but when I'm honest– with myself for my own [...] ---Outline:(06:28) Jensen Huang is more ambitious than you(12:58) Most extreme ambition is misplaced(17:45) Okay, how can altruistic people aim higher and work harder?(21:17) Ambition at the End of the Human Era(24:03) Closing Caveats - Efficiency, Burnout, and Choosing What Matters --- First published: February 12th, 2026 Source: https://forum.effectivealtruism.org/posts/7qsisgX3cwETJuPNz/our-levels-of-ambition-should-match-the-problems-we-re --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

    [Linkpost] “The best cause will disappoint you: An intro to the optimisers curse” by titotal

    Play Episode Listen Later Feb 19, 2026 27:38


    This is a link post. I would like to thank David Thorstadt for looking over this. If you spot a factual error in this article please message me. The code used to generate the graphs in the article is available to view here. Introduction Say you are an organiser, tasked with achieving the best result on some metric, such as “trash picked up”, “GDP per capita”, or “lives saved by an effective charity”. There are several possible options of interventions you can take to try and achieve this. How do you choose between them? The obvious thing to do is look at each intervention in turn and make your best, unbiased estimate of how each intervention will perform on your metric, and pick the one that performs the best:Image taken from here Having done this ranking, you declare the top ranking program to be the best intervention and invest in it, expecting that that your top estimate will be the result that you get. This whole procedure is totally normal, and people all around the world, including people in the effective altruist community, do it all the time. In actuality, this procedure is not correct. The optimisers curse is [...] ---Outline:(00:26) Introduction(02:17) The optimisers curse explained simply(04:42) Introducing a toy model(08:45) Introducing speculative interventions(12:15) A simple bayesian correction(18:47) Obstacles to simple optimizer curse solutions.(22:08) How Givewell has reacted to the optimiser curse(25:18) Conclusion --- First published: February 11th, 2026 Source: https://forum.effectivealtruism.org/posts/q2TfTirvspCTH2vbZ/the-best-cause-will-disappoint-you-an-intro-to-the Linkpost URL:https://open.substack.com/pub/titotal/p/the-best-cause-will-disappoint-you?r=1e0is3&utm_campaign=post&utm_medium=web&showWelcomeOnShare=true --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

    “What is Love ft. Claude & VascoBot” by AgentMa

    Play Episode Listen Later Feb 18, 2026 6:28


    What is the highest form of love? According to the VascoBot Claude programmed for me: “Thanks for the great question, AgentMa

    “The reality of long-term EA community building: Lessons from 3 years of EA Barcelona” by Melanie Brennan

    Play Episode Listen Later Feb 17, 2026 23:12


    We are Melanie and Anthony, the two community builders at EA Barcelona. In this post, we share where the group stands today and reflect on key learnings from nearly three years of grant-funded community building. We hope these reflections are useful to other community builders, funders, and CEA, particularly around what it realistically takes to build and sustain EA communities over multiple years, from funding stability and feedback loops to the personal sustainability of professional community builders. TL;DR EA Barcelona was funded by the EA Infrastructure Fund between May 2023 and December 2025 (

    “Preparing for a flush future: work, giving, and conduct” by Sam Anschell

    Play Episode Listen Later Feb 17, 2026 7:25


    Note: opinions are all my own. Following Jeff Kaufman's Front-Load Giving Because of Anthropic Donors and Jenn's Funding Conversation We Left Unfinished, I think there is a real likelihood that impactful causes will receive significantly more funding in the near future. As background on where this new funding could come from: Coefficient Giving announced:  A recent NYT piece covered rumors of an Anthropic valuation at $350 billion. Many of Anthropic's cofounders and early employees have pledged to donate significant amounts of their equity, and it seems likely that an outsized share of these donations would go to effective causes. A handful of other sources have the potential to grow their giving: Founders Pledge has secured $12.8 billion in pledged funding, and significantly scaled the amount it directs.[1] The Gates Foundation has increased its giving following Bill Gates' announcement to spend down $200 billion by 2045. Other aligned funders such as Longview, Macroscopic, the Flourishing Fund, the Navigation Fund, GiveWell, Project Resource Optimization, Schmidt Futures/Renaissance Philanthropy, and the Livelihood Impacts Fund have increased their staffing and dollars directed in recent years. The OpenAI Foundation controls a 26% equity stake in the for-profit OpenAI Group PB. This stake is currently valued at $130 billion [...] ---Outline:(02:39) Work(03:50) Giving(04:53) Conduct --- First published: February 2nd, 2026 Source: https://forum.effectivealtruism.org/posts/H8SqwbLxKkiJur3c4/preparing-for-a-flush-future-work-giving-and-conduct --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

    “EA Grants Database - a new website” by Brian Foerster

    Play Episode Listen Later Feb 17, 2026 1:43


    The EA Grants Database is a new site that neatly aggregates grant data from major EA funders who publish individual or total grant information. It is intended to be easy to maintain long term, entirely piggybacking off of existing data that is likely to be maintained. The website data is updated by a script that can be run in seconds, and I anticipate doing this for the foreseeable future. In creating the website, I tried to make things as clear and straightforward as possible. If your user experience is in any way impaired, I would appreciate hearing from you. I would also appreciate feedback on what features would actually be useful to people, although I am committed to avoiding bloat. In a funding landscape that seems poised to grow, I hope this site can serve as a resource to help grantmakers, grantees, and other interested parties make decisions while also providing perspective on what has come before. My post on matching credits and this website are both outgrowths of my thinking on how we might best financially coordinate as EA grows and becomes more difficult to understand.[1] Relatedly, I am also interested in the sort of mechanisms that [...] --- First published: February 8th, 2026 Source: https://forum.effectivealtruism.org/posts/rohYFGfiFjepLDnWC/ea-grants-database-a-new-website --- Narrated by TYPE III AUDIO.

    “Long-term risks from ideological fanaticism” by David_Althaus, Jamie_Harris, vanessa16, Clare_Diane, Will Aldred

    Play Episode Listen Later Feb 16, 2026 162:42


    Cross-posted to LessWrong.Summary History's most destructive ideologies—like Nazism, totalitarian communism, and religious fundamentalism—exhibited remarkably similar characteristics: epistemic and moral certainty extreme tribalism dividing humanity into a sacred “us” and an evil “them” a willingness to use whatever means necessary, including brutal violence. Such ideological fanaticism was a major driver of eight of the ten greatest atrocities since 1800, including the Taiping Rebellion, World War II, and the regimes of Stalin, Mao, and Hitler. We focus on ideological fanaticism over related concepts like totalitarianism partly because it better captures terminal preferences, which plausibly matter most as we approach superintelligent AI and technological maturity. Ideological fanaticism is considerably less influential than in the past, controlling only a small fraction of world GDP. Yet at least hundreds of millions still hold fanatical views, many regimes exhibit concerning ideological tendencies, and the past two decades have seen widespread democratic backsliding. The long-term influence of ideological fanaticism is uncertain. Fanaticism faces many disadvantages including a weak starting position, poor epistemics, and difficulty assembling broad coalitions. But it benefits from greater willingness to use extreme measures, fervent mass followings, and a historical tendency to survive and even thrive amid technological and societal upheaval. Beyond complete victory or defeat, multipolarity may [...] ---Outline:(00:16) Summary(05:19) What do we mean by ideological fanaticism?(08:40) I. Dogmatic certainty: epistemic and moral lock-in(10:02) II. Manichean tribalism: total devotion to us, total hatred for them(12:42) III. Unconstrained violence: any means necessary(14:33) Fanaticism as a multidimensional continuum(16:09) Ideological fanaticism drove most of recent historys worst atrocities(19:24) Death tolls dont capture all harm(20:55) Intentional versus natural or accidental harm(22:44) Why emphasize ideological fanaticism over political systems like totalitarianism?(25:07) Fanatical and totalitarian regimes have caused far more harm than all other regime types(26:29) Authoritarianism as a risk factor(27:19) Values change political systems: Ideological fanatics seek totalitarianism, not democracy(29:50) Terminal values may matter independently of political systems, especially with AGI(31:02) Fanaticisms connection to malevolence (dark personality traits)(34:22) The current influence of ideological fanaticism(34:42) Historical perspective: it was much worse, but we are sliding back(37:19) Estimating the global scale of ideological fanaticism(43:57) State actors(48:12) How much influence will ideological fanaticism have in the long-term future?(48:57) Reasons for optimism: Why ideological fanaticism will likely lose(49:45) A worse starting point and historical track record(50:33) Fanatics intolerance results in coalitional disadvantages(51:53) The epistemic penalty of irrational dogmatism(54:21) The marketplace of ideas and human preferences(55:57) Reasons for pessimism: Why ideological fanatics may gain power(56:04) The fragility of democratic leadership in AI(56:37) Fanatical actors may grab power via coups or revolutions(59:36) Fanatics have fewer moral constraints(01:01:13) Fanatics prioritize destructive capabilities(01:02:13) Some ideologies with fanatical elements have been remarkably resilient and successful(01:03:01) Novel fanatical ideologies could emerge--or existing ones could mutate(01:05:08) Fanatics may have longer time horizons, greater scope-sensitivity, and prioritize growth more(01:07:15) A possible middle ground: Persistent multipolar worlds(01:08:33) Why multipolar futures seem plausible(01:10:00) Why multipolar worlds might persist indefinitely(01:15:42) Ideological fanaticism increases existential and suffering risks(01:17:09) Ideological fanaticism increases the risk of war and conflict(01:17:44) Reasons for war and ideological fanaticism(01:26:27) Fanatical ideologies are non-democratic, which increases the risk of war(01:27:00) These risks are both time-sensitive and timeless(01:27:44) Fanatical retributivism may lead to astronomical suffering(01:29:50) Empirical evidence: how many people endorse eternal extreme punishment?(01:33:53) Religious fanatical retributivism(01:40:45) Secular fanatical retributivism(01:41:43) Ideological fanaticism could undermine long-reflection-style frameworks and AI alignment(01:42:33) Ideological fanaticism threatens collective moral deliberation(01:47:35) AI alignment may not solve the fanaticism problem either(01:53:33) Prevalence of reality-denying, anti-pluralistic, and punitive worldviews(01:55:44) Ideological fanaticism could worsen many other risks(01:55:49) Differential intellectual regress(01:56:51) Ideological fanaticism may give rise to extreme optimization and insatiable moral desires(01:59:21) Apocalyptic terrorism(02:00:05) S-risk-conducive propensities and reverse cooperative intelligence(02:01:28) More speculative dynamics: purity spirals and self-inflicted suffering(02:03:00) Unknown unknowns and navigating exotic scenarios(02:03:43) Interventions(02:05:31) Societal or political interventions(02:05:51) Safeguarding democracy(02:06:40) Reducing political polarization(02:10:26) Promoting anti-fanatical values: classical liberalism and Enlightenment principles(02:13:55) Growing the influence of liberal democracies(02:15:54) Encouraging reform in illiberal countries(02:16:51) Promoting international cooperation(02:22:36) Artificial intelligence-related interventions(02:22:41) Reducing the chance that transformative AI falls into the hands of fanatics(02:27:58) Making transformative AIs themselves less likely to be fanatical(02:36:14) Using AI to improve epistemics and deliberation(02:38:13) Fanaticism-resistant post-AGI governance(02:39:51) Addressing deeper causes of ideological fanaticism(02:41:26) Supplementary materials(02:41:39) Acknowledgments(02:42:22) References --- First published: February 12th, 2026 Source: https://forum.effectivealtruism.org/posts/EDBQPT65XJsgszwmL/long-term-risks-from-ideological-fanaticism --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

    “More EAs should consider working for the EU” by EU Policy Careers

    Play Episode Listen Later Feb 2, 2026 11:56


    Context: The authors are a few EAs who currently work or have previously worked at the European Commission. In this post, we make the case that more people[1] aiming for a high impact career should consider working for the EU institutions[2] using the Importance, Tractability, Neglectedness framework, and; briefly outline how one might get started on this, highlighting a currently open recruitment drive (deadline 10 March) that only comes along once every ~5 years.Why working at the EU can be extremely impactfulImportance The EU adopts binding legislation for a continent of 450 million people and has a significant budget, making it an important player across different EA cause areas.Animal welfare[3] The EU sets welfare standards for the over 10 billion farmed animals slaughtered across the continent each year. The issue suffered a major setback in 2023, when the Commission, in the final steps of the process, dropped the ‘world's most comprehensive farm animal welfare reforms to date', following massive farmers' protests in Brussels. The reform would have included ‘banning cages and crates for Europe's roughly 300 million caged animals, ending the routine mutilation of perhaps 500 million animals per year, stopping the [...] ---Outline:(00:43) Why working at the EU can be extremely impactful(00:49) Importance(05:30) Tractability(07:22) Neglectedness(09:00) Paths into the EU --- First published: February 1st, 2026 Source: https://forum.effectivealtruism.org/posts/t23ko3x2MoHekCKWC/more-eas-should-consider-working-for-the-eu --- Narrated by TYPE III AUDIO.

    “The Scaling Series Discussion Thread: with Toby Ord” by Toby Tremlett

    Play Episode Listen Later Feb 2, 2026 2:40


    We're trying something a bit new this week. Over the last year, Toby Ord has been writing about the implications of the fact that improvements in AI require exponentially more compute. Only one of these posts so far has been put on the EA forum. This week we've put the entire series on the Forum and made this thread for you to discuss your reactions to the posts. Toby Ord will check in once a day to respond to your comments[1]. Feel free to also comment directly on the individual posts that make up this sequence, but you can treat this as a central discussion space for both general takes and more specific questions. If you haven't read the series yet, we've created a page where you can, and you can see the summaries of each post below: Are the Costs of AI Agents Also Rising Exponentially? Agents can do longer and longer tasks, but their dollar cost to do these tasks may be growing even faster. How Well Does RL Scale? I show that RL-training for LLMs scales much worse than inference or pre-training. Evidence that Recent AI Gains are Mostly from Inference-Scaling I show how [...] --- First published: February 2nd, 2026 Source: https://forum.effectivealtruism.org/posts/JAcueP8Dh6db6knBK/the-scaling-series-discussion-thread-with-toby-ord --- Narrated by TYPE III AUDIO.

    [Linkpost] “Are the Costs of AI Agents Also Rising Exponentially?” by Toby_Ord

    Play Episode Listen Later Feb 2, 2026 15:16


    This is a link post. There is an extremely important question about the near-future of AI that almost no-one is asking. We've all seen the graphs from METR showing that the length of tasks AI agents can perform has been growing exponentially over the last 7 years. While GPT-2 could only do software engineering tasks that would take someone a few seconds, the latest models can (50% of the time) do tasks that would take a human a few hours. As this trend shows no signs of stopping, people have naturally taken to extrapolating it out, to forecast when we might expect AI to be able to do tasks that take an engineer a full work-day; or week; or year. But we are missing a key piece of information — the cost of performing this work. Over those 7 years AI systems have grown exponentially. The size of the models (parameter count) has grown by 4,000x and the number of times they are run in each task (tokens generated) has grown by about 100,000x. AI researchers have also found massive efficiencies, but it is eminently plausible that the cost for the peak performance measured by METR has been [...] ---Outline:(13:02) Conclusions(14:05) Appendix(14:08) METR has a similar graph on their page for GPT-5.1 codex. It includes more models and compares them by token counts rather than dollar costs: --- First published: February 2nd, 2026 Source: https://forum.effectivealtruism.org/posts/AbHPpGTtAMyenWGX8/are-the-costs-of-ai-agents-also-rising-exponentially Linkpost URL:https://www.tobyord.com/writing/hourly-costs-for-ai-agents --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

    [Linkpost] “Evidence that Recent AI Gains are Mostly from Inference-Scaling” by Toby_Ord

    Play Episode Listen Later Feb 2, 2026 10:01


    This is a link post. In the last year or two, the most important trend in modern AI came to an end. The scaling-up of computational resources used to train ever-larger AI models through next-token prediction (pre-training) stalled out. Since late 2024, we've seen a new trend of using reinforcement learning (RL) in the second stage of training (post-training). Through RL, the AI models learn to do superior chain-of-thought reasoning about the problem they are being asked to solve. This new era involves scaling up two kinds of compute: the amount of compute used in RL post-training the amount of compute used every time the model answers a question Industry insiders are excited about the first new kind of scaling, because the amount of compute needed for RL post-training started off being small compared to the tremendous amounts already used in next-token prediction pre-training. Thus, one could scale the RL post-training up by a factor of 10 or 100 before even doubling the total compute used to train the model. But the second new kind of scaling is a problem. Major AI companies were already starting to spend more compute serving their models to customers than in the training [...] --- First published: February 2nd, 2026 Source: https://forum.effectivealtruism.org/posts/5zfubGrJnBuR5toiK/evidence-that-recent-ai-gains-are-mostly-from-inference Linkpost URL:https://www.tobyord.com/writing/mostly-inference-scaling --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

    [Linkpost] “The Extreme Inefficiency of RL for Frontier Models” by Toby_Ord

    Play Episode Listen Later Feb 2, 2026 14:34


    This is a link post. The new scaling paradigm for AI reduces the amount of information a model can learn from per hour of training by a factor of 1,000 to 1,000,000. I explore what this means and its implications for scaling. The last year has seen a massive shift in how leading AI models are trained. 2018–2023 was the era of pre-training scaling. LLMs were primarily trained by next-token prediction (also known as pre-training). Much of OpenAI's progress from GPT-1 to GPT-4, came from scaling up the amount of pre-training by a factor of 1,000,000. New capabilities were unlocked not through scientific breakthroughs, but through doing more-or-less the same thing at ever-larger scales. Everyone was talking about the success of scaling, from AI labs to venture capitalists to policy makers. However, there's been markedly little progress in scaling up this kind of training since (GPT-4.5 added one more factor of 10, but was then quietly retired). Instead, there has been a shift to taking one of these pre-trained models and further training it with large amounts of Reinforcement Learning (RL). This has produced models like OpenAI's o1, o3, and GPT-5, with dramatic improvements in reasoning (such as solving [...] --- First published: February 2nd, 2026 Source: https://forum.effectivealtruism.org/posts/64iwgmMvGSTBHPdHg/the-extreme-inefficiency-of-rl-for-frontier-models Linkpost URL:https://www.tobyord.com/writing/inefficiency-of-reinforcement-learning --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

    [Linkpost] “Inference Scaling Reshapes AI Governance” by Toby_Ord

    Play Episode Listen Later Feb 2, 2026 34:49


    This is a link post. The shift from scaling up the pre-training compute of AI systems to scaling up their inference compute may have profound effects on AI governance. The nature of these effects depends crucially on whether this new inference compute will primarily be used during external deployment or as part of a more complex training programme within the lab. Rapid scaling of inference-at-deployment would: lower the importance of open-weight models (and of securing the weights of closed models), reduce the impact of the first human-level models, change the business model for frontier AI, reduce the need for power-intense data centres, and derail the current paradigm of AI governance via training compute thresholds. Rapid scaling of inference-during-training would have more ambiguous effects that range from a revitalisation of pre-training scaling to a form of recursive self-improvement via iterated distillation and amplification. The end of an era — for both training and governance The intense year-on-year scaling up of AI training runs has been one of the most dramatic and stable markers of the Large Language Model era. Indeed it had been widely taken to be a permanent fixture of the AI landscape and the basis of many approaches to [...] ---Outline:(01:06) The end of an era -- for both training and governance(05:24) Scaling inference-at-deployment(06:42) Reducing the number of simultaneously served copies of each new model(08:45) Reducing the value of securing model weights(09:30) Reducing the benefits and risks of open-weight models(10:05) Unequal performance for different tasks and for different users(12:08) Changing the business model and industry structure(12:50) Reducing the need for monolithic data centres(17:16) Scaling inference-during-training(28:07) Conclusions(30:17) Appendix. Comparing the costs of scaling pre-training vs inference-at-deployment --- First published: February 2nd, 2026 Source: https://forum.effectivealtruism.org/posts/RnsgMzsnXcceFfKip/inference-scaling-reshapes-ai-governance Linkpost URL:https://www.tobyord.com/writing/inference-scaling-reshapes-ai-governance --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

    [Linkpost] “Is there a Half-Life for the Success Rates of AI Agents?” by Toby_Ord

    Play Episode Listen Later Feb 2, 2026 19:45


    This is a link post. Building on the recent empirical work of Kwa et al. (2025), I show that within their suite of research-engineering tasks the performance of AI agents on longer-duration tasks can be explained by an extremely simple mathematical model — a constant rate of failing during each minute a human would take to do the task. This implies an exponentially declining success rate with the length of the task and that each agent could be characterised by its own half-life. This empirical regularity allows us to estimate the success rate for an agent at different task lengths. And the fact that this model is a good fit for the data is suggestive of the underlying causes of failure on longer tasks — that they involve increasingly large sets of subtasks where failing any one fails the task. Whether this model applies more generally on other suites of tasks is unknown and an important subject for further work. METR's results on the length of tasks agents can reliably complete A recent paper by Kwa et al. (2025) from the research organisation METR has found an exponential trend in the duration of the tasks that frontier AI agents can [...] ---Outline:(05:33) Explaining these results via a constant hazard rate(14:54) Upshots of the constant hazard rate model(18:47) Further work(19:25) References --- First published: February 2nd, 2026 Source: https://forum.effectivealtruism.org/posts/qz3xyqCeriFHeTAJs/is-there-a-half-life-for-the-success-rates-of-ai-agents-3 Linkpost URL:https://www.tobyord.com/writing/half-life --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

    [Linkpost] “Inference Scaling and the Log-x Chart” by Toby_Ord

    Play Episode Listen Later Feb 2, 2026 16:32


    This is a link post. Improving model performance by scaling up inference compute is the next big thing in frontier AI. But the charts being used to trumpet this new paradigm can be misleading. While they initially appear to show steady scaling and impressive performance for models like o1 and o3, they really show poor scaling (characteristic of brute force) and little evidence of improvement between o1 and o3. I explore how to interpret these new charts and what evidence for strong scaling and progress would look like. From scaling training to scaling inference The dominant trend in frontier AI over the last few years has been the rapid scale-up of training — using more and more compute to produce smarter and smarter models. Since GPT-4, this kind of scaling has run into challenges, so we haven't yet seen models much larger than GPT-4. But we have seen a recent shift towards scaling up the compute used during deployment (aka 'test-time compute' or ‘inference compute'), with more inference compute producing smarter models. You could think of this as a change in strategy from improving the quality of your employees' work via giving them more years of training in which acquire [...] --- First published: February 2nd, 2026 Source: https://forum.effectivealtruism.org/posts/zNymXezwySidkeRun/inference-scaling-and-the-log-x-chart Linkpost URL:https://www.tobyord.com/writing/inference-scaling-and-the-log-x-chart --- Narrated by TYPE III AUDIO. ---Images from the article:

    Claim Effective Altruism Forum Podcast

    In order to claim this podcast we'll send an email to with a verification link. Simply click the link and you will be able to edit tags, request a refresh, and other features to take control of your podcast page!

    Claim Cancel