Podcasts about dreadnoughts

Discover why dreadnought guitars dominate the singer-songwriter world and learn what makes the Yamaha FG830 an affordable standout. From powerful projection to warm tones, experts break down the features that matter most for performers.Info: https://www.samash.com/yamaha-fg830-acoustic-guitar-natural-yfg830xxx Sam Ash City: Hicksville Address: 278 Duffy Ave Website: https://www.samash.com/

Agradece a este podcast tantas horas de entretenimiento y disfruta de episodios exclusivos como éste. ¡Apóyale en iVoox! La botadura del HMS Dreadnought en 1906 supuso una auténtica revolución naval: su combinación de artillería de gran calibre unificada, blindaje avanzado y propulsión por turbinas lo convirtió en un buque tan superior que dejó obsoletas a todas las flotas existentes de un solo golpe. Su aparición desencadenó una carrera armamentística sin precedentes, especialmente entre el Reino Unido y Alemania, pero también involucró a potencias como Estados Unidos, Japón, Rusia o Italia, que se vieron obligadas a rediseñar sus marinas para no quedar atrás. En apenas unos años, las naciones compitieron frenéticamente por construir acorazados cada vez más grandes, rápidos y poderosos, transformando el equilibrio naval mundial y alimentando las tensiones que precedieron a la Primera Guerra Mundial. ------------------------------------------------------------------------------------- 🎧 Antena Historia te regala 30 días PREMIUM Disfruta de todo el contenido sin interrupciones y con ventajas exclusivas en iVoox: 👉 https://www.ivoox.com/premium?affiliate-code=b4688a50868967db9ca413741a54cea5 📻 Producción y realización: Antonio Cruz 🎙️ Edición: Antena Historia 📡 Antena Historia forma parte del sello iVoox Originals 🌐 Visita nuestra web: https://antenahistoria.com 📺 YouTube: Podcast Antena Historia 📧 Correo: antenahistoria@gmail.com 📘 Facebook: Antena Historia Podcast 🐦 Twitter: @AntenaHistoria 💬 Telegram: https://t.me/foroantenahistoria 💰 Apoya el proyecto: Donaciones en PayPal 📢 ¿Quieres anunciarte en Antena Historia? Ofrecemos menciones, cuñas personalizadas y programas a medida. Más información en 👉 Antena Historia – AdVoices Escucha el episodio completo en la app de iVoox, o descubre todo el catálogo de iVoox Originals

Agradece a este podcast tantas horas de entretenimiento y disfruta de episodios exclusivos como éste. ¡Apóyale en iVoox! La botadura del HMS Dreadnought en 1906 supuso una auténtica revolución naval: su combinación de artillería de gran calibre unificada, blindaje avanzado y propulsión por turbinas lo convirtió en un buque tan superior que dejó obsoletas a todas las flotas existentes de un solo golpe. Su aparición desencadenó una carrera armamentística sin precedentes, especialmente entre el Reino Unido y Alemania, pero también involucró a potencias como Estados Unidos, Japón, Rusia o Italia, que se vieron obligadas a rediseñar sus marinas para no quedar atrás. En apenas unos años, las naciones compitieron frenéticamente por construir acorazados cada vez más grandes, rápidos y poderosos, transformando el equilibrio naval mundial y alimentando las tensiones que precedieron a la Primera Guerra Mundial. ------------------------------------------------------------------------------------- 🎧 Antena Historia te regala 30 días PREMIUM Disfruta de todo el contenido sin interrupciones y con ventajas exclusivas en iVoox: 👉 https://www.ivoox.com/premium?affiliate-code=b4688a50868967db9ca413741a54cea5 📻 Producción y realización: Antonio Cruz 🎙️ Edición: Antena Historia 📡 Antena Historia forma parte del sello iVoox Originals 🌐 Visita nuestra web: https://antenahistoria.com 📺 YouTube: Podcast Antena Historia 📧 Correo: antenahistoria@gmail.com 📘 Facebook: Antena Historia Podcast 🐦 Twitter: @AntenaHistoria 💬 Telegram: https://t.me/foroantenahistoria 💰 Apoya el proyecto: Donaciones en PayPal 📢 ¿Quieres anunciarte en Antena Historia? Ofrecemos menciones, cuñas personalizadas y programas a medida. Más información en 👉 Antena Historia – AdVoices Escucha el episodio completo en la app de iVoox, o descubre todo el catálogo de iVoox Originals

Innovation and Tradition: Taylor Guitars at NAMM 2026Walking into the Taylor booth at NAMM 2026 felt like stepping into a sonic candy store. Jim Kirlin's words, not mine—but he's right.I sat down with Jim to talk about what Taylor is bringing to the table this year, and it comes down to two distinct directions: the Next Generation Grand Auditorium series and the Gold Label Collection. Modern innovation on one side, vintage inspiration on the other.The Next Gen guitars build on Taylor's flagship Grand Auditorium—that versatile middle-size body that works for everything from fingerpicking to strumming. But they've added three significant upgrades.First is the Action Control Neck. It's a patented design with a long tenon joint that enhances resonance and tonal transfer between neck and body. More importantly, it lets players adjust string height in seconds through the sound hole. Climate changes, different venues, personal preference—you can dial it in on the fly. That's the kind of player-centric thinking that removes obstacles from the playing experience.Second is Scalloped V-Class Bracing. Andy Powers introduced V-Class back in 2018, and this evolution adds warmth and low end while maintaining that clear, balanced Taylor articulation. You get more of everything without losing what makes a Taylor sound like a Taylor.Third is the new Claria Pickup system. It's discreet—sound hole mounted with volume, mid contour, and tone controls. The goal was simplicity. Plug in, play, express yourself. No fussing with complicated setups depending on the venue. Just reliable amplified sound wherever you are.Then there's the Gold Label Collection—a completely different approach.These are non-cutaway guitars with traditional styling inspired by instruments from the 1930s and 40s. Andy Powers designed them to broaden Taylor's tonal palette and reach players who've never been drawn to the brand before.The new square shoulder dreadnought caught my attention. Deeper body dimensions than a traditional Taylor dread, with serious lung capacity inside. You strum those chords and feel the low end push back. Fan V-Class Bracing gives it projection and response that traditional dreadnought fans will appreciate.There's also round shoulder dreadnoughts and super auditoriums—the latter based on the Grand Auditorium but with all the curves pushed out for more air mass. Many feature torrified tops that give them an aged, played-in character right out of the case.The headstock shape is different. The logo styling is older. It's Taylor paying respect to tradition while still building with modern precision.What struck me most was how intentional both directions are. Taylor isn't abandoning their modern sound—they're expanding what's possible. Next Gen for players who want cutting-edge innovation. Gold Label for players who want vintage warmth and resonance.Two paths. Same commitment to removing obstacles and inspiring players.That's 50 years of guitar making at work.Sean Martin interviews Jim Kirlin from Taylor Guitars at NAMM 2026 for ITSPmagazine.__________________________This is a Brand Highlight. A Brand Highlight is an introductory conversation designed to put a spotlight on the guest and their company. Learn more: https://www.studioc60.com/creation#highlightGUESTSJim KirlinEditorial Director at Taylor GuitarsRESOURCESLearn more about Taylir Guitars Strings Guitars: https://www.taylorguitars.comAre you interested in telling your story?▶︎ Full Length Brand Story: https://www.studioc60.com/content-creation#full▶︎ Brand Spotlight Story: https://www.studioc60.com/content-creation#spotlight▶︎ Brand Highlight Story: https://www.studioc60.com/content-creation#highlight Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Katie Robinette:Katie is an entertainment professional, vocalist, and entrepreneur from York, PA. She has built a 25-year career spanning live performance, artist development, and music-business leadership. In 2016, Katie co-founded Robin-Banks Entertainment, LLC with Amy Banks in Central Pennsylvania. Robin-Banks Entertainment is a 100% woman-owned company led by Katie as founder and CEO, serving clients throughout the Mid-Atlantic region. In addition to the business and fronting Central City Orchestra as a bandleader and vocalist, she mentors emerging musicians, serves on music industry advisory boards at York College of Pennsylvania and Harrisburg Area Community College.https://www.katierobinette.com/https://www.rbelive.com/Dan Brenner:2025 Educator of Note - Dan is the Director of Modern Music for Spring Grove Area High School with 24 years of dedicated instruction. His accolades include being a quarter-finalist for the Grammy Educator Award and earning recognition as an Outstanding Teacher by Shippensburg University. Dan has a dual bachelor's degrees in Music Education and Music with a focus on jazz and percussion, a master's degrees in Classroom Technology from Wilkes University and in Music Education from Lebanon Valley College. Dan performs live as a solo artist and in many bands; one of which, Dreadnoughts, has recorded 7 albums.You will be able to see Dan receive his Educator of Note Award at the 7th Annual CPMAs on March 4th, 2026 in Lancaster PA. Get your tickets now!https://www.facebook.com/DanBrennerMusic/https://www.sgasd.org/district-news/~board/district-news/post/dan-brenner-recognized-by-central-pa-music-hall-of-famehttps://cpmhof.com/educators-of-noteYou can find out more about the CPMHOF @ https://cpmhof.com/Brought to you by Darker with Daniel @ Studio 3.http://darkerwithdaniel.com/All media requests: thecpmpodcast@gmail.comWant to be on an episode of the CPMP? For all considerations please fill out a form @ https://cpmhof.com/guest-considerationJoin us back here or on your favorite audio streaming platform every other week for more content.

https://www.patreon.com/AdeptusRidiculoushttps://www.adeptusridiculous.com/https://twitter.com/AdRidiculoushttps://shop.orchideight.com/collections/adeptus-ridiculous​Bjorn is not just a Space Wolf; in many respects, he is THE Space Wolf. From walking beside the Allfather himself during the Great Crusade to spending the last 10,000 years napping in a Dreadnought, Bjorn has a saga longer than the modern Imperium. ​In this episode, we cover the absolute unit that is Bjorn the Fell-Handed. We dive into his early days of accidentally shooting down Kasper Hawser (oopsies), his five-year hunt for the demon Arvax to avenge his pack, and the conflicting sources on how exactly he lost his hand—was it chopped off by Valdor or lost to a demon on Prospero?. ​But it's not all ancient history. We also break down the Battle of the Fang, where a very angry, freshly-woken Bjorn decided to treat a Daemon Primarch like a piñata. Plus, we discuss the time he told the Inquisition to shove it, reminding them that calling the Emperor a "god" is exactly how this whole mess started.Support the show

Canal de Telegram:https://t.me/w40k_prietoComunidad de Telegram:https://t.me/wppcomunidadSpotify: https://open.spotify.com/show/06BWSGtQmYM6IOk1dnAFS1?si=MtNYGpQCS8OnRXluQrnlTA&utm_source=copy-linkIvoox: https://www.ivoox.com/p_sq_f11064076_1.htmlPatreon - apóyanos para tener beneficios!https://www.patreon.com/wppAnchor: https://anchor.fm/wpp40kCorreo de contacto: wpp40k@gmail.comLos twitters de los anfitriones:Kench - @UrsusKenchFascio - @fascio_aeternum

There's zero doubt, Absolute Batman Annual #1 will be one of the year's most talked-about comics. Featuring three stories by Daniel Warren Johnson, Mike Spicer, James Harren, Dave Stewart, Meredith McClaren, and Clayton Cowles, this hefty comic centers on the early Absolute Universe adventures of Bruce Wayne, revealing how that chonky Batmobile came to be, and just how Black Mask's party animals first encountered the Dark Knight. We read the comic a couple of weeks back, and the instant we flipped that last page, we were compelled to get Daniel Warren Johnson into a Zoom room. Thankfully, he obliged. Johnson's untitled story makes up the bulk of the Absolute Batman Annual. It propels Absolute Batman against a white supremacist horde, showcasing some of the most brutal action from the ongoing series so far, while doing so in a way that questions that violence's effectiveness. As Daniel Warren Johnson has showcased in other comics like Murder Falcon, Do a Powerbomb!, and his recent run on Transformers, badass, jaw-dropping visuals are only half his might as a creator. DWJ breaks hearts as often as he breaks bones. “It's in my blood and it's boiling, and I have to get it out.” In an exclusive conversation with Comic Book Couples Counseling, Johnson explains how his tale in the Absolute Batman Annual came to pass. We discuss his reluctance to contribute to the world so expertly crafted by Scott Snyder and Nick Dragotta, and how one single image eventually caused him to put everything he had into this character and universe. Daniel Warren Johnson tells us why supplying only compelling, catastrophic action isn't enough for him as a storyteller. He requires more than an exclamation point to climax his stories. He needs a question. Absolute Batman Annual is now available from DC Comics. Make sure you're following Daniel Warren Johnson on Blue Sky, Instagram, and his Website. This Week's Sponsors Judge Dredd Megazine turns thirty-five years old this October, and it'll be celebrating with a very special issue perfect for first-time readers! Featuring the return of the critically acclaimed series Dreadnoughts and Megalopolis, this 100-page issue is a brilliant way to jump into the crazy world of 2000 AD. You'll also find incredible new stories featuring Judge Dredd, Judge Anderson, and much more inside! Get a print subscription to the Megazine and it'll arrive through your American mailbox every month – or get a combi subscription and receive 2000 AD each week as well! If you subscribe digitally, you can download DRM-free copies of each issue for only $9 a month. That's 128 pages of incredible comics every month for less than $10! Head to 2000AD.com and click on ‘subscribe' now – or download the 2000 AD app and start reading today! Launching this October, it's the latest entry in IDW Publishing's Kei-Sei line of Godzilla comics: Starship Godzilla, a cosmic adventure. It's written by award-winning scribe Chris Gooch (of In Utero fame) and illustrated by inventive artist Oliver Ono (I mean, come on, did you read their Godzilla: Monster Island Summer Camp? Insta-Classic). The Kai-Sei Era is the only ongoing Godzilla story of its kind, crafted for comics readers who have never bought a Godzilla book and Godzilla fans who have never read a comic. Starship Godzilla #1 is out now wherever rad comic books are sold. Other Relevant Links to This Week's Episode: Subscribe to The Stacks, Comic Creators Name Their Favorite Comics Previously On CBCC: Daniel Warren Johnson Live at Now or Never Comics Previously On CBCC: Daniel Warren Johnson and Riley Rossmo on The Moon is Following Us Previously On CBCC: Daniel Warren Johnson on Transformers Previously On CBCC: Daniel Warren Johnson on Do a Powerbomb! Previously On CBCC: Daniel Warren Johnson on Beta Ray Bill Previously On CBCC: Scott Snyder and Nick Dragotta on Absolute Batman The Comics Crossover Event with The Short Box, Oblivion Bar, Off Panel, and CBCC Watch The Harvey Awards on Popverse Final Round of Plugs (PHEW): Support the Podcast by Joining OUR PATREON COMMUNITY. The Comic Book Couples Counseling TeePublic Merch Page. And, of course, follow Comic Book Couples Counseling on Facebook, on Instagram, and on Bluesky @CBCCPodcast, and you can follow hosts Brad Gullickson @MouthDork & Lisa Gullickson @sidewalksiren. Send us your Words of Affirmation by leaving us a 5-star Review on Apple Podcasts. Continue your conversation with CBCC by hopping over to our website, where we have reviews, essays, and numerous interviews with comic book creators. Podcast logo by Jesse Lonergan and Hassan Otsmane-Elhaou.

We all crave a good meal. The challenge is savoring it once it's placed before you. Kelley Jones and Matt Wagner have wickedly, and delightfully, discovered a way to make Bram Stoker's Dracula not one good dish, but three...and possibly four and five. For the last several years, they've transformed the classic vampire novel into a feast impossible to gobble down in one sitting. By taking throwaway sentences in the book and building two graphic novels out of them (Dracula Book I: The Impaler, Dracula Book II: The Brides), they've miraculously extended their love affair with Vlad, and ours in the process as well. Now, with Dracula Book III: The Count, which only has a week left on Kickstarter, Jones and Kelley properly excavate Bram Stoker's book. This third entry tackles the iconic plot, but only from Count Dracula's perspective. We all know this story from Jonathan Harker, Mina, and Van Helsing's point of view, but how did the vicious beast at the center of their fear experience the whole endeavor? No more letters. Only the Count's singular, hungry howl of self. We've read and watched many Dracula adaptations, but none as exhaustive and creative as this. As a result, this week's podcast had to match Jones and Wagner's studious passion. All together, we dig deep into their previous entry, Dracula Book II: The Brides. We discuss how, in chaining themselves to Dracula's perspective, they create unparalleled empathy for the monster and his godless pursuits. Is there danger in that? Again, Dracula: The Count only has seven days left on its Kickstarter campaign. Please visit the crowdfunding project by clicking HERE. You can continue the conversation with Kelley Jones by visiting his Instagram. You can follow Matt Wagner on Blue Sky and Instagram. This Week's Sponsors Launching this October, it's the latest entry in IDW Publishing's Kei-Sei line of Godzilla comics: Starship Godzilla, a cosmic adventure. It's written by award-winning scribe Chris Gooch (of In Utero fame) and illustrated by inventive artist Oliver Ono (I mean, come on, did you read their Godzilla: Monster Island Summer Camp? Insta-Classic). The Kai-Sei Era is the only ongoing Godzilla story of its kind, crafted for comics readers who have never bought a Godzilla book and Godzilla fans who have never read a comic. Starship Godzilla #1 is out now wherever rad comic books are sold. Judge Dredd Megazine turns thirty-five years old this October, and it'll be celebrating with a very special issue perfect for first-time readers! Featuring the return of the critically acclaimed series Dreadnoughts and Megalopolis, this 100-page issue is a brilliant way to jump into the crazy world of 2000 AD. You'll also find incredible new stories featuring Judge Dredd, Judge Anderson, and much more inside! Get a print subscription to the Megazine and it'll arrive through your American mailbox every month – or get a combi subscription and receive 2000 AD each week as well! If you subscribe digitally, you can download DRM-free copies of each issue for only $9 a month. That's 128 pages of incredible comics every month for less than $10! Head to 2000AD.com and click on ‘subscribe' now – or download the 2000 AD app and start reading today! Other Relevant Links to This Week's Episode: Previously on CBCC: Kelley Jones and Matt Wagner on Dracula Book 1: The Impaler Subscribe to The Stacks, Comic Creators Name Their Favorite Comics Watch The Harvey Awards on Popverse NYCC 2025 Patreon Dispatch: Michael Walsh on Exquisite Corpses Grab Your Tickets for Addams Family Values on 10/26 at the Alamo Drafthouse Winchester, co-sponsored by Four Color Fantasies Final Round of Plugs (PHEW): Support the Podcast by Joining OUR PATREON COMMUNITY. The Comic Book Couples Counseling TeePublic Merch Page. And, of course, follow Comic Book Couples Counseling on Facebook, on Instagram, and on Bluesky @CBCCPodcast, and you can follow hosts Brad Gullickson @MouthDork & Lisa Gullickson @sidewalksiren. Send us your Words of Affirmation by leaving us a 5-star Review on Apple Podcasts. Continue your conversation with CBCC by hopping over to our website, where we have reviews, essays, and numerous interviews with comic book creators. Podcast logo by Jesse Lonergan and Hassan Otsmane-Elhaou.

Support us on Patreon: https://www.patreon.com/EternalDurdlesTCGPLAYER AFFILIATE LINK:https://partner.tcgplayer.com/OexAAnZac Clark and ForceofPhil delve into the intricacies of the Mono Blue Dreadnought deck in Magic: The Gathering. They discuss its mechanics, strategies, and the importance of card interactions and tempo. The duo also analyzes various matchups, including Goblins and Burn, and explores the effectiveness of the pivot plan in different scenarios. The conversation highlights the significance of trample as a mechanic and the deck's adaptability in the current meta. In this conversation, Zac Clark and ForceofPhil delve into advanced strategies for playing Dreadnought decks in various matchups. They discuss the importance of sideboarding, understanding opponent strategies, and the significance of key spells in determining the outcome of games. The conversation covers specific decks such as Replenish, Survival, Parallax Tide, Elves, Ponza, and Parfait, providing insights into how to navigate these matchups effectively. The discussion emphasizes the need for adaptability and strategic thinking in the ever-evolving landscape of Magic: The Gathering.Decklist: https://moxfield.com/decks/ZV3KzKrm0Eq3WKTHIO2xmg

Support us on Patreon: https://www.patreon.com/EternalDurdlesTCGPLAYER AFFILIATE LINK:https://partner.tcgplayer.com/OexAAnZac Clark and ForceofPhil delve into the intricacies of the Mono Blue Dreadnought deck in Magic: The Gathering. They discuss its mechanics, strategies, and the importance of card interactions and tempo. The duo also analyzes various matchups, including Goblins and Burn, and explores the effectiveness of the pivot plan in different scenarios. The conversation highlights the significance of trample as a mechanic and the deck's adaptability in the current meta. In this conversation, Zac Clark and ForceofPhil delve into advanced strategies for playing Dreadnought decks in various matchups. They discuss the importance of sideboarding, understanding opponent strategies, and the significance of key spells in determining the outcome of games. The conversation covers specific decks such as Replenish, Survival, Parallax Tide, Elves, Ponza, and Parfait, providing insights into how to navigate these matchups effectively. The discussion emphasizes the need for adaptability and strategic thinking in the ever-evolving landscape of Magic: The Gathering.Decklist: https://moxfield.com/decks/ZV3KzKrm0Eq3WKTHIO2xmg

Transplanting the Doughboys from one medium to another demands collaborators with a firm grasp on both worlds. Podcasters Mike Mitchell and Nick Wiger know their realm, but require a few comic book maniacs to hurl them confidently into the sequential playground. Enter writer Alex Firer and artist Fred C. Stressing (also, colorist Meg Casey). Not only did Firer and Stresing grow up stewing in comics, but they've spent the last several years working together on the Rick and Morty books from Oni Press. They bring with them a strong passion for Harvey Kurtzman, Grant Morrison, and Krazy Kat. They're equally pickled in Doughboys lore, and after a little back and forth with Mitch and Wiger, could decipher the podcast into the epic quest called Doughboys: The Comic Book - Mitch and Wiger Chew America - Crisis on Infinite Girths. Last week, we spoke with Mike Mitchell and Nick Wiger about how they found their way into a comic book, and this week, we're speaking with Alex Firer and Fred C. Stresing about how they helped make that wild fantasy a reality. Also, as a result of hosting the Harvey Awards at New York Comic Con last weekend, we're stewing in Harvey Kurtzman's world ourselves, and his influence is easily identified in the Doughboys Comic Book. It's a joy to discuss madcap comedy, especially the funny book variety, with these two. Make sure you're following the Doughboys on your favorite podcast app, or just click here. Follow Alex Firer on Blue Sky and Instagram. Follow Fred C. Stresing on Blue Sky and Instagram. You can purchase Doughboys: The Comic Book - Mitch and Wiger Chew America - Crisis on Infinite Girths on BeOurKids.com. This Week's Sponsors Judge Dredd Megazine turns thirty-five years old this October, and it'll be celebrating with a very special issue perfect for first-time readers! Featuring the return of the critically acclaimed series Dreadnoughts and Megalopolis, this 100-page issue is a brilliant way to jump into the crazy world of 2000 AD. You'll also find incredible new stories featuring Judge Dredd, Judge Anderson, and much more inside! Get a print subscription to the Megazine and it'll arrive through your American mailbox every month – or get a combi subscription and receive 2000 AD each week as well! If you subscribe digitally, you can download DRM-free copies of each issue for only $9 a month. That's 128 pages of incredible comics every month for less than $10! Head to 2000AD.com and click on ‘subscribe' now – or download the 2000 AD app and start reading today! Launching this October, it's the latest entry in IDW Publishing's Kei-Sei line of Godzilla comics: Starship Godzilla, a cosmic adventure. It's written by award-winning scribe Chris Gooch (of In Utero fame) and illustrated by inventive artist Oliver Ono (I mean, come on, did you read their Godzilla: Monster Island Summer Camp? Insta-Classic). The Kai-Sei Era is the only ongoing Godzilla story of its kind, crafted for comics readers who have never bought a Godzilla book and Godzilla fans who have never read a comic. Starship Godzilla #1 is out now wherever rad comic books are sold. Other Relevant Links to This Week's Episode: Subscribe to The Stacks, Comic Creators Name Their Favorite Comics Watch The Harvey Awards on Popverse NYCC 2025 Patreon Dispatch: Michael Walsh on Exquisite Corpses Grab Your Tickets for Addams Family Values on 10/26 at the Alamo Drafthouse Winchester, co-sponsored by Four Color Fantasies Final Round of Plugs (PHEW): Support the Podcast by Joining OUR PATREON COMMUNITY. The Comic Book Couples Counseling TeePublic Merch Page. And, of course, follow Comic Book Couples Counseling on Facebook, on Instagram, and on Bluesky @CBCCPodcast, and you can follow hosts Brad Gullickson @MouthDork & Lisa Gullickson @sidewalksiren. Send us your Words of Affirmation by leaving us a 5-star Review on Apple Podcasts. Continue your conversation with CBCC by hopping over to our website, where we have reviews, essays, and numerous interviews with comic book creators. Podcast logo by Jesse Lonergan and Hassan Otsmane-Elhaou.

The podcast crossover event no one was expecting is here. The Doughboys, Mike Mitchell and Nick Wiger, arrive on Comic Book Couples Counseling ready to examine their feelings and suss out why they've propelled their podcast life into comic book form. Collaborating with writer Alex Firer, artist Fred C. Stresing, and colorist Meg Casey, Mitch and Wiger boil down their obsession with fast food and chain restaurants into a delicious four-color stew. It's a six-issue series called Doughboys: The Comic Book - Mitch and Wiger Chew America - Crisis on Infinite Girths. Everything you need to know about the vibe is right there in the title. The book is comic book-y, and a Where's Waldoquest for Wednesday warriors, as well as longtime fans of the podcast. You can nab the first issue here. For ten years, Mitch and Wiger have met weekly to battle it out over Red Lobster, Steak n Shake, and Taco Bell, usually inviting fellow comedy maniacs like Jon Gabrus or Lauren Lapkus to weigh in. The Doughboys comic book operates in a similar fashion, but cranks everything to eleven. Demonic and heavenly forces are at play here, friends. We return from New York Comic Con with the perfect episode. We discuss with Mitch and Wiger what drew them to comics, what they've learned about themselves while spending years talking about food, and how insignificant you can feel when sitting in a football stadium or the New York Javits Center. Make sure you're following the Doughboys on your favorite podcast app, or just click here. You can also follow them on Blue Sky and Instagram. This Week's Sponsors Launching this October, it's the latest entry in IDW Publishing's Kei-Sei line of Godzilla comics: Starship Godzilla, a cosmic adventure. It's written by award-winning scribe Chris Gooch (of In Utero fame) and illustrated by inventive artist Oliver Ono (I mean, come on, did you read their Godzilla: Monster Island Summer Camp? Insta-Classic). The Kai-Sei Era is the only ongoing Godzilla story of its kind, crafted for comics readers who have never bought a Godzilla book and Godzilla fans who have never read a comic. Starship Godzilla #1 is out now wherever rad comic books are sold. Judge Dredd Megazine turns thirty-five years old this October, and it'll be celebrating with a very special issue perfect for first-time readers! Featuring the return of the critically acclaimed series Dreadnoughts and Megalopolis, this 100-page issue is a brilliant way to jump into the crazy world of 2000 AD. You'll also find incredible new stories featuring Judge Dredd, Judge Anderson, and much more inside! Get a print subscription to the Megazine and it'll arrive through your American mailbox every month – or get a combi subscription and receive 2000 AD each week as well! If you subscribe digitally, you can download DRM-free copies of each issue for only $9 a month. That's 128 pages of incredible comics every month for less than $10! Head to 2000AD.com and click on ‘subscribe' now – or download the 2000 AD app and start reading today! Other Relevant Links to This Week's Episode: Subscribe to The Stacks, Comic Creators Name Their Favorite Comics Chris Condon in The Stacks at Third Eye Comics Brad and Lisa Gullickson in The Stacks at Third Eye Comics Sanford Greene in The Stacks at Third Eye Comics Philip Kennedy Johnson in The Stacks at Third Eye Comics Steve Anderson in The Stacks at Third Eye Comics David Brothers and Chip Zdarsky in The Stacks at Third Eye Comics Benjamin Percy in the Stacks at Third Eye Comics Final Round of Plugs (PHEW): Support the Podcast by Joining OUR PATREON COMMUNITY. The Comic Book Couples Counseling TeePublic Merch Page. And, of course, follow Comic Book Couples Counseling on Facebook, on Instagram, and on Bluesky @CBCCPodcast, and you can follow hosts Brad Gullickson @MouthDork & Lisa Gullickson @sidewalksiren. Send us your Words of Affirmation by leaving us a 5-star Review on Apple Podcasts. Continue your conversation with CBCC by hopping over to our website, where we have reviews, essays, and numerous interviews with comic book creators. Podcast logo by Jesse Lonergan and Hassan Otsmane-Elhaou.

Support us on Patreon: https://www.patreon.com/EternalDurdlesTCGPLAYER AFFILIATE LINK:https://partner.tcgplayer.com/OexAAnZac Clark and Josh Fry discuss the Mono Blue Tide deck, exploring its strategies, key card interactions, and budget considerations. Joshua shares his impressive tournament record of 20-3, highlighting the deck's resilience and adaptability in various matchups. They delve into the importance of understanding the mana base, effective sideboarding, and the nuances of specific matchups like Stasis and Goblins. The discussion emphasizes the significance of card advantage and strategic play in the pre-modern format, providing valuable insights for players looking to master Mono Blue Tide. In this conversation, Zac Clark and Joshua discuss various strategies and sideboard plans for different matchups in Magic: The Gathering, focusing on the control deck archetype. They delve into specific cards, counterplay techniques, and the importance of adapting strategies based on the opponent's deck. The discussion covers key matchups such as Dreadnought, Replenish, Survival, Stasis, Landstill, Elves, Psychatog, and Reanimator, providing insights into effective gameplay and decision-making.

Support us on Patreon: https://www.patreon.com/EternalDurdlesTCGPLAYER AFFILIATE LINK:https://partner.tcgplayer.com/OexAAnZac Clark and Josh Fry discuss the Mono Blue Tide deck, exploring its strategies, key card interactions, and budget considerations. Joshua shares his impressive tournament record of 20-3, highlighting the deck's resilience and adaptability in various matchups. They delve into the importance of understanding the mana base, effective sideboarding, and the nuances of specific matchups like Stasis and Goblins. The discussion emphasizes the significance of card advantage and strategic play in the pre-modern format, providing valuable insights for players looking to master Mono Blue Tide. In this conversation, Zac Clark and Joshua discuss various strategies and sideboard plans for different matchups in Magic: The Gathering, focusing on the control deck archetype. They delve into specific cards, counterplay techniques, and the importance of adapting strategies based on the opponent's deck. The discussion covers key matchups such as Dreadnought, Replenish, Survival, Stasis, Landstill, Elves, Psychatog, and Reanimator, providing insights into effective gameplay and decision-making.

Weeks ago, we told you to keep an eye glued to the Macabre Valley #1 Kickstarter from writer Zack Quaintance and artist Anna Readman. Now, you have only one week left to back the project and secure yourself a copy of this fiendishly fun comic. Based on Quaintance's own experiences reporting along the American/Mexican border, Macabre Valley tells a viciously recognizable story, energized by Anna Readman's gnarly creature designs and trippy sequential storytelling. You can even support the project knowing you'll receive your comic soon, as Macabre Valley has surpassed its funding goal spectacularly. To celebrate and encourage last-minute stragglers, we're thrilled to have Zack Quaintance back on the podcast this week to discuss the werewolf priest at Macabre Valley's center, and he's even joined this time by his talented collaborator Anna Readman (making her podcast debut, no less). We discuss what makes the best werewolves and how both creators relate to the real-life horror that surrounds the fantastical horror throughout Macabre Valley. The conversation considers uniforms, from the lawful to the hirsute, and the influence they have on those who wear them. Finally, it leaves the listener imagining a wild, wonderful alternate reality where Cormac McCarthy wrote for EC Comics. Again, Macabre Valley #1 is currently seeking funding via Kickstarter. It's written by Zack Quaintance, illustrated by Anna Readman, colored by Brad Simpson, and lettered by Becca Carey. Please follow Zack Quaintance on Blue Skyand Instagram, and follow Anna Readman on her Website and Instagram. This Week's Sponsors Judge Dredd Megazine turns thirty-five years old this October, and it'll be celebrating with a very special issue perfect for first-time readers! Featuring the return of the critically acclaimed series Dreadnoughts and Megalopolis, this 100-page issue is a brilliant way to jump into the crazy world of 2000 AD. You'll also find incredible new stories featuring Judge Dredd, Judge Anderson, and much more inside! Get a print subscription to the Megazine and it'll arrive through your American mailbox every month – or get a combi subscription and receive 2000 AD each week as well! If you subscribe digitally, you can download DRM-free copies of each issue for only $9 a month. That's 128 pages of incredible comics every month for less than $10! Head to 2000AD.com and click on ‘subscribe' now – or download the 2000 AD app and start reading today! Launching this October, it's the latest entry in IDW Publishing's Kei-Sei line of Godzilla comics: Starship Godzilla, a cosmic adventure. It's written by award-winning scribe Chris Gooch (of In Utero fame) and illustrated by inventive artist Oliver Ono (I mean, come on, did you read their Godzilla: Monster Island Summer Camp? Insta-Classic). The Kai-Sei Era is the only ongoing Godzilla story of its kind, crafted for comics readers who have never bought a Godzilla book and Godzilla fans who have never read a comic. Starship Godzilla #1 is out now wherever rad comic books are sold. Other Relevant Links to This Week's Episode: Subscribe to The Stacks, Comic Creators Name Their Favorite Comics Zack Quaintance on The Death of Comics Bookcase Watch The Harvey Awards 2024 via Popverse Final Round of Plugs (PHEW): Support the Podcast by Joining OUR PATREON COMMUNITY. The Comic Book Couples Counseling TeePublic Merch Page. And, of course, follow Comic Book Couples Counseling on Facebook, on Instagram, and on Bluesky @CBCCPodcast, and you can follow hosts Brad Gullickson @MouthDork & Lisa Gullickson @sidewalksiren. Send us your Words of Affirmation by leaving us a 5-star Review on Apple Podcasts. Continue your conversation with CBCC by hopping over to our website, where we have reviews, essays, and numerous interviews with comic book creators. Podcast logo by Jesse Lonergan and Hassan Otsmane-Elhaou.

When Francis Ford Coppola shoots you an email asking you to transform his new movie into a comic book, you say yes and worry about the details later. Chris Ryall got the email. Once he got over the shock ot it, he immediately knew who to contact next: Comic Book Couples Counseling regular, Jacob Phillips. They couldn't have possibly understood what an undertaking they were committing to during those early days, but nearly five years later, they have the Megalopolisgraphic novel in their hands. It's something special. As you'll hear on this week's podcast, Francis Ford Coppola wanted Ryall and Phillips to make the comic their own. If that meant chopping up the script or fabricating the designs, so be it. Jacob Phillips approaches the likenesses the way he would any corporate comic character. If he were on Batman, he'd do his version of Batman. So, he'd apply the same logic to Adam Driver. The actor is the design, but the pencils and inks belong to Phillips. The magic is in how the movie and the comic, crafted independently of each other, aligned so well together. Chatting with Ryall and Phillips allowed us to celebrate both artistic mediums. We discuss the challenges of translating cinematic ideas onto panels, the need for repertoire stories, and the hope within Francis Ford Coppola's humanism. Before all that, however, we also discuss the new documentary, Shopping for Superman. Directed by Wes Eastin, the film travels across America, from one comic book shop to another. It's a must-watch for every comic book reader, as it honors the industry while contemplating where it's all going in the wake of Diamond Comic Distributors' destruction. Megalopolis, the comic, is published by Abrams ComicArts and arrives in shops on October 7th. Make sure you're following Chris Ryall on his Substack, Instagram, and Blue Sky. Also, follow Jacob Phillips on Instagram and Blue Sky. This Week's Sponsors Launching this October, it's the latest entry in IDW Publishing's Kei-Sei line of Godzilla comics: Starship Godzilla, a cosmic adventure. It's written by award-winning scribe Chris Gooch (of In Utero fame) and illustrated by inventive artist Oliver Ono (I mean, come on, did you read their Godzilla: Monster Island Summer Camp? Insta-Classic). The Kai-Sei Era is the only ongoing Godzilla story of its kind, crafted for comics readers who have never bought a Godzilla book and Godzilla fans who have never read a comic. Starship Godzilla #1 is out now wherever rad comic books are sold. Judge Dredd Megazine turns thirty-five years old this October, and it'll be celebrating with a very special issue perfect for first-time readers! Featuring the return of the critically acclaimed series Dreadnoughts and Megalopolis, this 100-page issue is a brilliant way to jump into the crazy world of 2000 AD. You'll also find incredible new stories featuring Judge Dredd, Judge Anderson, and much more inside! Get a print subscription to the Megazine and it'll arrive through your American mailbox every month – or get a combi subscription and receive 2000 AD each week as well! If you subscribe digitally, you can download DRM-free copies of each issue for only $9 a month. That's 128 pages of incredible comics every month for less than $10! Head to 2000AD.com and click on ‘subscribe' now – or download the 2000 AD app and start reading today! Other Relevant Links to This Week's Episode: Subscribe to The Stacks, Comic Creators Name Their Favorite Comics Chris Condon in The Stacks at Third Eye Comics Brad and Lisa Gullickson in The Stacks at Third Eye Comics Sanford Greene in The Stacks at Third Eye Comics Philip Kennedy Johnson in The Stacks at Third Eye Comics Steve Anderson in The Stacks at Third Eye Comics David Brothers and Chip Zdarsky in The Stacks at Third Eye Comics Benjamin Percy in the Stacks at Third Eye Comics Final Round of Plugs (PHEW): Support the Podcast by Joining OUR PATREON COMMUNITY. The Comic Book Couples Counseling TeePublic Merch Page. And, of course, follow Comic Book Couples Counseling on Facebook, on Instagram, and on Bluesky @CBCCPodcast, and you can follow hosts Brad Gullickson @MouthDork & Lisa Gullickson @sidewalksiren. Send us your Words of Affirmation by leaving us a 5-star Review on Apple Podcasts. Continue your conversation with CBCC by hopping over to our website, where we have reviews, essays, and numerous interviews with comic book creators. Podcast logo by Jesse Lonergan and Hassan Otsmane-Elhaou.

Anyways my work schedule has been a little crazy and it's been tricky to nail down times to record, hopefully getting back on a regular release schedule soon!Check out the latest on Youtube: https://www.youtube.com/@lannynynySupport Spike Colony on Ko-Fi: https://ko-fi.com/spikecolony (donations grant access to the follower discord!)Check out the Premodern Tier List and other articles: https://spikecolony.com/

Brand new music from O'Craven, The Dreadnoughts & Chaos Pirata Support us on PayPal!

Learn more about your ad choices. Visit megaphone.fm/adchoices

In the second and final part of their discussion defence expert Lee Pilgrim and host Iain Ballantyne resume their survey of the Royal Navy and how to fix it. They ponder the need for a new ‘Dreadnought moment' under a leader as radical as the legendary Admiral Jacky Fisher who introduced war-winning tech and a new mindset. Fisher pushed through construction of the all-big-gun, steam turbine powered HMS Dreadnought, which in 1906 made all other battleships obsolete. Lee suggests it will also require a latter-day Julian Corbett, the civilian naval visionary who helped Britain forge a strategy for the immensely powerful Royal Navy of the early 20th Century. In their lively chat, Lee and Iain weigh up the worth of the UK's new Atlantic Bastion concept, and the part uncrewed systems will play in it, along with the need to keep humans in the kill chain if drones are to be a major part of policing the Greenland-Iceland-UK (GIUK) gap.  The latter is the main gateway to the broader Atlantic used by Russian submarines since the Cold War, but Iain and Lee wonder if a less passive, more forward leaning strategy is needed. Also touched on in the discussion is the utility of drones as part of the UK Carrier Strike Group and the  F-35B jet as a fighter-bomber compared to how the Royal Navy used to do things the last time it had big carriers (in the 1970s). •Lee Pilgrim has worked in defence and intelligence - for government and industry - for over 30 years both in the UK and overseas, so has some useful insights into a whole load of interesting things. His social media posts on X are well worth a read. Follow him on that platform @MtarfaL He has also written several articles for Warships IFR and contributed to our forthcoming ‘Guide to the Royal Navy 2026.' •Iain Ballantyne is the founding and current Editor of Warships IFR (first published in 1998) along with its ‘Guide to the Royal Navy' (since 2002) and ‘Guide to the US Navy' (since 2018). Iain is also author of the books ‘Hunter Killers' (Orion) and ‘The Deadly Trade' (Weidenfeld & Nicolson), both about submarine warfare, plus ‘Arnhem: Ten Days in The Cauldron' (published by Canelo). In 2017 Iain was awarded a Fellowship by the British Maritime Foundation, which promotes awareness of the United Kingdom's dependence on the sea and seafarers. Visit his web site Bismarckbattle.com and follow him on X @IBallantyn The new (October) edition of Warships IFR is out 19.9.25 in the UK and also being deployed globally. Visit the magazine web site http://bit.ly/wifrmag  Follow us on X @WarshipsIFR Facebook @WarshipsIFR and Warships IFR TV on YouTube @warshipsifrtv3668  To subscribe to the magazine's digital and/or hard copy variants https://warshipsifr.com/subscriptions/ The ‘Guide to the Royal Navy 2026' mentioned in this podcast episode is published on 18.9.25 and can be ordered here https://sundialmedia.escosubs.co.uk/store/products,guide-to-the-royal-navy-2026_640.htm

In today's episode, Drea's biggest secret is revealedConnect:⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Sounds Like Adventure on Twitch⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Sounds Like Adventure on YouTube⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Sounds Like Adventure on Instagram⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Sounds Like Adventure on Discord

ב-1906, בנמל פורתסמות' שבאנגליה, הושקה ספינת המערכה 'דרדנוט' (Dreadnought). ברגע שבו פגש גוף המתכת הקמור של הספינה הבריטית את מי הנמל, השתנה עולם הלוחמה הימית לנצח. כל שאר אניות המערכה בעולם, בכל הציים הפכו בבת אחת ללא רלוונטיות. היא הייתה כה מהפכנית, כה חדשנית וכה רבת-עוצמה, עד שלא ניתן היה להשוות אותה לשום דבר שבא לפניה.האזנה נעימה,רן

ב-1906, בנמל פורתסמות' שבאנגליה, הושקה ספינת המערכה 'דרדנוט' (Dreadnought). ברגע שבו פגש גוף המתכת הקמור של הספינה הבריטית את מי הנמל, השתנה עולם הלוחמה הימית לנצח. כל שאר אניות המערכה בעולם, בכל הציים הפכו בבת אחת ללא רלוונטיות. היא הייתה כה מהפכנית, כה חדשנית וכה רבת-עוצמה, עד שלא ניתן היה להשוות אותה לשום דבר שבא לפניה.האזנה נעימה,רן

In today's episode, the crew deal with the aftermath of their fight with Honey Viper.Connect:⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Sounds Like Adventure on Twitch⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Sounds Like Adventure on YouTube⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Sounds Like Adventure on Instagram⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Sounds Like Adventure on Discord

Deciding between Martin's Dreadnought and 000/Auditorium? The Dreadnought delivers powerful volume ideal for strumming and bluegrass, while the smaller 000 offers balanced tone perfect for fingerstyle players who prioritize comfort over projection.For more information, visit https://www.samash.com/spotlight/martin-guitars-dreadnought-vs-000 Sam Ash City: Hicksville Address: 278 Duffy Ave Website: https://www.samash.com/

Yuen Biao finds his courage and faces off against White Tiger in 1981's Dreadnought.Music: Journey - Tenno Digital Sunshine - Shierro & Yestalgia 

On this week's episode Daniel, Sherman and Slothy talk about Dawnsire, Sunstar dreadnought. This commander utilizes the new rule change in commander to allow vehicles to serve as commander. This deck is fairly budget and looks like an absolute blast to play! What would you have put in this list ? Deck List Here https://archidekt.com/decks/14520572/dawnsire_sunstar_dreadnoughtPatreon: https://www.patreon.com/Intothe99Go to house of cards for the best place to grab your singles! Use the promo code IT99 for a discount! Supports a great shop, saves you money and supports the show! https://houseofcards.ca/Check out these amazing sleeves ! Ai Armor is the best in the game and if you click the link below you can get some amazing new designs. Support an awesome company and support us in the process!https://www.amazon.com/stores/AiArmor/page/E772952B-3C23-4BE5-AA38-81B49CA42450?maas=maas_adg_2D6C4AC19673AFF658FDF6AD59314A37_afap_abs&ref_=aa_maas&tag=maasIf you want awesome audio equipment buy Rode ! Our affiliate link is below!https://brandstore.rode.com?sca_ref=6254570.6h6a2qaxNBWe have new merch! Make sure you check it out!teespring.com/stores/intothe99    Intro musicMusic from #Uppbeat (free for Creators!):https://uppbeat.io/t/abbynoise/dreamlineLicense code: 9JQ8GOXP0XXBBDW3Outro music Music: www.purple-planet.com  The Instagram for slothys band !https://www.instagram.com/necrotic_spew?igsh=dzJpY3ByMzd4ejJ2The instagram and YouTube for Daniels music https://www.instagram.com/danielrudemusic?igsh=MW5xa3JrbGNvdm9xbw==https://youtube.com/@danielrudemusic?si=IBRTawXFJRoQS0xchttps://www.instagram.com/theskysmiledback?igsh=a3BreTJ1NXVjcmdmhttps://youtube.com/@theskysmiledback?si=xquejMSFoJDUaA2vThe Gaming BlenderWe mash genres. We pitch games. You question our sanity.Listen on: Apple Podcasts SpotifySupport the show

The double century is upon us! Danny and Mark are joined by Great Britain's fattest podcasting punk duo, Tom & Niallism!The Big Book of Bullshit was bursting at the seams for once, so expect all the classics: "why are you still doing this?" "shag, marry, kill" "dream guests" and of course, "when was the last time you shit your pants?".Danny and Mark tell us about gigs they've organised, Mark's been to a strange place on holiday and Danny Barrett tells us about how he was mugged off by smelly crusties at the weekend.Music comes from: Nerf Herder, The Dreadnoughts, Dead To Me, The Abs, Off With Their Heads, Goober Patrol, Vamos, Leatherface, The Aquabats and Skimmer.

https://www.patreon.com/AdeptusRidiculoushttps://www.adeptusridiculous.com/https://twitter.com/AdRidiculoushttps://shop.orchideight.com/collections/adeptus-ridiculousDante is the current Chapter Master of the Blood Angels. Commander Dante is one of the most experienced and able Space Marine commanders. In no small part, this is due to the longevity of the Blood Angels, which he has ruled for 1,100 years. Dante is the oldest living Space Marine in the Imperium (excluding Dreadnoughts) and is held in awe by leaders of other Chapters, who can remember him being a famous commander when they were in the Scout Company.Support the show

You've seen us talk 3rd edition, but what about the most beloved era of Warhammer 40k...2nd edition!  In this episode, we're reviewing every space marines release from 1993 - 1998This was James and Paul's intro into the world of Warhammer, so expect a lot of nostalgia that certainly won't go unchecked! Also in this week's episode it's our latest monthly painting challenge: #JunespiteGitz and we'll be rounding up all of the submissions from our community! Expect insights into:✅The best Space Marines of 2nd edition❌The Worst miniatures of 2nd edition

In which six bored, Cambridge-connected bohemians con their way onto the British Empire's naval flagship by dressing as African royalty, and Ken thinks John is either Batman or a Karen. Certificate #19722.

⁠⁠⁠⁠Get ad-free episodes, early release, and bonus shows⁠ On this dive into the mailbag we come back with a fair number of actual ghost stories! Will wonders ever cease?! To keep things balanced, we also talk about wrestling, jazz, and Literary Review's Bad Sex in Fiction Award. Our musical guests are Canadian folk punk legends the Dreadnoughts, with their latest single, "Polka Pit", available now from Punkerton Records! If you like what you hear, you can check out more from the Dreadnoughts by following the links here. Tickets to their September 19th album release party in Columbis, Ohio are available via TicketWeb Also make sure to follow friends of the show Bangers and Mash on Instagram and, if you're in the area, check them out at the NJ Irish Festival in Monmouth Park on Sunday, June 8th, at 10am. For full shownotes, head to GhostStoryGuys.com Learn more about your ad choices. Visit megaphone.fm/adchoices

Today the government has published the long-awaited strategic defence review. The brief was to take a new look at some of the challenges to the UK in 2025, and what is needed to ensure our security and reset our defence priorities.We are still waiting for some of the detail, but so far we know: £15 billion for new warheads to be carried by the new Dreadnought-class submarines; a dozen new SSN-Aukus attack submarines; £1.5 billion to build at least six munitions' factories; £6 billion to procure munitions over the remainder of this parliament; and £1 billion for digital capability and a new CyberEM Command. Where is all that money coming from?Most of the squabbling today has been over the commitment to 3 per cent of GDP on defence spending. Labour have so far only gone as far as to say that's an ‘ambition'. But are Labour being ambitious enough? Is the UK still a global player when it comes to defence if we can't commit to 3 per cent? Oscar Edmondson speaks to James Heale and Emma Salisbury, research fellow at the Council on Geostrategy.Produced by Oscar Edmondson. Hosted on Acast. See acast.com/privacy for more information.

Esto es HistoCast. No es Esparta pero casi. Hablamos de la evolución del barco de guerra desde el navío de línea a los acorazados, para ello está @FSupervielleB y embarcado con él van @LordCirencester, @DeividNagan y @goyix_salduero.Secciones Historia: - Navío de línea - 11:12 - El siglo XIX - 1:18:44 - El acorazado - 2:17:09 - Bibliografía - 3:01:59

Mike and Lanny dive into a debate about the Stasis vs. Dreadnought matchup that lasts longer than the matchup would! Skip to 1:18:00 if you don't care! Then we open up the mailbag to see what hot takes the community has been cooking up during an eerily quiet period of post Lobstercon Premodern.LOVE, SPIKE COLONYCheck out the latest on Youtube: https://www.youtube.com/@lannynynySupport Spike Colony on Ko-Fi: https://ko-fi.com/spikecolony (donations grant access to the follower discord!)Check out the Premodern Tier List and other articles: https://spikecolony.com/

What was it like to collect space marines in 1999? In this episode, we're talking about one of the most often overlooked editions of Warhammer 40k... 3rd edition! Miniature design has come a long way and while we still have many of these classic models with us today, many have been forgotten to time... Also in this week's episode it's our latest monthly painting challenge: #AdMechApril and we'll be rounding up all of the submissions from our community! Expect insights into:✅The best Space Marines of 3rd edition❌The Worst miniatures of 3rd edition

Paddy steps into the Celtic time machine for Phoenyx, a San Fran band's 35 year old recording is finally released! A Touch of the familiar from Kate Bush (she lives in a castle so, Celtic adjacent). And, out standing Celtic from The Gloaming, The Dreadnoughts and Karen Matheson. Join Patricia Fraser for Canada's contemporary Celtic Radio Hour!   Phoenyx - Banish Misfortune  Feufollet - Cette Fois  The Dreadnoughts - Cider Holiday CANCON Enter The Haggis - Gone​ CANCON Firkin - Those Irish Punk Girls  Flook - Jig For Sham  Kate Bush - Running Up That Hill  The Gloaming - The Old Road To Garry  Paddy Murphy - Hot Girl  Gnoss - Stroma  Artists For Action - Which Side Are You On​? CANCON (proceeds to Ukraine) Karen Matheson - Recovery Susan McKeown - Goodbye And Farewell  Peatbog Faeries - Captain Coull's Parrot    59:56

Mike and Lanny recap an action packed Manhattan meetup where Mike managed to beat Dreadnought 4 times in a row with Replenish (before losing to elves?)Check out the latest on Youtube: https://www.youtube.com/@lannynyny Support Spike Colony on Ko-Fi: https://ko-fi.com/spikecolony (donations grant access to the follower discord!)Check out the Premodern Tier List and other articles: https://spikecolony.com/

Andrew is slowly crawling towards a beta release for MetaMonster, he's almost done with the signup/checkout flow and then has a few more things he wants to check off the list before launch. Sean has been playing with Lovable again, and has built a proof of concept for a Webflow changelog he wants for Miscreants (and is thinking about selling). The guys get a little technical talking through the challenges with Supabase edge functions and building with AI. Links:Andrew's Twitter: @AndrewAskinsAndrew's website: https://www.andrewaskins.com/MetaMonster: https://metamonster.ai/Sean's Twitter: @seanqsunMiscreants: http://miscreants.com/Sean's website: https://seanqsun.com/Stacked cookbook: https://www.amazon.com/Stacked-Perfect-Sandwich-Owen-Han/dp/0063330652For more information about the podcast, check out https://www.smalleffortspod.com/.Transcript:00:01.01SeanHow you doing?00:02.26AndrewI'm good, man.00:03.31SeanHow's South Carolina?00:04.58AndrewSouth Carolina was great. Had...00:09.01Andrewbut Sorry.00:10.00Seanwe'll start recording again.00:11.53SeanNo, keep it rolling, keep it rolling, keep going.00:13.18AndrewYou don't want to leave that? You don't want to leave my my hacking?00:15.76SeanHmm.00:18.03AndrewYeah. Yeah, picked up a little bit of, i don't know, crud. not Not even a cold necessarily, just like got super congested for a few days. But had a great time with my family.00:29.79AndrewTook my parents to Korean barbecue for the first time ever. They'd never never tried Korean barbecue and they loved it.00:32.22SeanWhoa.00:36.68AndrewI made some butter chicken for my mom's birthday for her and some of her friends.00:39.84SeanNice. Happy birthday your mom. What is your...00:43.39AndrewMy mom got a new kitten.00:45.25SeanWhoa.00:46.19AndrewSo that was fun.00:46.48SeanBig updates. Uh-huh.00:47.60Andrewher name's Her name's Ruthie.00:49.57SeanNice.00:50.30AndrewFull name RBG.00:51.66Seanare Okay.00:52.46AndrewShe's my mom's resistance kitten.00:54.48SeanVery good. i love it. I love it.00:57.66AndrewYeah. Yeah, things are good. i Cancelled last week's podcast because i was trying to get some work done on client project that we just we just shipped.01:11.63AndrewCongrats to the Dreadnought team. Their website's now live.01:14.42SeanAbsolutely.01:14.58AndrewSuper cool to see. it wasn't It absolutely was not that I was procrastinating on my promise to finish the onboarding flow for Metamonster.01:21.95SeanRight. Right. Right. Convenient story.01:24.77AndrewYeah, that had nothing to do with it.01:26.24SeanYour mom's birthday kitten. i don't believe any of those things. Yeah. Just kidding. Happy birthday to your mom. I don't know her name, but okay.01:37.38AndrewAllison. Allison had a great birthday.01:39.39SeanHappy birthday, Allison. Cool. Or Miss Askins. Miss Askins. Miss Askins.01:45.00AndrewAllison's fine. We are we are adults.01:49.54SeanAnd you might be an adult. You can make butter chicken. I can't. Cool. Cool. But that that was a fun, was that was a fun, hectic launch to get everything live. But02:03.35AndrewIt was. Yarek is a beast, man.02:05.70SeanI know.02:05.75AndrewYarek, like, just...02:06.73SeanYeah.02:08.61AndrewThere were so many things that he just took and ran with. And, like, the, the like, image... generator app that he built to apply like one of the the effects that we created for the website like without anyone asking him to build it was sick the client loves that uh yeah he's he's a beast i i feel i am a little worried that he hates me because i was constantly like hey all right can we change this can we change that like got another request for you but but no he's awesome02:17.91SeanYeah. Yeah.02:26.24Seanyeah02:41.42SeanYeah, he's, yeah. yeah. um do think And the guy's a part-time professor.02:48.22AndrewAnd he's a part-time professor.02:49.76SeanThat's crazy. He's out here teaching kids design things.02:50.68AndrewYeah.02:54.93SeanYeah, yeah, he's pretty good. We're very lucky to have him, so. Cool. health so So, okay. So we skipped. It's just for context.03:03.72SeanFor people that missed the last episode, two weeks ago on our weekly episode podcast, Andrew promised that for the next podcast, he would have his onboarding flow for his SaaS app done.03:16.04SeanIt has been, we missed an episode, so technically this is the new episode. so so is it see it? are like can we see it03:24.48AndrewDefine done.03:28.78Seanyou find time I don't know. I don't know what you had in mind.03:33.06AndrewOkay, so I would say the the we're over 50% of the way there.03:40.07SeanCan I reset my password? Because I forgot it. and he can't like03:42.15AndrewNo, no, that's that's one of the things that I still need to do.03:43.06Seangosh03:46.98AndrewSo you can sign up for an account. As part of the signup flow, you have to pick...

In this episode of Eternal Durdles, host Zac Clark and guest Harain delve into the intricacies of the Stiflenought deck in Magic: The Gathering. They explore its history, key strategies, and the impact of specific cards like Curie on gameplay. The conversation also touches on experimental deck builds, the role of Stifle in the current meta, and the challenges posed by other competitive decks. As they discuss the evolution of Legacy and Modern formats, they reflect on the changing landscape of competitive Magic and the need for players to adapt to new strategies. In this conversation, Evran Harain and the Eternal Durdles Cast explore the evolution of Magic: The Gathering, focusing on the changing landscape of content creation, the economics of competitive play, and the divide between casual and competitive gaming. They delve into the intricacies of the Stiflenought deck, discussing its strengths, weaknesses, and the importance of adapting to the current meta. The discussion highlights the rich history of Magic and its community, emphasizing the need to celebrate unique archetypes like Dreadnought.

In this episode of Eternal Durdles, host Zac Clark and guest Harain delve into the intricacies of the Stiflenought deck in Magic: The Gathering. They explore its history, key strategies, and the impact of specific cards like Curie on gameplay. The conversation also touches on experimental deck builds, the role of Stifle in the current meta, and the challenges posed by other competitive decks. As they discuss the evolution of Legacy and Modern formats, they reflect on the changing landscape of competitive Magic and the need for players to adapt to new strategies. In this conversation, Evran Harain and the Eternal Durdles Cast explore the evolution of Magic: The Gathering, focusing on the changing landscape of content creation, the economics of competitive play, and the divide between casual and competitive gaming. They delve into the intricacies of the Stiflenought deck, discussing its strengths, weaknesses, and the importance of adapting to the current meta. The discussion highlights the rich history of Magic and its community, emphasizing the need to celebrate unique archetypes like Dreadnought.

Court, Impetus and Saint Kabr had a busy two weeks to kick off Episode: Heresy! Hear their thoughts on the return of the Dreadnought, Contest Mode Sundered Doctrine, and the first half of the Heretical Arsenal.TIMESTAMPSEpisode First Impressions - 11:20Adamantite - 56:30Psychopomp - 1:16:30Abyssal Edge - 1:31:00Eyes Unveiled - 1:39:00Watchful Eye - 1:51:20PatreonBECOME A PVE PATRON: https://www.patreon.com/podcastversusenemiesSocialsPVE TWITTER: https://twitter.com/PodvsEnemiesPVE BLUESKY: https://bsky.app/profile/podvsenemies.bsky.socialPVE DISCORD: https://discord.gg/TheyfeQDestiny ScienceSCIENCE LINKTREE: https://www.destiny2.science/AudioAUDIO PRODUCTION (Autodidaktos): https://twitter.com/CameronChollarINTRO MUSIC (Radio Orphe): https://www.youtube.com/watch?v=POdqgitXq64

Zac and Phil discuss the evolving landscape of control decks in Legacy, focusing on the declining viability of Terminus in the current meta. They explore alternative strategies, including the use of Dress Down and the potential pivot to Dreadnought as a response to the changing dynamics of the game. In this conversation, Zac and Phil delve into the intricacies of building and adapting control decks in Legacy, particularly focusing on the role of Mystic Sanctuary, sideboarding strategies, and the importance of resilience against various meta threats. They discuss the synergy of cards like Consigned to Memory and the potential of Dreadnought as a fast threat, emphasizing the need for adaptability in deck construction and gameplay.

Zac and Phil discuss the evolving landscape of control decks in legacy, focusing on the declining viability of Terminus in the current meta. They explore alternative strategies, including the use of Dress Down and the potential pivot to Dreadnought as a response to the changing dynamics of the game. In this conversation, Zac and Phil delve into the intricacies of building and adapting control decks in Legacy, particularly focusing on the role of Mystic Sanctuary, sideboarding strategies, and the importance of resilience against various meta threats. They discuss the synergy of cards like Consigned to Memory and the potential of Dreadnought as a fast threat, emphasizing the need for adaptability in deck construction and gameplay.

A stiff chaser of cool Celtic is what is what you need to follow a true blue Monday. Spend an hour in the company of great Canadians like The Mahaones, The Dreadnoughts, The Fretless and Maggie's Wake. Plus, tasty tracks from Denmark, Catalonia and Breton. Lighten your load with a stop on the road for Celt In A Twist!   Jim Moray - Fair Margaret and Sweet William  Talisk - Storm  The Dreadnoughts - Brisbane Harbour CANCON The Fretless - The Queen Nancy CANCON Dom DufF - Gwrac'h An Aber Don Svobsk - After Tonder Skyrie - Take Me Home With You  ROS - Arlovins  Maggie's Wake - Bridget O'Brien CANCON Afro Celt Sound System - Brid Bahn  Celtica - Itchy Fingers  The Mahones (feat. Simon Townshend) - Stars CANCON Flook - The Quickenbeam    58:38

The Alchemist subclass has leveled up its potion game, proving you can now brew life-saving elixirs faster than most of us can make a cup of coffee. Meanwhile, the Armorer subclass is out here making Dreadnought armor that essentially says, "I'm big, I'm bad, and I take up two squares now." The real drama, though, lies in the rules chaos of pulling, pushing, and grappling mechanics. It turns out grappling is now about as effective as arguing with your DM, and brain extractions have been upgraded to dark comedy gold. But hey, the Artillerist got an upgrade, so you can still blow stuff up while debating whether guns belong in your magical fantasy world. Spoiler: Someone's Homunculus Roomba is going to have to clean up the mess. Tune in for the laughs, stay for the puns, and remember: one day, Vicious Mockery might become a bonus action, and then no adventurer's ego will be safe. Links Eberron: Rising from the Last War (affiliate link) Tasha's Cauldron of Everything (affiliate link) Unearthed Arcana: Revised Artificer Melancon: A Grimoire Tale (affiliate link) https://www.somanyrobots.com/s/Spellbound-Sea-Sample.pdf Summary and Takeaways In this hilarious deep-dive into Dungeons & Dragons' Unearthed Arcana, the hosts embark on a chaotic yet insightful exploration of all things Artificer. The episode begins with a lively discussion of the revamped Alchemist subclass, where the once-mediocre healer is now brewing elixirs that can practically bring characters back from the brink of death—or at least keep them upright long enough to face their next poor life choice. Potions are now crafted faster than ever, which might explain why Alchemists seem perpetually caffeinated. Shifting gears, the hosts don their metaphorical armor (and probably some literal helmets) to dissect the updated Armorer subclass. With options like Dreadnought armor, which makes you bigger and scarier in combat, and Perfected Armor, which adds a splash of damage and utility, there's something for everyone—unless you liked the old customization options, in which case, condolences. The new armor replication system is simpler, but as one host laments, "simplicity is the enemy of shiny customization."  Things take a turn for the absurd as the conversation veers into gameplay mechanics. Pulling and pushing creatures might sound straightforward, but apparently, it's a one-way ticket to rules-lawyering chaos. Grappling, once a staple of wrestling matches gone awry, now feels about as effective as trying to hug a gelatinous cube. And then there's the unforgettable mention of "character brain extraction," which the hosts agree is equal parts horrifying and comedy gold, depending on which side of the dice you're on. Next, the spotlight shines on the Artillerist subclass, which has undergone upgrades that make it deadlier—and debatably more explosive—than ever. This sparks a lively debate about the coexistence of magic and technology in fantasy worlds, with one host arguing for the poetic elegance of wands and the other championing the raw, chaotic energy of boomsticks. Meanwhile, Battlesmith fans will be pleased to know the Steel Defender is now more useful, although one host quips, "It still won't do your taxes." The humor continues with a look at the Homunculus spell, a new addition to the Artificer arsenal that lets players conjure a small, slightly unsettling creature to assist in adventures. One host imagines it as "a glorified Roomba with attitude," while the other is already brainstorming scenarios where the Homunculus saves the day—or ruins it spectacularly.  The episode rounds off with a mailbag segment tackling the question: which cantrips should become bonus actions? This sparks a flurry of debate, with one host suggesting Firebolt could add some sizzle to multi-action rounds and the other lamenting that bonus-action Vicious Mockery would lead to endless pun wars at the table.  Throughout the episode, the hosts share their hopes, dreams, and mixed feelings about the future of D&D. They long for innovative subclasses, yearn for a return to the rich settings of Eberron, and urge designers to embrace the weird, wonderful flavor that makes the game magical. All this is delivered with a heaping dose of humor, proving once again that no matter how complex the rules or contentious the changes, the real joy of D&D is in laughing through it all with friends. If you enjoy the show, please rate and review us on Apple Podcasts, Spotify, or your favorite podcast app. It's a quick, free way to support the podcast, and helps us reach new listeners. If you love the show, consider joining us on Patreon, where backers at the $5 and above tiers get ad free access to RPGBOT.net and the RPGBOT.Podcast, can chat directly to members of the RPGBOT team and community on the RPGBOT.Discord, and can join us for live-streamed recordings. Support us on Amazon.com when you purchase products recommended in the show at the following link: https://amzn.to/3NwElxQ How to Find Us: In-depth articles, guides, handbooks, reviews, news on Tabletop Role Playing at RPGBOT.net Tyler Kamstra Twitter: @RPGBOTDOTNET Facebook: rpgbotbotdotnet Bluesky:rpgbot.bsky.social Ash Ely Professional Game Master on StartPlaying.Games Twitter: @GravenAshes YouTube@ashravenmedia Randall James @JackAmateur Amateurjack.com Producer Dan @Lzr_illuminati

Keri Russell (U.S. Ambassador Kate Wyler) returns to the podcast to chat with Baroness Ayesha Hazarika about Kate's style transformation in this episode and the complexly passionate bond between Kate and Hal throughout the season. Creator and showrunner Debora Cahn and executive producer Janice Williams discuss why Kate Wyler is now fully embracing the Vice President role and break down the explosive season-ending. To round out the season, get a behind-the-scenes look at the life of the current serving US ambassador for the UK, Jane Hartley. She does Kate Wyler's job for real and she's a fan of The Diplomat. She reveals all about the day-to-day work on the job, why she wants to make a difference in this world, and what it's like when a President lands their helicopter on your lawn. Spoilers Ahead! If you have not seen The Diplomat season 2, episode 6: Dreadnought, then go stream it now on Netflix and come back to us! Thanks for listening to this podcast alongside season 2. And it's official! The Diplomat will be returning for season 3, only on Netflix. Follow along on Tudum.com for more news about the series. The Diplomat: The Official Podcast is produced by Netflix in association with Novel. Credits: Host: Baroness Ayesha Hazarika Netflix Executive Producers: Erica Brady, Rae Votta, David Markowitz and Kathryn Huyghue Novel Credits Producer: Ashley Clivery Editor: Amber Bateman Researcher: Zeyana Yussuf Production Management: Cheree Houston, Sarah Tobin, and Charlotte Wolf Creative Director: Willard Foxton Director of Development: Selina Mater Chief Content Officer: Max O'Brien Episode Mixer: Nicholas Alexander Additional video production: Mark Blackman, Nicholas Chandler, and Roxanne Holman Special thanks to Debora Cahn, the creator and showrunner of The Diplomat, Executive Producers Janice Williams and Alex Graves, Writer Anna Hagan, Associate Producer Elaine Ivy Harris, the team at Winfield House, and the U.S. State Department.

Apologies for lower audio quality; we lost recordings and had to use backup tracks. Our guests today are Anastasios Angelopoulos and Wei-Lin Chiang, leads of Chatbot Arena, fka LMSYS, the crowdsourced AI evaluation platform developed by the LMSys student club at Berkeley, which became the de facto standard for comparing language models. Arena ELO is often more cited than MMLU scores to many folks, and they have attracted >1,000,000 people to cast votes since its launch, leading top model trainers to cite them over their own formal academic benchmarks:The Limits of Static BenchmarksWe've done two benchmarks episodes: Benchmarks 101 and Benchmarks 201. One issue we've always brought up with static benchmarks is that 1) many are getting saturated, with models scoring almost perfectly on them 2) they often don't reflect production use cases, making it hard for developers and users to use them as guidance. The fundamental challenge in AI evaluation isn't technical - it's philosophical. How do you measure something that increasingly resembles human intelligence? Rather than trying to define intelligence upfront, Arena let users interact naturally with models and collect comparative feedback. It's messy and subjective, but that's precisely the point - it captures the full spectrum of what people actually care about when using AI.The Pareto Frontier of Cost vs IntelligenceBecause the Elo scores are remarkably stable over time, we can put all the chat models on a map against their respective cost to gain a view of at least 3 orders of magnitude of model sizes/costs and observe the remarkable shift in intelligence per dollar over the past year:This frontier stood remarkably firm through the recent releases of o1-preview and price cuts of Gemini 1.5:The Statistics of SubjectivityIn our Benchmarks 201 episode, Clémentine Fourrier from HuggingFace thought this design choice was one of shortcomings of arenas: they aren't reproducible. You don't know who ranked what and what exactly the outcome was at the time of ranking. That same person might rank the same pair of outputs differently on a different day, or might ask harder questions to better models compared to smaller ones, making it imbalanced. Another argument that people have brought up is confirmation bias. We know humans prefer longer responses and are swayed by formatting - Rob Mulla from Dreadnode had found some interesting data on this in May:The approach LMArena is taking is to use logistic regression to decompose human preferences into constituent factors. As Anastasios explains: "We can say what components of style contribute to human preference and how they contribute." By adding these style components as parameters, they can mathematically "suck out" their influence and isolate the core model capabilities.This extends beyond just style - they can control for any measurable factor: "What if I want to look at the cost adjusted performance? Parameter count? We can ex post facto measure that." This is one of the most interesting things about Arena: You have a data generation engine which you can clean and turn into leaderboards later. If you wanted to create a leaderboard for poetry writing, you could get existing data from Arena, normalize it by identifying these style components. Whether or not it's possible to really understand WHAT bias the voters have, that's a different question.Private EvalsOne of the most delicate challenges LMSYS faces is maintaining trust while collaborating with AI labs. The concern is that labs could game the system by testing multiple variants privately and only releasing the best performer. This was brought up when 4o-mini released and it ranked as the second best model on the leaderboard:But this fear misunderstands how Arena works. Unlike static benchmarks where selection bias is a major issue, Arena's live nature means any initial bias gets washed out by ongoing evaluation. As Anastasios explains: "In the long run, there's way more fresh data than there is data that was used to compare these five models." The other big question is WHAT model is actually being tested; as people often talk about on X / Discord, the same endpoint will randomly feel “nerfed” like it happened for “Claude European summer” and corresponding conspiracy theories:It's hard to keep track of these performance changes in Arena as these changes (if real…?) are not observable.The Future of EvaluationThe team's latest work on RouteLLM points to an interesting future where evaluation becomes more granular and task-specific. But they maintain that even simple routing strategies can be powerful - like directing complex queries to larger models while handling simple tasks with smaller ones.Arena is now going to expand beyond text into multimodal evaluation and specialized domains like code execution and red teaming. But their core insight remains: the best way to evaluate intelligence isn't to simplify it into metrics, but to embrace its complexity and find rigorous ways to analyze it. To go after this vision, they are spinning out Arena from LMSys, which will stay as an academia-driven group at Berkeley.Full Video PodcastChapters* 00:00:00 - Introductions* 00:01:16 - Origin and development of Chatbot Arena* 00:05:41 - Static benchmarks vs. Arenas* 00:09:03 - Community building* 00:13:32 - Biases in human preference evaluation* 00:18:27 - Style Control and Model Categories* 00:26:06 - Impact of o1* 00:29:15 - Collaborating with AI labs* 00:34:51 - RouteLLM and router models* 00:38:09 - Future of LMSys / ArenaShow Notes* Anastasios Angelopoulos* Anastasios' NeurIPS Paper Conformal Risk Control* Wei-Lin Chiang* Chatbot Arena* LMSys* MTBench* ShareGPT dataset* Stanford's Alpaca project* LLMRouter* E2B* DreadnodeTranscriptAlessio [00:00:00]: Hey everyone, welcome to the Latent Space podcast. This is Alessio, Partner and CTO in Residence at Decibel Partners, and I'm joined by my co-host Swyx, founder of Smol.ai.Swyx [00:00:14]: Hey, and today we're very happy and excited to welcome Anastasios and Wei Lin from LMSys. Welcome guys.Wei Lin [00:00:21]: Hey, how's it going? Nice to see you.Anastasios [00:00:23]: Thanks for having us.Swyx [00:00:24]: Anastasios, I actually saw you, I think at last year's NeurIPS. You were presenting a paper, which I don't really super understand, but it was some theory paper about how your method was very dominating over other sort of search methods. I don't remember what it was, but I remember that you were a very confident speaker.Anastasios [00:00:40]: Oh, I totally remember you. Didn't ever connect that, but yes, that's definitely true. Yeah. Nice to see you again.Swyx [00:00:46]: Yeah. I was frantically looking for the name of your paper and I couldn't find it. Basically I had to cut it because I didn't understand it.Anastasios [00:00:51]: Is this conformal PID control or was this the online control?Wei Lin [00:00:55]: Blast from the past, man.Swyx [00:00:57]: Blast from the past. It's always interesting how NeurIPS and all these academic conferences are sort of six months behind what people are actually doing, but conformal risk control, I would recommend people check it out. I have the recording. I just never published it just because I was like, I don't understand this enough to explain it.Anastasios [00:01:14]: People won't be interested.Wei Lin [00:01:15]: It's all good.Swyx [00:01:16]: But ELO scores, ELO scores are very easy to understand. You guys are responsible for the biggest revolution in language model benchmarking in the last few years. Maybe you guys want to introduce yourselves and maybe tell a little bit of the brief history of LMSysWei Lin [00:01:32]: Hey, I'm Wei Lin. I'm a fifth year PhD student at UC Berkeley, working on Chatbot Arena these days, doing crowdsourcing AI benchmarking.Anastasios [00:01:43]: I'm Anastasios. I'm a sixth year PhD student here at Berkeley. I did most of my PhD on like theoretical statistics and sort of foundations of model evaluation and testing. And now I'm working 150% on this Chatbot Arena stuff. It's great.Alessio [00:02:00]: And what was the origin of it? How did you come up with the idea? How did you get people to buy in? And then maybe what were one or two of the pivotal moments early on that kind of made it the standard for these things?Wei Lin [00:02:12]: Yeah, yeah. Chatbot Arena project was started last year in April, May, around that. Before that, we were basically experimenting in a lab how to fine tune a chatbot open source based on the Llama 1 model that I released. At that time, Lama 1 was like a base model and people didn't really know how to fine tune it. So we were doing some explorations. We were inspired by Stanford's Alpaca project. So we basically, yeah, grow a data set from the internet, which is called ShareGPT data set, which is like a dialogue data set between user and chat GPT conversation. It turns out to be like pretty high quality data, dialogue data. So we fine tune on it and then we train it and release the model called V2. And people were very excited about it because it kind of like demonstrate open way model can reach this conversation capability similar to chat GPT. And then we basically release the model with and also build a demo website for the model. People were very excited about it. But during the development, the biggest challenge to us at the time was like, how do we even evaluate it? How do we even argue this model we trained is better than others? And then what's the gap between this open source model that other proprietary offering? At that time, it was like GPT-4 was just announced and it's like Cloud One. What's the difference between them? And then after that, like every week, there's a new model being fine tuned, released. So even until still now, right? And then we have that demo website for V2 now. And then we thought like, okay, maybe we can add a few more of the model as well, like API model as well. And then we quickly realized that people need a tool to compare between different models. So we have like a side by side UI implemented on the website to that people choose, you know, compare. And we quickly realized that maybe we can do something like, like a battle on top of ECLMs, like just anonymize it, anonymize the identity, and that people vote which one is better. So the community decides which one is better, not us, not us arguing, you know, our model is better or what. And that turns out to be like, people are very excited about this idea. And then we tweet, we launch, and that's, yeah, that's April, May. And then it was like first two, three weeks, like just a few hundred thousand views tweet on our launch tweets. And then we have regularly double update weekly, beginning at a time, adding new model GPT-4 as well. So it was like, that was the, you know, the initial.Anastasios [00:04:58]: Another pivotal moment, just to jump in, would be private models, like the GPT, I'm a little,Wei Lin [00:05:04]: I'm a little chatty. That was this year. That was this year.Anastasios [00:05:07]: Huge.Wei Lin [00:05:08]: That was also huge.Alessio [00:05:09]: In the beginning, I saw the initial release was May 3rd of the beta board. On April 6, we did a benchmarks 101 episode for a podcast, just kind of talking about, you know, how so much of the data is like in the pre-training corpus and blah, blah, blah. And like the benchmarks are really not what we need to evaluate whether or not a model is good. Why did you not make a benchmark? Maybe at the time, you know, it was just like, Hey, let's just put together a whole bunch of data again, run a, make a score that seems much easier than coming out with a whole website where like users need to vote. Any thoughts behind that?Wei Lin [00:05:41]: I think it's more like fundamentally, we don't know how to automate this kind of benchmarks when it's more like, you know, conversational, multi-turn, and more open-ended task that may not come with a ground truth. So let's say if you ask a model to help you write an email for you for whatever purpose, there's no ground truth. How do you score them? Or write a story or a creative story or many other things like how we use ChatterBee these days. It's more open-ended. You know, we need human in the loop to give us feedback, which one is better. And I think nuance here is like, sometimes it's also hard for human to give the absolute rating. So that's why we have this kind of pairwise comparison, easier for people to choose which one is better. So from that, we use these pairwise comparison, those to calculate the leaderboard. Yeah. You can add more about this methodology.Anastasios [00:06:40]: Yeah. I think the point is that, and you guys probably also talked about this at some point, but static benchmarks are intrinsically, to some extent, unable to measure generative model performance. And the reason is because you cannot pre-annotate all the outputs of a generative model. You change the model, it's like the distribution of your data is changing. New labels to deal with that. New labels are great automated labeling, right? Which is why people are pursuing both. And yeah, static benchmarks, they allow you to zoom in to particular types of information like factuality, historical facts. We can build the best benchmark of historical facts, and we will then know that the model is great at historical facts. But ultimately, that's not the only axis, right? And we can build 50 of them, and we can evaluate 50 axes. But it's just so, the problem of generative model evaluation is just so expansive, and it's so subjective, that it's just maybe non-intrinsically impossible, but at least we don't see a way. We didn't see a way of encoding that into a fixed benchmark.Wei Lin [00:07:47]: But on the other hand, I think there's a challenge where this kind of online dynamic benchmark is more expensive than static benchmark, offline benchmark, where people still need it. Like when they build models, they need static benchmark to track where they are.Anastasios [00:08:03]: It's not like our benchmark is uniformly better than all other benchmarks, right? It just measures a different kind of performance that has proved to be useful.Swyx [00:08:14]: You guys also published MTBench as well, which is a static version, let's say, of Chatbot Arena, right? That people can actually use in their development of models.Wei Lin [00:08:25]: Right. I think one of the reasons we still do this static benchmark, we still wanted to explore, experiment whether we can automate this, because people, eventually, model developers need it to fast iterate their model. So that's why we explored LM as a judge, and ArenaHard, trying to filter, select high-quality data we collected from Chatbot Arena, the high-quality subset, and use that as a question and then automate the judge pipeline, so that people can quickly get high-quality signal, benchmark signals, using this online benchmark.Swyx [00:09:03]: As a community builder, I'm curious about just the initial early days. Obviously when you offer effectively free A-B testing inference for people, people will come and use your arena. What do you think were the key unlocks for you? Was it funding for this arena? Was it marketing? When people came in, do you see a noticeable skew in the data? Which obviously now you have enough data sets, you can separate things out, like coding and hard prompts, but in the early days, it was just all sorts of things.Anastasios [00:09:31]: Yeah, maybe one thing to establish at first is that our philosophy has always been to maximize organic use. I think that really does speak to your point, which is, yeah, why do people come? They came to use free LLM inference, right? And also, a lot of users just come to the website to use direct chat, because you can chat with the model for free. And then you could think about it like, hey, let's just be kind of like more on the selfish or conservative or protectionist side and say, no, we're only giving credits for people that battle or so on and so forth. Strategy wouldn't work, right? Because what we're trying to build is like a big funnel, a big funnel that can direct people. And some people are passionate and interested and they battle. And yes, the distribution of the people that do that is different. It's like, as you're pointing out, it's like, that's not as they're enthusiastic.Wei Lin [00:10:24]: They're early adopters of this technology.Anastasios [00:10:27]: Or they like games, you know, people like this. And we've run a couple of surveys that indicate this as well, of our user base.Wei Lin [00:10:36]: We do see a lot of developers come to the site asking polling questions, 20-30%. Yeah, 20-30%.Anastasios [00:10:42]: It's obviously not reflective of the general population, but it's reflective of some corner of the world of people that really care. And to some extent, maybe that's all right, because those are like the power users. And you know, we're not trying to claim that we represent the world, right? We represent the people that come and vote.Swyx [00:11:02]: Did you have to do anything marketing-wise? Was anything effective? Did you struggle at all? Was it success from day one?Wei Lin [00:11:09]: At some point, almost done. Okay. Because as you can imagine, this leaderboard depends on community engagement participation. If no one comes to vote tomorrow, then no leaderboard.Anastasios [00:11:23]: So we had some period of time when the number of users was just, after the initial launch, it went lower. Yeah. And, you know, at some point, it did not look promising. Actually, I joined the project a couple months in to do the statistical aspects, right? As you can imagine, that's how it kind of hooked into my previous work. At that time, it wasn't like, you know, it definitely wasn't clear that this was like going to be the eval or something. It was just like, oh, this is a cool project. Like Wayland seems awesome, you know, and that's it.Wei Lin [00:11:56]: Definitely. There's in the beginning, because people don't know us, people don't know what this is for. So we had a hard time. But I think we were lucky enough that we have some initial momentum. And as well as the competition between model providers just becoming, you know, became very intense. Intense. And then that makes the eval onto us, right? Because always number one is number one.Anastasios [00:12:23]: There's also an element of trust. Our main priority in everything we do is trust. We want to make sure we're doing everything like all the I's are dotted and the T's are crossed and nobody gets unfair treatment and people can see from our profiles and from our previous work and from whatever, you know, we're trustworthy people. We're not like trying to make a buck and we're not trying to become famous off of this or that. It's just, we're trying to provide a great public leaderboard community venture project.Wei Lin [00:12:51]: Yeah.Swyx [00:12:52]: Yes. I mean, you are kind of famous now, you know, that's fine. Just to dive in more into biases and, you know, some of this is like statistical control. The classic one for human preference evaluation is humans demonstrably prefer longer contexts or longer outputs, which is actually something that we don't necessarily want. You guys, I think maybe two months ago put out some length control studies. Apart from that, there are just other documented biases. Like, I'd just be interested in your review of what you've learned about biases and maybe a little bit about how you've controlled for them.Anastasios [00:13:32]: At a very high level, yeah. Humans are biased. Totally agree. Like in various ways. It's not clear whether that's good or bad, you know, we try not to make value judgments about these things. We just try to describe them as they are. And our approach is always as follows. We collect organic data and then we take that data and we mine it to get whatever insights we can get. And, you know, we have many millions of data points that we can now use to extract insights from. Now, one of those insights is to ask the question, what is the effect of style, right? You have a bunch of data, you have votes, people are voting either which way. We have all the conversations. We can say what components of style contribute to human preference and how do they contribute? Now, that's an important question. Why is that an important question? It's important because some people want to see which model would be better if the lengths of the responses were the same, were to be the same, right? People want to see the causal effect of the model's identity controlled for length or controlled for markdown, number of headers, bulleted lists, is the text bold? Some people don't, they just don't care about that. The idea is not to impose the judgment that this is not important, but rather to say ex post facto, can we analyze our data in a way that decouples all the different factors that go into human preference? Now, the way we do this is via statistical regression. That is to say the arena score that we show on our leaderboard is a particular type of linear model, right? It's a linear model that takes, it's a logistic regression that takes model identities and fits them against human preference, right? So it regresses human preference against model identity. What you get at the end of that logistic regression is a parameter vector of coefficients. And when the coefficient is large, it tells you that GPT 4.0 or whatever, very large coefficient, that means it's strong. And that's exactly what we report in the table. It's just the predictive effect of the model identity on the vote. The other thing that you can do is you can take that vector, let's say we have M models, that is an M dimensional vector of coefficients. What you can do is you say, hey, I also want to understand what the effect of length is. So I'll add another entry to that vector, which is trying to predict the vote, right? That tells me the difference in length between two model responses. So we have that for all of our data. We can compute it ex post facto. We added it into the regression and we look at that predictive effect. And then the idea, and this is formally true under certain conditions, not always verifiable ones, but the idea is that adding that extra coefficient to this vector will kind of suck out the predictive power of length and put it into that M plus first coefficient and quote, unquote, de-bias the rest so that the effect of length is not included. And that's what we do in style control. Now we don't just do it for M plus one. We have, you know, five, six different style components that have to do with markdown headers and bulleted lists and so on that we add here. Now, where is this going? You guys see the idea. It's a general methodology. If you have something that's sort of like a nuisance parameter, something that exists and provides predictive value, but you really don't want to estimate that. You want to remove its effect. In causal inference, these things are called like confounders often. What you can do is you can model the effect. You can put them into your model and try to adjust for them. So another one of those things might be cost. You know, what if I want to look at the cost adjusted performance of my model, which models are punching above their weight, parameter count, which models are punching above their weight in terms of parameter count, we can ex post facto measure that. We can do it without introducing anything that compromises the organic nature of theWei Lin [00:17:17]: data that we collect.Anastasios [00:17:18]: Hopefully that answers the question.Wei Lin [00:17:20]: It does.Swyx [00:17:21]: So I guess with a background in econometrics, this is super familiar.Anastasios [00:17:25]: You're probably better at this than me for sure.Swyx [00:17:27]: Well, I mean, so I used to be, you know, a quantitative trader and so, you know, controlling for multiple effects on stock price is effectively the job. So it's interesting. Obviously the problem is proving causation, which is hard, but you don't have to do that.Anastasios [00:17:45]: Yes. Yes, that's right. And causal inference is a hard problem and it goes beyond statistics, right? It's like you have to build the right causal model and so on and so forth. But we think that this is a good first step and we're sort of looking forward to learning from more people. You know, there's some good people at Berkeley that work on causal inference for the learning from them on like, what are the really most contemporary techniques that we can use in order to estimate true causal effects if possible.Swyx [00:18:10]: Maybe we could take a step through the other categories. So style control is a category. It is not a default. I have thought that when you wrote that blog post, actually, I thought it would be the new default because it seems like the most obvious thing to control for. But you also have other categories, you have coding, you have hard prompts. We consider that.Anastasios [00:18:27]: We're still actively considering it. It's just, you know, once you make that step, once you take that step, you're introducing your opinion and I'm not, you know, why should our opinion be the one? That's kind of a community choice. We could put it to a vote.Wei Lin [00:18:39]: We could pass.Anastasios [00:18:40]: Yeah, maybe do a poll. Maybe do a poll.Swyx [00:18:42]: I don't know. No opinion is an opinion.Wei Lin [00:18:44]: You know what I mean?Swyx [00:18:45]: Yeah.Wei Lin [00:18:46]: There's no neutral choice here.Swyx [00:18:47]: Yeah. You have all these others. You have instruction following too. What are your favorite categories that you like to talk about? Maybe you tell a little bit of the stories, tell a little bit of like the hard choices that you had to make.Wei Lin [00:18:57]: Yeah. Yeah. Yeah. I think the, uh, initially the reason why we want to add these new categories is essentially to answer some of the questions from our community, which is we won't have a single leaderboard for everything. So these models behave very differently in different domains. Let's say this model is trend for coding, this model trend for more technical questions and so on. On the other hand, to answer people's question about like, okay, what if all these low quality, you know, because we crowdsource data from the internet, there will be noise. So how do we de-noise? How do we filter out these low quality data effectively? So that was like, you know, some questions we want to answer. So basically we spent a few months, like really diving into these questions to understand how do we filter all these data because these are like medias of data points. And then if you want to re-label yourself, it's possible, but we need to kind of like to automate this kind of data classification pipeline for us to effectively categorize them to different categories, say coding, math, structure, and also harder problems. So that was like, the hope is when we slice the data into these meaningful categories to give people more like better signals, more direct signals, and that's also to clarify what we are actually measuring for, because I think that's the core part of the benchmark. That was the initial motivation. Does that make sense?Anastasios [00:20:27]: Yeah. Also, I'll just say, this does like get back to the point that the philosophy is to like mine organic, to take organic data and then mine it x plus factor.Alessio [00:20:35]: Is the data cage-free too, or just organic?Anastasios [00:20:39]: It's cage-free.Wei Lin [00:20:40]: No GMO. Yeah. And all of these efforts are like open source, like we open source all of the data cleaning pipeline, filtering pipeline. Yeah.Swyx [00:20:50]: I love the notebooks you guys publish. Actually really good just for learning statistics.Wei Lin [00:20:54]: Yeah. I'll share this insights with everyone.Alessio [00:20:59]: I agree on the initial premise of, Hey, writing an email, writing a story, there's like no ground truth. But I think as you move into like coding and like red teaming, some of these things, there's like kind of like skill levels. So I'm curious how you think about the distribution of skill of the users. Like maybe the top 1% of red teamers is just not participating in the arena. So how do you guys think about adjusting for it? And like feels like this where there's kind of like big differences between the average and the top. Yeah.Anastasios [00:21:29]: Red teaming, of course, red teaming is quite challenging. So, okay. Moving back. There's definitely like some tasks that are not as subjective that like pairwise human preference feedback is not the only signal that you would want to measure. And to some extent, maybe it's useful, but it may be more useful if you give people better tools. For example, it'd be great if we could execute code with an arena, be fantastic.Wei Lin [00:21:52]: We want to do it.Anastasios [00:21:53]: There's also this idea of constructing a user leaderboard. What does that mean? That means some users are better than others. And how do we measure that? How do we quantify that? Hard in chatbot arena, but where it is easier is in red teaming, because in red teaming, there's an explicit game. You're trying to break the model, you either win or you lose. So what you can do is you can say, Hey, what's really happening here is that the models and humans are playing a game against one another. And then you can use the same sort of Bradley Terry methodology with some, some extensions that we came up with in one of you can read one of our recent blog posts for, for the sort of theoretical extensions. You can attribute like strength back to individual players and jointly attribute strength to like the models that are in this jailbreaking game, along with the target tasks, like what types of jailbreaks you want.Wei Lin [00:22:44]: So yeah.Anastasios [00:22:45]: And I think that this is, this is a hugely important and interesting avenue that we want to continue researching. We have some initial ideas, but you know, all thoughts are welcome.Wei Lin [00:22:54]: Yeah.Alessio [00:22:55]: So first of all, on the code execution, the E2B guys, I'm sure they'll be happy to helpWei Lin [00:22:59]: you.Alessio [00:23:00]: I'll please set that up. They're big fans. We're investors in a company called Dreadnought, which we do a lot in AI red teaming. I think to me, the most interesting thing has been, how do you do sure? Like the model jailbreak is one side. We also had Nicola Scarlini from DeepMind on the podcast, and he was talking about, for example, like, you know, context stealing and like a weight stealing. So there's kind of like a lot more that goes around it. I'm curious just how you think about the model and then maybe like the broader system, even with Red Team Arena, you're just focused on like jailbreaking of the model, right? You're not doing kind of like any testing on the more system level thing of the model where like, maybe you can get the training data back, you're going to exfiltrate some of the layers and the weights and things like that.Wei Lin [00:23:43]: So right now, as you can see, the Red Team Arena is at a very early stage and we are still exploring what could be the potential new games we can introduce to the platform. So the idea is still the same, right? And we build a community driven project platform for people. They can have fun with this website, for sure. That's one thing, and then help everyone to test these models. So one of the aspects you mentioned is stealing secrets, stealing training sets. That could be one, you know, it could be designed as a game. Say, can you still use their credential, you know, we hide, maybe we can hide the credential into system prompts and so on. So there are like a few potential ideas we want to explore for sure. Do you want to add more?Anastasios [00:24:28]: I think that this is great. This idea is a great one. There's a lot of great ideas in the Red Teaming space. You know, I'm not personally like a Red Teamer. I don't like go around and Red Team models, but there are people that do that and they're awesome. They're super skilled. When I think about the Red Team arena, I think those are really the people that we're building it for. Like, we want to make them excited and happy, build tools that they like. And just like chatbot arena, we'll trust that this will end up being useful for the world. And all these people are, you know, I won't say all these people in this community are actually good hearted, right? They're not doing it because they want to like see the world burn. They're doing it because they like, think it's fun and cool. And yeah. Okay. Maybe they want to see, maybe they want a little bit.Wei Lin [00:25:13]: I don't know. Majority.Anastasios [00:25:15]: Yeah.Wei Lin [00:25:16]: You know what I'm saying.Anastasios [00:25:17]: So, you know, trying to figure out how to serve them best, I think, I don't know where that fits. I just, I'm not expressing. And give them credits, right?Wei Lin [00:25:24]: And give them credit.Anastasios [00:25:25]: Yeah. Yeah. So I'm not trying to express any particular value judgment here as to whether that's the right next step. It's just, that's sort of the way that I think we would think about it.Swyx [00:25:35]: Yeah. We also talked to Sander Schulhoff of the HackerPrompt competition, and he's pretty interested in Red Teaming at scale. Let's just call it that. You guys maybe want to talk with him.Wei Lin [00:25:45]: Oh, nice.Swyx [00:25:46]: We wanted to cover a little, a few topical things and then go into the other stuff that your group is doing. You know, you're not just running Chatbot Arena. We can also talk about the new website and your future plans, but I just wanted to briefly focus on O1. It is the hottest, latest model. Obviously, you guys already have it on the leaderboard. What is the impact of O1 on your evals?Wei Lin [00:26:06]: Made our interface slower.Anastasios [00:26:07]: It made it slower.Swyx [00:26:08]: Yeah.Wei Lin [00:26:10]: Because it needs like 30, 60 seconds, sometimes even more to, the latency is like higher. So that's one. Sure. But I think we observe very interesting things from this model as well. Like we observe like significant improvement in certain categories, like more technical or math. Yeah.Anastasios [00:26:32]: I think actually like one takeaway that was encouraging is that I think a lot of people before the O1 release were thinking, oh, like this benchmark is saturated. And why were they thinking that? They were thinking that because there was a bunch of models that were kind of at the same level. They were just kind of like incrementally competing and it sort of wasn't immediately obvious that any of them were any better. Nobody, including any individual person, it's hard to tell. But what O1 did is it was, it's clearly a better model for certain tasks. I mean, I used it for like proving some theorems and you know, there's some theorems that like only I know because I still do a little bit of theory. Right. So it's like, I can go in there and ask like, oh, how would you prove this exact thing? Which I can tell you has never been in the public domain. It'll do it. It's like, what?Wei Lin [00:27:19]: Okay.Anastasios [00:27:20]: So there's this model and it crushed the benchmark. You know, it's just like really like a big gap. And what that's telling us is that it's not saturated yet. It's still measuring some signal. That was encouraging. The point, the takeaway is that the benchmark is comparative. There's no absolute number. There's no maximum ELO. It's just like, if you're better than the rest, then you win. I think that was actually quite helpful to us.Swyx [00:27:46]: I think people were criticizing, I saw some of the academics criticizing it as not apples to apples. Right. Like, because it can take more time to reason, it's basically doing some search, doing some chain of thought that if you actually let the other models do that same thing, they might do better.Wei Lin [00:28:03]: Absolutely.Anastasios [00:28:04]: To be clear, none of the leaderboard currently is apples to apples because you have like Gemini Flash, you have, you know, all sorts of tiny models like Lama 8B, like 8B and 405B are not apples to apples.Wei Lin [00:28:19]: Totally agree. They have different latencies.Anastasios [00:28:21]: Different latencies.Wei Lin [00:28:22]: Control for latency. Yeah.Anastasios [00:28:24]: Latency control. That's another thing. We can do style control, but latency control. You know, things like this are important if you want to understand the trade-offs involved in using AI.Swyx [00:28:34]: O1 is a developing story. We still haven't seen the full model yet, but it's definitely a very exciting new paradigm. I think one community controversy I just wanted to give you guys space to address is the collaboration between you and the large model labs. People have been suspicious, let's just say, about how they choose to A-B test on you. I'll state the argument and let you respond, which is basically they run like five anonymous models and basically argmax their Elo on LMSYS or chatbot arena, and they release the best one. Right? What has been your end of the controversy? How have you decided to clarify your policy going forward?Wei Lin [00:29:15]: On a high level, I think our goal here is to build a fast eval for everyone, and including everyone in the community can see the data board and understand, compare the models. More importantly, I think we want to build the best eval also for model builders, like all these frontier labs building models. They're also internally facing a challenge, which is how do they eval the model? That's the reason why we want to partner with all the frontier lab people, and then to help them testing. That's one of the... We want to solve this technical challenge, which is eval. Yeah.Anastasios [00:29:54]: I mean, ideally, it benefits everyone, right?Wei Lin [00:29:56]: Yeah.Anastasios [00:29:57]: And people also are interested in seeing the leading edge of the models. People in the community seem to like that. Oh, there's a new model up. Is this strawberry? People are excited. People are interested. Yeah. And then there's this question that you bring up of, is it actually causing harm?Wei Lin [00:30:15]: Right?Anastasios [00:30:16]: Is it causing harm to the benchmark that we are allowing this private testing to happen? Maybe stepping back, why do you have that instinct? The reason why you and others in the community have that instinct is because when you look at something like a benchmark, like an image net, a static benchmark, what happens is that if I give you a million different models that are all slightly different, and I pick the best one, there's something called selection bias that plays in, which is that the performance of the winning model is overstated. This is also sometimes called the winner's curse. And that's because statistical fluctuations in the evaluation, they're driving which model gets selected as the top. So this selection bias can be a problem. Now there's a couple of things that make this benchmark slightly different. So first of all, the selection bias that you include when you're only testing five models is normally empirically small.Wei Lin [00:31:12]: And that's why we have these confidence intervals constructed.Anastasios [00:31:16]: That's right. Yeah. Our confidence intervals are actually not multiplicity adjusted. One thing that we could do immediately tomorrow in order to address this concern is if a model provider is testing five models and they want to release one, and we're constructing the models at level one minus alpha, we can just construct the intervals instead at level one minus alpha divided by five. That's called Bonferroni correction. What that'll tell you is that the final performance of the model, the interval that gets constructed, is actually formally correct. We don't do that right now, partially because we know from simulations that the amount of selection bias you incur with these five things is just not huge. It's not huge in comparison to the variability that you get from just regular human voters. So that's one thing. But then the second thing is the benchmark is live, right? So what ends up happening is it'll be a small magnitude, but even if you suffer from the winner's curse after testing these five models, what'll happen is that over time, because we're getting new data, it'll get adjusted down. So if there's any bias that gets introduced at that stage, in the long run, it actually doesn't matter. Because asymptotically, basically in the long run, there's way more fresh data than there is data that was used to compare these five models against these private models.Swyx [00:32:35]: The announcement effect is only just the first phase and it has a long tail.Anastasios [00:32:39]: Yeah, that's right. And it sort of like automatically corrects itself for this selection adjustment.Swyx [00:32:45]: Every month, I do a little chart of Ellim's ELO versus cost, just to track the price per dollar, the amount of like, how much money do I have to pay for one incremental point in ELO? And so I actually observe an interesting stability in most of the ELO numbers, except for some of them. For example, GPT-4-O August has fallen from 12.90

After the introduction of the Dreadnought, the Naval Arms race would truly begin. 10 Years of Podcasting Update: https://www.patreon.com/posts/10-years-of-107050529 Contact sales@advertisecast.com to advertise on History of the Second World War.  History of the Great War is part of the Airwave Media podcast network. Learn more about your ad choices. Visit megaphone.fm/adchoices