Podcasts about Ilya

Join us on today's Views podcast as David and Jason welcome Natalie to discuss David's trip to a snack convention, Natalie's big move to Chicago and Jason's beef with David and Natalie about his upcoming birthday party. And David tries to make sense of Jason's marriage, Natalie accusses David of being in love with her and somebody holds Natalie's Chinese food hostage. And later, David welcome his roommates Ilya, Alex John and John's girlfriend Julia to discuss their recent fight and how John put his foot in his mouth once again. And the roommates discuss their ongoing "custody battle" with Julia over where John spends his time. New episodes Tuesday's and Thursdays! Check out Jason's pod here: https://open.spotify.com/episode/7LlWJVfakq3wDXXusQ7DGz?si=MdUqhYUWQ5-QyXmLogMmnA Learn more about your ad choices. Visit megaphone.fm/adchoices

Ilya Polosukhin is Co-Founder of NEAR, (https://www.near.ai), a high-performant, AI-native blockchain platform that provides the infrastructure needed for AI applications and agents to transact, operate, and interact across both Web2 and Web3. With a deep background in machine learning and software engineering, Ilya shares his journey into crypto, from early contributions in tech to co-founding NEAR, where he focuses on building an accessible Web3 ecosystem. He emphasizes the importance of user-centric blockchain infrastructure, the modularity of NEAR's design, and its role as a leading stack for creating decentralized applications, empowering developers to innovate seamlessly. 

My interview with Leaning Post Winery Co-Founders Ilya and Nadia Senchuk went so well that I had to split it up into two parts. In Part One: Their origin story which is more about love and trust than about tannins and full-bodied Chardonnay.  Nadia and Ilya are passionate, unapologetic winemakers whose portfolio can be found in Michelin Star restaurants all over the world. 

In the exciting conclusion of my interview with the owners/winemakers for Leaning Post Wines, Ilya and Nadia Senchuk, we pick up the interview about what the toughest moments were in those early years. So much fun talking giving birth while hunting for Syrah, speeding tickets and some fantastic Cabernet Franc.

Grant leads our full crew in a really fun show that has almost all of us eager to meet up at AMPS Nationals next week! (Sorry Grant) We have discussions on when is it OK to pull the plug on a show build, and if using shows as a motivating factor is healthy or not. We also dive into our own mortality as modelers, and ask the question, "What three builds are your “Pharaoh builds?” The Pharaohs of Egypt were famous for being buried with their earthly possessions and symbols of their accomplishments - so which three builds have you done that you would want archaeologists to find in 10,000 years buried with you?We also welcome back our friend Ilya Yut from Israel, and talk about his recent trip to Moson Show, and also catch up with him on new builds and his recent celebration of his 100th published model feature!! If you would like to become a Posse Outrider, and make a recurring monthly donation of $ 1 and up, visit us at www.patreon.com/plasticpossepodcast .Plastic Posse Podcast on Facebook: https://www.facebook.com/PlasticPossePlastic Posse Group on Facebook: https://www.facebook.com/groups/302255047706269Plastic Posse Podcast MERCH! : https://plastic-posse-podcast.creator-spring.com/Plastic Posse Podcast on YouTube:https://www.youtube.com/channel/UCP7O9C8b-rQx8JvxFKfG-KwOrion Paintworks (TJ): https://www.facebook.com/orionpaintworksJB-Closet Modeler (JB): https://www.facebook.com/closetmodelerThree Tens' Modelworks (Jensen): https://www.facebook.com/ThreeTensModelWorksSPONSORS:Tankraft: https://tankraft.com/AK Interactive: https://ak-interactive.com/Tamiya USA: https://www.tamiyausa.com/Support the showSupport the show

Ilya Tofilo • https://taplink.cc/sezonazlabel Ilya Tofilo aka Ilinouse A person who will love electronic music until the very end, all the people around him inspire and create feelings to move forward and create, always supports and is a big part of the family in electronic music, in the community with many people finds contact for the best goals! Co-owner of the underground label Sezonaz in which is Soul and faith! The value of each other above all! LINK INFO: • https://t.me/minimalfriendsvp • https://www.instagram.com/minimalfriends • https://www.facebook.com/minimalfriendsvideopodcast • https://vk.com/minimalfriends LOCATION • https://yandex.by/maps/org/ala_tau/14920098699 RTS.FM • https://t.me/rtsfm • https://soundcloud.com/rtsfm • https://rts.fm/ • https://facebook.com/rtsfm • https://instagram.com/rts.fm • https://vk.com/rtsfm • https://youtube.com/user/rtsfmmoscow RTS.FM is the first international internet radio project with LIVE audio-visual broadcasting from 30+ studios around the world!

In this second episode of a special two-part series, host Sandra Abrams chats with Maxine Peake about her portrayal of Anna Politkovskaya, a Russian-American journalist, in the film Words of War. Maxine shares what it was like to play the real life reporter, wife, and mother of two who risked her life to uncover the truth about the Chechen War. Anna was assassinated on October 7, 2006, the same day as Vladimir Putin's birthday. The international cast for this geo-political thriller includes Ciaran Hinds as her editor, Dimtry, Jason Isaacs as her husband, Sasha, Harry Lawtey as her son, Ilya, and Naomi Battrick as her daughter, Vera. Maxine says she loved filming on location in Latvia and shares which scene she and Jason did some improvising. Sean Penn serves as executive producer. The film is now in theaters. Part one of this series (episode 97) features Mark Maxey, President of Rolling Pictures, WIFV board member, and one of the producers of the film. To learn more about Words of War, visit: https://www.rollingpictures.com/You can watch the film's trailer here: https://www.youtube.com/watch?v=pui6KMbHECM#WordsOfWar---Subscribe to learn more about filmmaking, production, media makers, creator resources, visual storytelling, and every aspect that brings film, television, and video projects from concepts to our screens. Check out the MediaMakerSpotlight.com show page to find even more conversations with industry professionals that inspire, educate, and entertain!We on the Women in Film & Video (WIFV) Podcast Team work hard to make this show a great resource for our listeners, and we thank you for listening!

UNDERCARD BATTLES: Alex Weiss vs Dan Finegold Grace Lobo vs Adam Thomas John Fox vs Paco Brad Rickert vs Catherine Lindsay MAIN EVENT: Ilya Laksin vs Big T JUDGES: Sarah Barnitt, Dave Sheehan, Jacob Williams, Mahdiy Drummond OFFICIALS: Warren Simpson, Amanda Vasco, Gabby Jordan Brown, Jake Lemonade DJ: Fluke Human HOST: Matt Maran Comedy Fight Club is recorded LIVE every Sunday in NYC. Not in the NYC area? You can still watch Comedy Fight Club on youtube and follow us on Instagram @comedyfightnyc If you want access to old episodes and bonus content subscribe to our Patreon page! https://www.patreon.com/comedyfightclub

Florida and New York are massive markets — but they're still early. Everyone's fighting for attention, trust, and long-term positioning.So how did The Flowery rise to the top and become the go-to partner for the industry's premier brands?710 Labs. Wizard Trees. Preferred Gardens. Doja Pak the list goes on.These brands are some of the most sought-after names in the entire cannabis industry.They drive traffic into the store, signal trust with customers, and are built on quality and brand recognition.This week we sit down with Ilya Shmidt, of The Flowery, to uncover how his team became the trusted home for the most influential names in cannabis — and how they're scaling that same trust across Florida and New York.In this episode, we dive into:How The Flowery earned partnerships with the industry's top-tier brandsThe systems behind scaling quality and consistency at retailWhy New York's market share shifted fast — and what's next in FloridaChapters00:00 Introduction to Flowery and Ilya Schmidt01:07 Ilya's Journey into the Cannabis Industry02:41 Building Brand Partnerships in Cannabis05:07 The Vetting Process for Brand Collaborations06:01 Vertical Integration in Cannabis Production10:30 Collaboration and Knowledge Sharing Among Brands12:51 Creating Unique Cultivars and Market Disruption13:06 Learning from Other Industries14:59 Balancing Brand Visibility and Shelf Space18:05 Expanding into New Markets like New York22:54 Navigating the Cannabis Market in New York29:42 The Importance of Education in Cannabis35:00 Emerging Brands and Market Trends39:01 Lessons Learned in the Cannabis Industry00:00 Introduction to Flowery and Ilya Schmidt01:07 Ilya's Journey into the Cannabis Industry02:41 Building Brand Partnerships in Cannabis05:07 The Vetting Process for Brand Collaborations06:01 Vertical Integration in Cannabis Production10:30 Collaboration and Knowledge Sharing Among Brands12:51 Creating Unique Cultivars and Market Disruption13:06 Learning from Other Industries14:59 Balancing Brand Visibility and Shelf Space18:05 Expanding into New Markets like New York22:54 Navigating the Cannabis Market in New York29:42 The Importance of Education in Cannabis35:00 Emerging Brands and Market Trends39:01 Lessons Learned in the Cannabis IndustryGuest Links:https://www.linkedin.com/in/ilyashmidt/https://theflowery.co/https://www.instagram.com/floweryflorida/https://www.linkedin.com/company/the-floweryco?trk=public_profile_topcard-current-companyhttps://www.youtube.com/channel/UCEhtokhIFa7UFWeSQqtR3XgOur LinksBryan Fields on TwitterKellan Finney on TwitterThe Dime on TwitterAt Eighth Revolution (8th Rev), we provide services from capital to cannabinoid and everything in between in the cannabinoid industry.8th Revolution Cannabinoid Playbook is an Industry-leading report covering the entire cannabis supply chain The Dime is a top 5% most shared  global podcastThe Dime has a New Website. Shhhh its not finished.The Dime is a top 50 Cannabis PodcastSign up for our playbook here:

Микс посвящен лучшим танцевальным хитам Версия микса без джинглов вот-вот появится эксклюзивно в моем Telegram канале: t.me/ilyacryis Эксклюзивы тут: Telegram: t.me/ilyacryis Kamazz - Текила-Любовь (Тропикана-Женщина) (Remix) XOLIDAYBOY - Моя хулиганка (Remix) Минаева - Шоколадка (Remix) NЮ - АУ (Remix) Дима Билан, Мари Краимбрери - It's My Life (Remix) Wallem - Харизма (Remix) Big Baby Tape, Aarne - Supersonic (Remix) t.A.T.u x Alexx Slam - Я сошла с ума (Blend) KOREL & NEEL x David Guetta & Akon - Она делит вайб (Edit) INSTASAMKA - Мой мармеладный (Remix) VEIGEL - Довези (Edit) MACAN, A.V.G - Привыкаю (Remix) Jakone - Дорога дальняя (Remix) NLO, REFLEX, Leonid Rudenko - Танцы 2.0 (Remix) 5sta Family - В июле (Remix) Татьяна Куртукова - Матушка (Blend) DASHI x A7S - К Черту Любовь (Edit) Alblak 52 - 7 x Малинки (Edit) В версиях от лучших русскоязычных саунд-продюсеров: Corto, Slim, Shmelev, DJ Prezzplay, Arteez, Breezwell, JONVS, Ramirez, Alexx Slam, Vee-Tal, Baldin, RAKURS, EwellicK, Hardovich, KIRILLSLEM, MIKIS, Glazur, XM

Jeff and Jenna are joined by Ilya (I love you always) who discusses his own journey from victim to victor and the importance of the men's work he has done through the Mankind Project (MKP). He announces and promotes his up-and-coming YouTube Channel and Podcast entitled "Ilya".

In this episode we recap our Q1: what we shipped, distribution challenges, siloing engineering workstreams + a bunch of tangential topics.Download the Metacast podcast app for free:iOS: https://apps.apple.com/app/metacast/id6462012536Android: https://play.google.com/store/apps/details?id=app.metacast.podcast.playerSegments[00:00] Opening[02:09] New feature: Chapters[05:27] New feature: Following a.k.a. Podcast Inbox[06:17] Feedback from Grumpy Old Geeks[08:10] Ilya turning into full-time engineer[12:02] We don't vibe code![14:49] AI summaries in the web app[16:52] Full transcripts in the web app[18:39] Web is the innovation platform[19:45] Better sharing images[21:01] New blogging framework[24:08] Restarting marketing[26:05] The distribution challenge[27:13] Discoverability on App Store[28:34] The cold start problem[30:04] 1000 fans[30:56] Distractions in Q1[31:15] Spiking GCP costs[33:52] LLM bots update[34:28] Taxes[37:55] Siloing[39:20] Working in person again![40:11] What we're listening to[48:20] Where people can find usShow notesBlog postsMetacast: Q1 2025 RetrospectiveOur biggest struggle — distributionEpisode chapters now available in Metacast podcast appPodcast Inbox now available in Metacast podcast appLLM bots + Next.js image optimization = recipe for bankruptcy (post-mortem)DIY Delaware C-Corp taxes for a new startup with no funding, no payroll and no assetsPodcasts661: The Nightmare Before Overcast on Grumpy Old GeeksEverything Everywhere DailyDo trade deficits matter? on Planet MoneyJosh Waitzkin on The Joe Rogan Experience#792: Seth Godin on Playing the Right Game and Strategy as a SuperpowerBooksThe Art of Learning by Josh WaitzkinGet in touch

Linktree: https://linktr.ee/AnalyticWelcome to Notorious Mass Effect, hosted by Analytic Dreamz, your go-to source for music deep dives. In this segment, Analytic Dreamz explores Ed Sheeran's latest single, “Azizam,” released April 4, 2025, as the lead track for his upcoming 8th studio album, Play. This upbeat, pop-tinged song, produced by Iranian-born ILYA, draws from Persian heritage, with “Azizam” translating to “my beloved” in Farsi. Dedicated to Sheeran's wife, Cherry Seaborn, it blends rich cultural rhythms and universal themes of love. Analytic Dreamz unpacks its lyrics, cultural influences, and Play's place in Sheeran's 10-album vision.Support this podcast at — https://redcircle.com/analytic-dreamz-notorious-mass-effect/donationsAdvertising Inquiries: https://redcircle.com/brandsPrivacy & Opt-Out: https://redcircle.com/privacy

On today's podcast, David and Jason welcome Natalie, Taylor and Ilya for a hilarious pod including how much Natalie makes per year, Ilya's wild story from Hong Kong, and David answers if he is on steroids or not. Also, David and Taylor hang with Chris Martin on a Coldplay music video shoot, Jason gets stopped at the Mexican border, putting urinals in women's bathrooms and Jason may or may not have skin cancer.  And finally,  the guys put a call to the listener as they consider moving to two or three podcasts a week.Please comment how many podcasts per week you would like below or DM David and Jason. We would really appreciate your feedback! Check out Jason's podcast "All Good Things" https://open.spotify.com/episode/5i8MMF1Jvwq3fNcejhSAKu?si=J4GbXxIxSN2YRK4W99A2Yw Learn more about your ad choices. Visit megaphone.fm/adchoices

Ilya joins Mark to talk about the continued legal battle between the courts & Trump in the case of Venezuelan immigrants and the President's his usage of the Alien Enemies Act.

The Trump administration has pulled funding for universities like Columbia and the University of Pennsylvania, and is threatening to withhold federal dollars from public schools with diversity, equity and inclusion programs. Harvard is also fighting to retain its funding. On this week's On the Media, hear how the distinctly American idea of “diversity” has fallen out of favor—from higher education to the Supreme Court.Reporter Ilya Marritz explains how the Trump administration is cracking down on universities by pulling funding. Plus. how the history of Harvard and the concept of “diversity” is the hidden subtext for the Trump administration's education policies. In the past half-century, the academy (and the business world) embraced the idea of diversity as a social good–an idea developed at Harvard and endorsed by the Supreme Court, until the latter ended race-based affirmative action in 2023. You can find earlier installments of Ilya's reporting for The Harvard Plan, a collaboration with The Boston Globe, here.Further reading/listening:The Harvard Plan: Part OneThe Harvard Plan: Part TwoUniversity presidents aren't capitulating to Trump, they say. They're ‘adapting.' by Hilary BurnsTrump is threatening Harvard with funding cuts in the billions. But what does he want the university to do? by Hilary Burns On the Media is supported by listeners like you. Support OTM by donating today (https://pledge.wnyc.org/support/otm). Follow our show on Instagram, Twitter and Facebook @onthemedia, and share your thoughts with us by emailing onthemedia@wnyc.org.

WGN Radio's Charlie Roumeliotis breaks down the Blackhawks 5-3 loss to the Vegas Golden Knights. Troy Murray joins the show to discuss the tough loss despite a career night for Ryan Donato. Then, the two talk about the future for a number of Blackhawks players, including Donato. Later, hear postgame thoughts from Ryan Donato, Ilya […]

In this episode of The Bookkeepers' Podcast, Jo Wood and Zoe Whitman are joined by Ilya Radzinsky, CPO and Founder of TaxDome, the all-in-one platform designed to help bookkeepers and accountants simplify, automate, and grow their practices. If you're tired of juggling different software tools, chasing clients for paperwork, or feeling buried in admin, this conversation will show you a better way. Ilya shares how TaxDome brings everything together in one powerful platform—making it easier for bookkeepers to manage their workflow, get paid faster, and scale their businesses. We talk about: ✅ Why automation is key to growing a profitable bookkeeping business ✅ How to simplify client communication and document collection ✅ The must-have tools inside TaxDome for bookkeepers and accountants ✅ How to systemise your processes and save hours every week ✅ Why using an all-in-one platform can reduce overwhelm and increase profit Whether you're just starting out or ready to scale, this episode is packed with practical advice on how to work smarter—not harder!

Use code VIEWS10 for 10% off your next SeatGeek order here: https://tinyurl.com/bze4pb74 Sponsored by SeatGeek. *Restrictions apply. *Restrictions Apply. Max $20 Discount Today's Views podcast is packed, as David and Jason welcome Natalie, Ilya, Taylor, John and Alex to talk about how the cops were called to Jason's house, David's luxury experience sitting court side at the Laker game, and Natalie comes to an old man's rescue. Also, running into Paul McCartney, David can't remember showering with his roommate, and the guys divulge their biggest turn-ons. Check out Jason's latest "All Good Things" podcast here: https://open.spotify.com/episode/7shbccrNyLOJgQqiZdA3wq?si=4C6WWqQMSVKlnbLAZOAyKw Learn more about your ad choices. Visit megaphone.fm/adchoices

Ilya Ponomarev is a Russian-Ukrainian politician who was a member of the Russian State Duma from 2007 to 2016. After the 2022 Russian invasion, Ponomarev joined Ukraine's Territorial Defence Forces, and categorically denounced the invasion. While a member of the Russian State Duma, he was the only deputy not to vote in favour of the Russian gay propaganda law and to vote against Russia's annexation of Crimea in March 2014. He is now in exile in Ukraine and is a spokesman with insurgent Russian forces (National Republican Army) fighting on the side of Ukraine. ----------SILICON CURTAIN FILM FUNDRAISERA project to make a documentary film in Ukraine, to raise awareness of Ukraine's struggle and in supporting a team running aid convoys to Ukraine's front-line towns.https://buymeacoffee.com/siliconcurtain/extras----------SILICON CURTAIN LIVE EVENTS - FUNDRAISER CAMPAIGN Events in 2025 - Advocacy for a Ukrainian victory with Silicon Curtainhttps://buymeacoffee.com/siliconcurtain/extrasOur first live events this year in Lviv and Kyiv were a huge success. Now we need to maintain this momentum, and change the tide towards a Ukrainian victory. The Silicon Curtain Roadshow is an ambitious campaign to run a minimum of 12 events in 2025, and potentially many more. We may add more venues to the program, depending on the success of the fundraising campaign. https://buymeacoffee.com/siliconcurtain/extrasWe need to scale up our support for Ukraine, and these events are designed to have a major impact. Your support in making it happen is greatly appreciated. All events will be recorded professionally and published for free on the Silicon Curtain channel. Where possible, we will also live-stream events.https://buymeacoffee.com/siliconcurtain/extras----------LINKS:https://en.wikipedia.org/wiki/Ilya_Ponomarev https://www.bbc.co.uk/programmes/m002113qhttps://www.fpri.org/contributor/ilya-ponomarev/BOOKS:Does Putin Have to Die? The Story of How Russia Becomes a Democracy after Losing to Ukraine (Hardcover – 19 Jan. 2023)ARTICLES: https://www.themoscowtimes.com/2024/01/19/ilya-ponomaryov-we-have-to-capture-the-kremlin-there-is-no-other-way-a83772 ----------SUPPORT THE CHANNEL:https://www.buymeacoffee.com/siliconcurtainhttps://www.patreon.com/siliconcurtain----------TRUSTED CHARITIES ON THE GROUND:Save Ukrainehttps://www.saveukraineua.org/Superhumans - Hospital for war traumashttps://superhumans.com/en/UNBROKEN - Treatment. Prosthesis. Rehabilitation for Ukrainians in Ukrainehttps://unbroken.org.ua/Come Back Alivehttps://savelife.in.ua/en/Chefs For Ukraine - World Central Kitchenhttps://wck.org/relief/activation-chefs-for-ukraineUNITED24 - An initiative of President Zelenskyyhttps://u24.gov.ua/Serhiy Prytula Charity Foundationhttps://prytulafoundation.orgNGO “Herojam Slava”https://heroiamslava.org/kharpp - Reconstruction project supporting communities in Kharkiv and Przemyślhttps://kharpp.com/NOR DOG Animal Rescuehttps://www.nor-dog.org/home/----------PLATFORMS:Twitter: https://twitter.com/CurtainSiliconInstagram: https://www.instagram.com/siliconcurtain/Podcast: https://open.spotify.com/show/4thRZj6NO7y93zG11JMtqmLinkedin: https://www.linkedin.com/in/finkjonathan/Patreon: https://www.patreon.com/siliconcurtain----------Welcome to the Silicon Curtain podcast. Please like and subscribe if you like the content we produce. It will really help to increase the popularity of our content in YouTube's algorithm. Our material is now being made available on popular podcasting platforms as well, such as Spotify and Apple Podcasts.

On the latest episode of Unsupervised Learning, Jacob is joined by two of the most influential minds in AI today. 

Send us a textWhen you mix beauty, engineering and and pure excitement into something that just makes you say, "Hell Yes!", you get a supercar that will blow your mind. Oilstainlab's HF11 is a car built for drivers.Today we have with us Nitkita Bridan. In 2019, he and his brother Ilya formed Oilstainlabs, to begin producing a one of a kind supercar. The HF11 is a 650hp, 2000 lbs, vehicle that is the perfect mix of heritage, cutting-edge technology, precision engineering, and pure anarchy. With an interchangeable internal combustion or EV powerplant, the HF-11 is being honed to be the ultimate street legal vehicle. Only 25 limited edition cars will be available worldwide with 11 going to discriminating buyers as part of an exclusive “Maniac” package.So let's talk with Nikita about how they engineered all the excitement into this vehicle.Welcome Nikita.Click Here to Subscribe: FUTR.tv focuses on startups, innovation, culture and the business of emerging tech with weekly podcasts talking with Industry leaders and deep thinkers.Occasionally we share links to products we use. As an Amazon Associate we earn from qualifying purchases on Amazon.

Use code VIEWS10 for 10% off your next SeatGeek order here: https://tinyurl.com/bze4pb74 Sponsored by SeatGeek. *Restrictions apply. *Restrictions Apply. Max $20 Discount On today's Views podcast David, Jason and Natalie sit down with David's roommate John to talk bout his strange approach to the world, John's credit card debt and the horrible thing John said to Natalie's sister. Also, David takes issue with Natalie's mom, Ilya helps John with his English, and David reveals the naughty thing that happened to him in church. Check out Jason's latest AGT podcast here: https://open.spotify.com/episode/5ReqauUvQQtqO0NKINMmQd Learn more about your ad choices. Visit megaphone.fm/adchoices

Though always in their hearts, it had been months since the Rostovs received news of Nicholas. When Count Ilya finally received a letter from his son, he ran his study with it. Anna Drubetskaya, Boris' mother, was living with the family and aimed to be useful. She found Ilya sobbing and laughing. His darling boy suffered a small wound but was promoted. He found this reason to thank God. Still, he wonders how to tell his wife of the injury. Anna therefore took the rest of the day preparing the Countess. Young Natasha convinced Anna to reveal the nature of the letter and promised to keep it secret. She broke her word right away, telling Sonya (who is devoted to Nicholas) as well as her little brother, Petya. Sonya cried and Natasha comforted her -- noting it was just “a little wound.” Petya takes the missive with resolve and adds how he would have “killed many Frenchmen.” Natasha asks Sonya, “Do you remember Nicholas?” She means in the sense of holding the same feelings. Sonya reveals, “I am in love with your brother and whatever may happen, shall never cease to love him.” Natasha no longer feels the same about Boris.  Her childlike love has faded. Natasha knew there was such love as Sonya was describing, but never experienced it. They discuss whether it would be proper for Sonya to write Nicholas and reference his commitment. Sonya decides that if she is mentioned in the letter, she will write. Natasha does not have any compulsion to write Boris as she feels it would just come out awkward. Pétya reveals Natasha has developed affections for the new Count Bezúkhov as well as her Italian singing coach.  After dinner, the Countess was in her room focused on a portrait of Nicholas. Anna arrived with the letter while Ilya listened through a keyhole. There was crying, silence, then voices in happy intonation. Anna opened the door and exhibited a proud expression. Anna embraced her husband and in came Véra, Natasha, Sonya and Pétya. All went over the letter. There was a description of the campaign, battles and the promotion. Nicholas sent his love and asked for his parents' blessings. He sent a special greeting to “dear Sónya, whom he loved and thought of just the same as ever.” When Sonya heard this, she blushed, cried and ran to the dancing hall, where she whirled around at full speed.The practical Vera asked, “Why are you crying, Mamma? One should be glad and not cry.” This was true but not wise to express. She was reproached by the family while her mother thought, “and who is it she takes after?”The letter was read over among tutors, nurses and servants. Each time the Countess did so with fresh pleasure.  She contemplated how incredible it was that her son, once a scarcely perceptible motion under her heart, who had learned to say little words, was now away in a foreign land doing warrior's work as a model officer. It was the universal experience - showing how children imperceptibly grow from the cradle to manhood. Yet it does not exist for a mother. Her boy's growth, at each stage, seemed as extraordinary to her as if it never existed in others. She thought, “What style! and “what a heart and soul!” She noticed how Nicholas barely wrote of his exploits and sufferings, but mentions Denísov and others.A bountiful response would come from the family, as a new officer needs supplies which are NOT paid for by the army. Preparations were being made, along drafts of letters.  6,000 rubles was collected. There was a question of how to reach Nicholas as he was on the move and the postal system was notoriously ill-managed.Anna would prove her worth yet again in conveying the material. She had curried favor with authorities (couriers for Grand Duke Constantine Pávlovich, a historic figure and elder brother of Alexander I) to secure a means of communication to reach Boris, who would convey any package to Nicholas. 

Get 15% off all orders with code VIEWS at https://www.schedule35.co/us/ Get a 60-day free trial at https://www.shipstation.com/promos/views/ On today's podcast, David, Jason and Natalie welcome Jason's wife Nivine to talk about how they fell in love, Nivine's potty mouth and the juicy details of their sex life, Plus, David and Natalie hit Vegas to hang with David Blaine, Marshmello and Shaun White. Also, David gets harassed at the club, Jason takes his daughter to the Sway House reunion and Ilya joins the podcast after overhearing David talking shit about people who devote their lives to working out.  Check out Jason's podcast "All Good Things" here; https://tinyurl.com/2pz8sp4w Learn more about your ad choices. Visit megaphone.fm/adchoices

— A big part of why we haven't designed a better world yet is that we haven't designed a better inner world. The truth is, all of us carry pain we haven't fully processed. Some of us have been deeply mistreated by the system. Others have more privilege, more resources—access to therapy, meditation retreats, time for self-reflection. But regardless of where we fall on the spectrum, every single one of us carries unresolved wounds. Your thoughts are shaped by the pain you haven't yet faced. If you've tried everything to change your circumstances and still feel stuck, here's why: Your nervous system is wired to protect you from pain. It's not going to let you just "think a different thought" if that thought contradicts the survival strategies you developed to avoid overwhelming pain in childhood. And those strategies? They live deep in the body. We have to face the pain — we need to actually discharge it from the body. Pain doesn't just sit in our minds. It's stored in our nervous systems, locked away in patterns of tension, contraction, and avoidance. And to unlock the full power of our minds—to become the creative, limitless beings we truly are—we have to physically release that stored pain. Transformative Listening is the way we're designed to heal.  It's through connection. All of our wounding happened in the absence of loving connection. As infants, we were completely vulnerable. We needed caregivers who could attune to us, hold us, soothe us. And where that didn't happen? We developed compensatory strategies—numbing, shutting down, staying small. But the good news? We can heal. We just need someone to be present with us while we do it. Valeria interviews Ilya Parizhsky — He is a licensed psychotherapist and the creator of Transformative Listening. Ilya helps leaders, innovators, and change-makers form structured partnerships that transform setbacks and pain into fuel for growth, resilience, and transformation - enabling them to face challenges head-on and emerge stronger. He emphasizes the importance of connection and closeness in this process, creating a space where individuals develop advanced emotional engagement skills - both for themselves and in their interactions with others. These skills facilitate deep healing and transformative breakthroughs. Through this immersive, experiential approach, Ilya guides individuals in harnessing the energy of pain and turning it into vitality, resilience, and well-being. His work empowers people to break free from emotional stagnation, cultivate powerful relationships, and expand beyond their perceived limits.  To learn more about Ilya Parizhsky and his work, please visit: https://transformativelistening.love/

Ilya Strebulaev has devoted two decades to studying how venture capitalists approach decision-making, and the reasons behind the successes and failures of corporate innovations. He joins Google to discuss his book, “The Venture Mindset,” a playbook on how to adapt to a rapidly changing world, make smarter bets, launch new ventures, and transform traditional organizations into hubs for innovation. Ilya is an international expert in venture capital, private equity, and financing innovation. Among his many achievements, he's been a professor at Stanford University's Graduate School of Business since 2004. He is also a research associate at the National Bureau of Economic Research and the founder and faculty director of the Stanford GSB Venture Capital Initiative. Watch this episode at youtube.com/TalksAtGoogle.

In this conversation, Conor and Jaeden discuss the recent surge in OpenAI's user base, the implications of Ilya Suskova's new startup Safe Super Intelligence, and Mir Moradi's new venture Thinking Machines Lab. They explore the factors contributing to OpenAI's growth, the challenges and opportunities facing AI startups, and the significance of leadership in the AI space. The discussion highlights the evolving landscape of AI technology and the potential impact of these new companies.Chapters00:00 OpenAI's Colossal Growth05:18 Ilya Suskova and Safe Super Intelligence08:44 Miriam Moradi's Thinking Machines Lab14:07 Final Thoughts and ReflectionsAI Applied YouTube Channel: https://www.youtube.com/@AI-Applied-PodcastGet on the AI Box Waitlist: ⁠⁠https://AIBox.ai/⁠⁠Conor's AI Course: https://www.ai-mindset.ai/coursesConor's AI Newsletter: https://www.ai-mindset.ai/Jaeden's AI Hustle Community: https://www.skool.com/aihustle/about

Telly is giving away free TVs. Seriously. We find out how exactly they can make enough money on ads to support this. Learn more about your ad choices. Visit megaphone.fm/adchoices

On this week's interview Paul sits down with attorney, activist, and author Ilya Shapiro. Shapiro worked at the libertarian Cato Institute for more than a decade and attempted a career change to Georgetown Law School. Sadly, a factually accurate but "controversial" post on social media got him into hot water and caused nationwide controversy including at Georgetown Law. The dustup caused Ilya to look elsewhere for employment and also resulted in his new book "Lawless: The Miseducation of America's Elites." You don't want to miss this informative conversation!  

In hour 1 of The Mark Reardon Show, Mark and the crew discuss the legacy's media word of the day, chaos. What agenda are they trying to push about the Trump administration? Mark is then joined by Josh Hammer, the Newsweek Senior Editor at Large and the Host of The Josh Hammer Show which can be heard on 97.1 on Saturdays at 1pm. They discuss the latest work being done within DOGE, why Democrats oppose DOGE, what occurred at CPAC, and more. In hour 2, Sue hosts, "Sue's News" where she discusses the latest trending entertainment news, this day in history, the random fact of the day, and much more. Mark is then joined by Ilya Shapiro, a Senior Fellow and the Director of Constitutional Studies at the Manhattan Institute. His new book is titled, "Lawless: The Miseducation of America's Elites". They discuss what DOGE really is -- and why Ilya says it is legally sound. He is later joined by John Jagler, the Wisconsin State Senator. He discusses Wisconsin Governor Tony Evers proposing to remove gender terms from state law which would replace the word, "mother" with "inseminated person" and "paternity" with "parentage". In hour 3, Mark is joined by the Missouri Secretary of State, Denny Hoskins who recently was at the center of delaying the start of sports betting in the state. He and Mark debate the topic and Mark is then joined by Alex Gold, with Kansas City's 610 Sports Radio. He shares his thoughts on the delay as well. Mark is then joined by Frank Miele, a retired editor of The Dailey Inter Lake in Montana, an author, and a columnist for Real Clear Politics. His newest book is titled, "What Matters Most: God, Country, Family and Friends". They discuss the importance of unity, but not compromise being the path forward as well as his latest piece which is headlined, "The Gulf Between Trump and the Associated Press." They wrap up the show with the Audio Cut of the Day.

On February 21, Suzi talked to Zakhar Popóvych, a Ukrainian researcher and activist in Kyiv with roots in labor and socialist organizing, and Ilya Budraitskis, a Russian historian and political theorist now in exile, about Trump's foreign policy moves regarding Ukraine on the eve of the third anniversary of Russia's invasion. The Trump administration has engaged in peace talks in Saudi Arabia that excluded Ukraine entirely. Trump has even embraced Putin's revisionist narrative claiming Ukraine started the war. What does this mean for Ukraine's survival, Europe's stability, and the broader left struggle against imperialism and authoritarianism? Suzi asks Zakhar and Ilya to unpack the shifting geopolitical landscape, the implications of Trump's concessions to Putin, the resilience of Ukraine, and the role of the internationalist left in an era of resurgent imperialism. Jacobin Radio with Suzi Weissman features conversations with leading thinkers and activists, with a focus on labor, the economy, and protest movements.

In this segment, Mark is joined by Ilya Shapiro, a Senior Fellow and the Director of Constitutional Studies at the Manhattan Institute. His new book is titled, "Lawless: The Miseducation of America's Elites". They discuss what DOGE really is -- and why Ilya says it is legally sound.

In hour 2, Sue hosts, "Sue's News" where she discusses the latest trending entertainment news, this day in history, the random fact of the day, and much more. Mark is then joined by Ilya Shapiro, a Senior Fellow and the Director of Constitutional Studies at the Manhattan Institute. His new book is titled, "Lawless: The Miseducation of America's Elites". They discuss what DOGE really is -- and why Ilya says it is legally sound. He is later joined by John Jagler, the Wisconsin State Senator. He discusses Wisconsin Governor Tony Evers proposing to remove gender terms from state law which would replace the word, "mother" with "inseminated person" and "paternity" with "parentage".

Guests: Winston Weinberg, CEO & co-founder of Harvey; and Ilya Fushman, partner at Kleiner Perkins“If you think about pretty much any job out there in the world, we will have some sort of [AI] copilot,” says Kleiner Perkins partner Ilya Fushman. “The question is, who are the right folks to build it, and what's their vision?”For Harvey CEO & co-founder Winston Weinberg, the vision is clear: Silicon Valley cannot and should not try to disrupt the legal profession by automating the job of lawyers. Instead, he says, they need to have “respect for the industry” before designing AI solutions that speed up specific tasks.“These industries are incredibly complex,” Winston says. “Legal is one of the oldest professions known to man. There are firms that are over a hundred years old. There are firms that are hundreds of years old, and having a brand that says, ‘We are partnering with the industry to transform it' versus ‘We are just going to steamroll the industry' is really important for us.”Chapters:(01:16) - The zeitgeist switch (02:58) - What is Harvey? (06:10) - Chief Law Officers (07:58) - Agentic workflows (09:43) - Ilya's investment thesis (12:48) - Collaborating with AI (16:05) - Task automation (20:52) - Why is it called Harvey? (23:14) - Respecting the legal industry (26:43) - Winston's past jobs (28:47) - First steps (32:13) - Scaling the company (35:02) - Scaling yourself (37:19) - Who works for Harvey (40:50) - Making mistakes (43:15) - Making sacrifices (45:51) - Growing too fast (50:50) - Setting priorities (54:54) - Harvey's competitors (57:38) - Internal virality (01:00:46) - Testing Harvey's limits (01:03:29) - Who Harvey is hiring (01:04:01) - What “grit” means to Winston Mentioned in this episode: ChatGPT, the Fortune 500, Microsoft Copilot, Gabe Pereyra, Activision, Excel, Counsel AI Corporation, Suits, Harvard University, Netflix, Dell, O'Melveny & Myers, Hueston Hennigan, Meta, Reddit, Jason Kwon, Anthropic, Marissa Mayer, Eric Schmidt, Google, Larry Page, Sergey Brin, and Glean.Links:Connect with WinstonTwitterLinkedInConnect with IlyaTwitterLinkedInConnect with JoubinTwitterLinkedInEmail: grit@kleinerperkins.com Learn more about Kleiner PerkinsThis episode was edited by Eric Johnson from LightningPod.fm

Join MEMBERS ONLY to get access to perks!  Support the channel for only $2.99. For only $4.99 a month, get EVERY NEW podcast episode EARLY and AD-FREE. As a member, you'll have access to guest AMAs to get your questions answered. Enjoy the cool elitefts badge next to your profile name as well. Welcome to another podcast episode of Dave Tate's Table Talk. Today's guest is Ryan Rhodes with co-host Ilya Khazov. Ryan Rhodes is a drug-free pro strongman and 5x World's Strongest Man Masters athlete who's competed in multiple weight classes over his past 26 years in the sport. Thriving in spite of his ND, VAST, C-PTSD and pacemaker implant for Stokes Adams Syndrome, he is recognized as the strongest human cyborg ever and the first pro athlete ever to compete with a battery powered heart. Ryan is also a successful business owner, the producer of 'Clash on the Coast' on ESPN- the first strongman competition ever to air live on TV- and has worked with Disney, Warner/Discovery, NBC and Viamedia among others. Ryan's IG: https://www.instagram.com/honkystrong/ Ilya Khazov, born in Russia and based in Cyprus, is a strongman competitor who holds a Guinness world record for rope jumping with an 80kg anvil, a feat he accomplished on Italian TV. In 2022, he competed in the Strongman Champions League, securing notable placements and lifting a 360kg front loader in Finland. Despite a serious bicep tear, he remains focused on competing at top levels, including the World's Strongest Man. Ilya also excels in martial arts and professional paintball, with his team placing third in Europe. Off the field, he enjoys competitive PC gaming and escape rooms with his wife, Lily.  Ilya's IG: https://www.instagram.com/ilyakhazov.strongman/  SPONSORS  AG1 AG1 is offering new subscribers a FREE $76 gift when you sign up. You'll get a Welcome Kit, a bottle of D3K2, and (5) free travel packs in your first box.  Visit https://drinkag1.com/DAVETATE Marek Health   A telehealth platform specializing in hormone optimization and preventative medicine. Offers self-service labs and guided optimization with competitive pricing.    Save 10% on your first order with code TABLETALK.    Visit Marek Health today: https://marekhealth.com/tabletalk   LMNT    A zero-sugar, naturally-formulated electrolyte drink mix suited for athletes and those on hydration-focused diets.    Receive a free 8-flavor sample pack with any purchase. https://partners.drinklmnt.com/free-gift-with-purchase?utm_campaign=agwp&am…    RP Hypertrophy App    An advanced training app designed for maximum muscle growth. Early access pricing starts at $24.99.    Visit the provided link for more details and discounts. https://go.rpstrength.com/hypertrophy-app/ CODE: TABLE TALK    elitefts    Offers a wide range of gym equipment and apparel.    Support the show: https://www.elitefts.com/content/table-talk/  Save 10% with code TABLETALK.  CODE: TABLETALK    All profits support Dave Tate's Table Talk Podcast.    SUPPORT THE SHOW    Support and help the Podcast grow by Joining The Crew: https://www.elitefts.com/join-the-crew    All profits from elitefts Limited Edition Apparel, Table Talk Coffee, and Team elitefts Workouts, Programs, and Training eBooks support Dave Tate's Table Talk Podcast.    Shop these elitefts items: https://www.elitefts.com/content/table-talk/  elitefts Shop: https://www.elitefts.com/  elitefts IG: https://www.instagram.com/elitefts/ elitefts  Limited Edition Apparel: https://www.elitefts.com/shop/apparel/limited-edition.html

Artist: Ilya Fedorov (Moscow, Russia) Name: February Podcast, 2025 [Vinyl Only] Genre: House / Minimal Techno Release Date: 06.02.2025 Exclusive: Deep House Moscow Ilya Fedorov: www.facebook.com/ilya.fedorov.31 Soundcloud: @ilya-fedorov Instagram: www.instagram.com/ilya_fedorov CONTACT (DHM): Email — deephousemoscow@hotmail.com Follow us: www.facebook.com/deephousemsk/ www.instagram.com/deephousemoscow/ vk.com/deephousemsk/

On today's Views podcast David and Jason sit down to talk about David's big night at the Grammy's, Natalie's girls trip to Aspen and Jason's advice on how he won his wife over. Also, David is mad Natalie is taking too many vacations days, David parties for the last time and Ilya joins the pod to defend how he spends his time as Dobrik's and Xeela CEO. Also, Taylor gets hit on at Erewhon, Zane nearly ruins Spiderman 3, and Jason has a bad time getting Greek yogurt with David.  Plus, we answer a few DM's including one that roasts David pretty hard.  Learn more about your ad choices. Visit megaphone.fm/adchoices

It's a birthday request with the classic episode The Sword and the Dragon. Man - it sure is beardy around here.Host segments: awkward invasion tactics; Roger Corman got his paws on this one, too; some people will be charred; death or Sharla?; this is now an Ilya Muromets fancast; always open with the dragon; Bergman does SNL; the magic tablecloth of lost opportunities.

VGK is 2nd in the Pacific! 3 Games then two weeks off; Four Nations: Good Luck Stone, Theodore, Hanifin, Hill, Eichel and Coach Cassidy! Ladies of the NHL Spring Retreat & Upcoming Watch Party! HBD Nic, Colleen, LT, Jiri & Ilya! Welcome Brandon Saad and Tomas Hertl is fire! Vegas Hockey Girls Podcast is created and recorded by hockey loving sisters Colleen and Mandy. The girls team up in their hometown of Las Vegas, NV and attend as many hockey games as possible! They were introduced to the NHL when Vegas was awarded an expansion team, shortly thereafter we were hooked! Yup, been fans since day effing one! Listen to be caught up with all things VGK and NHL in 15 minutes or less with a new pod twice a week! www.vegashockeygirls.com Find us on social media: https://www.instagram.com/hockeygirlspod/ https://twitter.com/HockeyGirlsPod https://www.facebook.com/groups/vegashockeygirlspodcast Mandy can be found on socials: as VGK GOALIE GIRL Reach out! Talk to us by leaving a voice message on SPOTIFY! If you ever hear an error, mistake, or something missing in our pod please email us: vegashockeygirls@gmail.com The views and opinions expressed in this podcast are those of the hosts and guests and do not reflect the position of The Vegas Golden Knights and/or any affiliates. 32 teams: 82 games for each team: 16 go to the playoffs: best of 7: four rounds: 16 wins and then you get to hoist Lord Stanley.  Thanks!

The Jubal Show is on the radio all over the country. They are unafraid to tackle the topical world we live in, and can’t get enough of the drama. Nothing is sacred, and nothing is off limits on The Jubal Show.Join Jubal, Nina, Victoria, Executive Producer Brad, and Producer Sharkey, and their listeners on a journey through romance, secrets, pop culture, and pranks.======This is just a tiny piece of The Jubal Show. You can find every podcast we have, including the full show every weekday right here…➡︎ https://thejubalshow.com/podcasts======The Jubal Show is everywhere, and also these places: Website ➡︎ https://thejubalshow.com Instagram ➡︎ https://instagram.com/thejubalshow X/Twitter ➡︎ https://twitter.com/thejubalshow Tiktok ➡︎ https://www.tiktok.com/@the.jubal.show YouTube ➡︎ https://www.youtube.com/@JubalFresh ======Meet The Jubal Show Cast:====== Jubal Fresh - https://jubalshow.com/featured/jubal-fresh/ Nina - https://thejubalshow.com/featured/ninaontheair/ Victoria - https://jubalshow.com/featured/victoria-ramirez/ Brad Nolan - https://jubalshow.com/featured/brad-nolan/ Sharkey - https://jubalshow.com/featured/richard-sharkey/ Support the show: https://the-jubal-show.beehiiv.com/subscribeSee omnystudio.com/listener for privacy information.

In his 13 years of software engineering, Ilya Reznik has specialized in commercializing machine learning solutions and building robust ML platforms. He's held technical lead and staff engineering roles at premier firms like Adobe, Twitter, and Meta. Currently, Ilya channels his expertise into his travel startup, Jaunt, while consulting and advising emerging startups. Navigating Machine Learning Careers: Insights from Meta to Consulting // MLOps Podcast #286 with Ilya Reznik, ML Engineering Thought Leader at Instructed Machines, LLC. // Abstract Ilya Reznik's insights into machine learning and career development within the field. With over 13 years of experience at leading tech companies such as Meta, Adobe, and Twitter, Ilya emphasizes the limitations of traditional model fine-tuning methods. He advocates for alternatives like prompt engineering and knowledge retrieval, highlighting their potential to enhance AI performance without the drawbacks associated with fine-tuning. Ilya's recent discussions at the NeurIPS conference reflect a shift towards practical applications of Transformer models and innovative strategies like curriculum learning. Additionally, he shares valuable perspectives on navigating career progression in tech, offering guidance for aspiring ML engineers aiming for senior roles. His narrative serves as a blend of technical expertise and practical career advice, making it a significant resource for professionals in the AI domain. // Bio Ilya has navigated a diverse career path since 2011, transitioning from physicist to software engineer, data scientist, ML engineer, and now content creator. He is passionate about helping ML engineers advance their careers and making AI more impactful and beneficial for society. Previously, Ilya was a technical lead at Meta, where he contributed to 12% of the company's revenue and managed approximately 30 production ML models. He also worked at Twitter, overseeing offline model evaluation, and at Adobe, where his team was responsible for all intelligent services within Adobe Analytics. Based in Salt Lake City, Ilya enjoys the outdoors, tinkering with Arduino electronics, and, most importantly, spending time with his family. // MLOps Swag/Merch https://shop.mlops.community/ // Related Links Website: mlepath.com --------------- ✌️Connect With Us ✌️ ------------- Join our slack community: https://go.mlops.community/slack Follow us on Twitter: @mlopscommunity Sign up for the next meetup: https://go.mlops.community/register Catch all episodes, blogs, newsletters, and more: https://mlops.community/ Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/ Connect with Ilya on LinkedIn: https://www.linkedin.com/in/ibreznik/

El Canal de Panamá, una infraestructura crucial para el comercio mundial, ha estado en el centro de la agenda internacional en las últimas semanas. El presidente Donald Trump viene advirtiendo que va a retomar el control de esta vía marítima, inaugurada por Estados Unidos en 1914 y devuelta completamente a Panamá en 1999 a raiz de los acuerdos firmados entre los presidentes Jimmy Carter y Omar Torrijos. Trump reclama por trato que reciben los buques de su país que pasan por el canal pero además denuncia denuncia que el canal está, de hecho, controlada por China. Así lo dijo en su discurso de asunción el lunes de la semana pasada. "Se ha roto la promesa que Panamá nos hizo. El propósito de nuestro acuerdo y el espíritu de nuestro tratado han sido totalmente violados. A los buques estadounidenses se les está cobrando en exceso gravemente y no están siendo tratados justamente de ninguna manera, forma o modo. Incluso la Armada de Estados Unidos. Y, sobre todo, China está operando el Canal de Panamá. Y nosotros no se lo dimos a China. Se lo dimos a Panamá y vamos a recuperarlo". El gobierno panameño ha condenado públicamente las intenciones de Trump. Incluso planteó su preocupación al secretario general de la ONU, Antonio Guterres. Mientras esperamos cómo evoluciona esta controversia, conocemos más de cerca qué es y cómo funciona el Canal de Panamá. Conversamos En Perspectiva con la ingeniera Ilya Espino de Marotta, Subadministradora de la Autoridad del Canal de Panamá.

Save the Soup with Ilya and Jessica - Episode 192 - At the Table With Darlene by Women Around the World

On today's podcast, David, Jason, Natalie and Ilya talk about their recent trip to Australia, Ilya being a “cliche” and how David recently fell in love with a stripper. Plus, Natalie gets her man stolen by another girl, David stays up until 9 am and Natalie's mom gets rushed to the hospital. Also, David tries to become a Slovakian influencer, Jason recounts the Tiktok ban and everybody tries to explain why Natalie doesn't get laid more often. Learn more about your ad choices. Visit megaphone.fm/adchoices

On today's episode, David and Jason return for their first podcast episode in two years. Listen in, as David talks about returning to vlogging, traveling to the Seven Wonders of the World and his incredible body transformation. Plus, Mr. Beast gets Ilya a Lamborghini, Natalie and David hit their 10 year high school reunion, Jason is glad the podcast is back and Corinna makes an offer to Ilya and David where they could make 200K each. Learn more about your ad choices. Visit megaphone.fm/adchoices

Applications for the 2025 AI Engineer Summit are up, and you can save the date for AIE Singapore in April and AIE World's Fair 2025 in June.Happy new year, and thanks for 100 great episodes! Please let us know what you want to see/hear for the next 100!Full YouTube Episode with Slides/ChartsLike and subscribe and hit that bell to get notifs!Timestamps* 00:00 Welcome to the 100th Episode!* 00:19 Reflecting on the Journey* 00:47 AI Engineering: The Rise and Impact* 03:15 Latent Space Live and AI Conferences* 09:44 The Competitive AI Landscape* 21:45 Synthetic Data and Future Trends* 35:53 Creative Writing with AI* 36:12 Legal and Ethical Issues in AI* 38:18 The Data War: GPU Poor vs. GPU Rich* 39:12 The Rise of GPU Ultra Rich* 40:47 Emerging Trends in AI Models* 45:31 The Multi-Modality War* 01:05:31 The Future of AI Benchmarks* 01:13:17 Pionote and Frontier Models* 01:13:47 Niche Models and Base Models* 01:14:30 State Space Models and RWKB* 01:15:48 Inference Race and Price Wars* 01:22:16 Major AI Themes of the Year* 01:22:48 AI Rewind: January to March* 01:26:42 AI Rewind: April to June* 01:33:12 AI Rewind: July to September* 01:34:59 AI Rewind: October to December* 01:39:53 Year-End Reflections and PredictionsTranscript[00:00:00] Welcome to the 100th Episode![00:00:00] Alessio: Hey everyone, welcome to the Latent Space Podcast. This is Alessio, partner and CTO at Decibel Partners, and I'm joined by my co host Swyx for the 100th time today.[00:00:12] swyx: Yay, um, and we're so glad that, yeah, you know, everyone has, uh, followed us in this journey. How do you feel about it? 100 episodes.[00:00:19] Alessio: Yeah, I know.[00:00:19] Reflecting on the Journey[00:00:19] Alessio: Almost two years that we've been doing this. We've had four different studios. Uh, we've had a lot of changes. You know, we used to do this lightning round. When we first started that we didn't like, and we tried to change the question. The answer[00:00:32] swyx: was cursor and perplexity.[00:00:34] Alessio: Yeah, I love mid journey. It's like, do you really not like anything else?[00:00:38] Alessio: Like what's, what's the unique thing? And I think, yeah, we, we've also had a lot more research driven content. You know, we had like 3DAO, we had, you know. Jeremy Howard, we had more folks like that.[00:00:47] AI Engineering: The Rise and Impact[00:00:47] Alessio: I think we want to do more of that too in the new year, like having, uh, some of the Gemini folks, both on the research and the applied side.[00:00:54] Alessio: Yeah, but it's been a ton of fun. I think we both started, I wouldn't say as a joke, we were kind of like, Oh, we [00:01:00] should do a podcast. And I think we kind of caught the right wave, obviously. And I think your rise of the AI engineer posts just kind of get people. Sombra to congregate, and then the AI engineer summit.[00:01:11] Alessio: And that's why when I look at our growth chart, it's kind of like a proxy for like the AI engineering industry as a whole, which is almost like, like, even if we don't do that much, we keep growing just because there's so many more AI engineers. So did you expect that growth or did you expect that would take longer for like the AI engineer thing to kind of like become, you know, everybody talks about it today.[00:01:32] swyx: So, the sign of that, that we have won is that Gartner puts it at the top of the hype curve right now. So Gartner has called the peak in AI engineering. I did not expect, um, to what level. I knew that I was correct when I called it because I did like two months of work going into that. But I didn't know, You know, how quickly it could happen, and obviously there's a chance that I could be wrong.[00:01:52] swyx: But I think, like, most people have come around to that concept. Hacker News hates it, which is a good sign. But there's enough people that have defined it, you know, GitHub, when [00:02:00] they launched GitHub Models, which is the Hugging Face clone, they put AI engineers in the banner, like, above the fold, like, in big So I think it's like kind of arrived as a meaningful and useful definition.[00:02:12] swyx: I think people are trying to figure out where the boundaries are. I think that was a lot of the quote unquote drama that happens behind the scenes at the World's Fair in June. Because I think there's a lot of doubt or questions about where ML engineering stops and AI engineering starts. That's a useful debate to be had.[00:02:29] swyx: In some sense, I actually anticipated that as well. So I intentionally did not. Put a firm definition there because most of the successful definitions are necessarily underspecified and it's actually useful to have different perspectives and you don't have to specify everything from the outset.[00:02:45] Alessio: Yeah, I was at um, AWS reInvent and the line to get into like the AI engineering talk, so to speak, which is, you know, applied AI and whatnot was like, there are like hundreds of people just in line to go in.[00:02:56] Alessio: I think that's kind of what enabled me. People, right? Which is what [00:03:00] you kind of talked about. It's like, Hey, look, you don't actually need a PhD, just, yeah, just use the model. And then maybe we'll talk about some of the blind spots that you get as an engineer with the earlier posts that we also had on on the sub stack.[00:03:11] Alessio: But yeah, it's been a heck of a heck of a two years.[00:03:14] swyx: Yeah.[00:03:15] Latent Space Live and AI Conferences[00:03:15] swyx: You know, I was, I was trying to view the conference as like, so NeurIPS is I think like 16, 17, 000 people. And the Latent Space Live event that we held there was 950 signups. I think. The AI world, the ML world is still very much research heavy. And that's as it should be because ML is very much in a research phase.[00:03:34] swyx: But as we move this entire field into production, I think that ratio inverts into becoming more engineering heavy. So at least I think engineering should be on the same level, even if it's never as prestigious, like it'll always be low status because at the end of the day, you're manipulating APIs or whatever.[00:03:51] swyx: But Yeah, wrapping GPTs, but there's going to be an increasing stack and an art to doing these, these things well. And I, you know, I [00:04:00] think that's what we're focusing on for the podcast, the conference and basically everything I do seems to make sense. And I think we'll, we'll talk about the trends here that apply.[00:04:09] swyx: It's, it's just very strange. So, like, there's a mix of, like, keeping on top of research while not being a researcher and then putting that research into production. So, like, people always ask me, like, why are you covering Neuralibs? Like, this is a ML research conference and I'm like, well, yeah, I mean, we're not going to, to like, understand everything Or reproduce every single paper, but the stuff that is being found here is going to make it through into production at some point, you hope.[00:04:32] swyx: And then actually like when I talk to the researchers, they actually get very excited because they're like, oh, you guys are actually caring about how this goes into production and that's what they really really want. The measure of success is previously just peer review, right? Getting 7s and 8s on their um, Academic review conferences and stuff like citations is one metric, but money is a better metric.[00:04:51] Alessio: Money is a better metric. Yeah, and there were about 2200 people on the live stream or something like that. Yeah, yeah. Hundred on the live stream. So [00:05:00] I try my best to moderate, but it was a lot spicier in person with Jonathan and, and Dylan. Yeah, that it was in the chat on YouTube.[00:05:06] swyx: I would say that I actually also created.[00:05:09] swyx: Layen Space Live in order to address flaws that are perceived in academic conferences. This is not NeurIPS specific, it's ICML, NeurIPS. Basically, it's very sort of oriented towards the PhD student, uh, market, job market, right? Like literally all, basically everyone's there to advertise their research and skills and get jobs.[00:05:28] swyx: And then obviously all the, the companies go there to hire them. And I think that's great for the individual researchers, but for people going there to get info is not great because you have to read between the lines, bring a ton of context in order to understand every single paper. So what is missing is effectively what I ended up doing, which is domain by domain, go through and recap the best of the year.[00:05:48] swyx: Survey the field. And there are, like NeurIPS had a, uh, I think ICML had a like a position paper track, NeurIPS added a benchmarks, uh, datasets track. These are ways in which to address that [00:06:00] issue. Uh, there's always workshops as well. Every, every conference has, you know, a last day of workshops and stuff that provide more of an overview.[00:06:06] swyx: But they're not specifically prompted to do so. And I think really, uh, Organizing a conference is just about getting good speakers and giving them the correct prompts. And then they will just go and do that thing and they do a very good job of it. So I think Sarah did a fantastic job with the startups prompt.[00:06:21] swyx: I can't list everybody, but we did best of 2024 in startups, vision, open models. Post transformers, synthetic data, small models, and agents. And then the last one was the, uh, and then we also did a quick one on reasoning with Nathan Lambert. And then the last one, obviously, was the debate that people were very hyped about.[00:06:39] swyx: It was very awkward. And I'm really, really thankful for John Franco, basically, who stepped up to challenge Dylan. Because Dylan was like, yeah, I'll do it. But He was pro scaling. And I think everyone who is like in AI is pro scaling, right? So you need somebody who's ready to publicly say, no, we've hit a wall.[00:06:57] swyx: So that means you're saying Sam Altman's wrong. [00:07:00] You're saying, um, you know, everyone else is wrong. It helps that this was the day before Ilya went on, went up on stage and then said pre training has hit a wall. And data has hit a wall. So actually Jonathan ended up winning, and then Ilya supported that statement, and then Noam Brown on the last day further supported that statement as well.[00:07:17] swyx: So it's kind of interesting that I think the consensus kind of going in was that we're not done scaling, like you should believe in a better lesson. And then, four straight days in a row, you had Sepp Hochreiter, who is the creator of the LSTM, along with everyone's favorite OG in AI, which is Juergen Schmidhuber.[00:07:34] swyx: He said that, um, we're pre trading inside a wall, or like, we've run into a different kind of wall. And then we have, you know John Frankel, Ilya, and then Noam Brown are all saying variations of the same thing, that we have hit some kind of wall in the status quo of what pre trained, scaling large pre trained models has looked like, and we need a new thing.[00:07:54] swyx: And obviously the new thing for people is some make, either people are calling it inference time compute or test time [00:08:00] compute. I think the collective terminology has been inference time, and I think that makes sense because test time, calling it test, meaning, has a very pre trained bias, meaning that the only reason for running inference at all is to test your model.[00:08:11] swyx: That is not true. Right. Yeah. So, so, I quite agree that. OpenAI seems to have adopted, or the community seems to have adopted this terminology of ITC instead of TTC. And that, that makes a lot of sense because like now we care about inference, even right down to compute optimality. Like I actually interviewed this author who recovered or reviewed the Chinchilla paper.[00:08:31] swyx: Chinchilla paper is compute optimal training, but what is not stated in there is it's pre trained compute optimal training. And once you start caring about inference, compute optimal training, you have a different scaling law. And in a way that we did not know last year.[00:08:45] Alessio: I wonder, because John is, he's also on the side of attention is all you need.[00:08:49] Alessio: Like he had the bet with Sasha. So I'm curious, like he doesn't believe in scaling, but he thinks the transformer, I wonder if he's still. So, so,[00:08:56] swyx: so he, obviously everything is nuanced and you know, I told him to play a character [00:09:00] for this debate, right? So he actually does. Yeah. He still, he still believes that we can scale more.[00:09:04] swyx: Uh, he just assumed the character to be very game for, for playing this debate. So even more kudos to him that he assumed a position that he didn't believe in and still won the debate.[00:09:16] Alessio: Get rekt, Dylan. Um, do you just want to quickly run through some of these things? Like, uh, Sarah's presentation, just the highlights.[00:09:24] swyx: Yeah, we can't go through everyone's slides, but I pulled out some things as a factor of, like, stuff that we were going to talk about. And we'll[00:09:30] Alessio: publish[00:09:31] swyx: the rest. Yeah, we'll publish on this feed the best of 2024 in those domains. And hopefully people can benefit from the work that our speakers have done.[00:09:39] swyx: But I think it's, uh, these are just good slides. And I've been, I've been looking for a sort of end of year recaps from, from people.[00:09:44] The Competitive AI Landscape[00:09:44] swyx: The field has progressed a lot. You know, I think the max ELO in 2023 on LMSys used to be 1200 for LMSys ELOs. And now everyone is at least at, uh, 1275 in their ELOs, and this is across Gemini, Chadjibuti, [00:10:00] Grok, O1.[00:10:01] swyx: ai, which with their E Large model, and Enthopic, of course. It's a very, very competitive race. There are multiple Frontier labs all racing, but there is a clear tier zero Frontier. And then there's like a tier one. It's like, I wish I had everything else. Tier zero is extremely competitive. It's effectively now three horse race between Gemini, uh, Anthropic and OpenAI.[00:10:21] swyx: I would say that people are still holding out a candle for XAI. XAI, I think, for some reason, because their API was very slow to roll out, is not included in these metrics. So it's actually quite hard to put on there. As someone who also does charts, XAI is continually snubbed because they don't work well with the benchmarking people.[00:10:42] swyx: Yeah, yeah, yeah. It's a little trivia for why XAI always gets ignored. The other thing is market share. So these are slides from Sarah. We have it up on the screen. It has gone from very heavily open AI. So we have some numbers and estimates. These are from RAMP. Estimates of open AI market share in [00:11:00] December 2023.[00:11:01] swyx: And this is basically, what is it, GPT being 95 percent of production traffic. And I think if you correlate that with stuff that we asked. Harrison Chase on the LangChain episode, it was true. And then CLAUD 3 launched mid middle of this year. I think CLAUD 3 launched in March, CLAUD 3. 5 Sonnet was in June ish.[00:11:23] swyx: And you can start seeing the market share shift towards opening, uh, towards that topic, uh, very, very aggressively. The more recent one is Gemini. So if I scroll down a little bit, this is an even more recent dataset. So RAM's dataset ends in September 2 2. 2024. Gemini has basically launched a price war at the low end, uh, with Gemini Flash, uh, being basically free for personal use.[00:11:44] swyx: Like, I think people don't understand the free tier. It's something like a billion tokens per day. Unless you're trying to abuse it, you cannot really exhaust your free tier on Gemini. They're really trying to get you to use it. They know they're in like third place, um, fourth place, depending how you, how you count.[00:11:58] swyx: And so they're going after [00:12:00] the Lower tier first, and then, you know, maybe the upper tier later, but yeah, Gemini Flash, according to OpenRouter, is now 50 percent of their OpenRouter requests. Obviously, these are the small requests. These are small, cheap requests that are mathematically going to be more.[00:12:15] swyx: The smart ones obviously are still going to OpenAI. But, you know, it's a very, very big shift in the market. Like basically 2023, 2022, To going into 2024 opening has gone from nine five market share to Yeah. Reasonably somewhere between 50 to 75 market share.[00:12:29] Alessio: Yeah. I'm really curious how ramped does the attribution to the model?[00:12:32] Alessio: If it's API, because I think it's all credit card spin. . Well, but it's all, the credit card doesn't say maybe. Maybe the, maybe when they do expenses, they upload the PDF, but yeah, the, the German I think makes sense. I think that was one of my main 2024 takeaways that like. The best small model companies are the large labs, which is not something I would have thought that the open source kind of like long tail would be like the small model.[00:12:53] swyx: Yeah, different sizes of small models we're talking about here, right? Like so small model here for Gemini is AB, [00:13:00] right? Uh, mini. We don't know what the small model size is, but yeah, it's probably in the double digits or maybe single digits, but probably double digits. The open source community has kind of focused on the one to three B size.[00:13:11] swyx: Mm-hmm . Yeah. Maybe[00:13:12] swyx: zero, maybe 0.5 B uh, that's moon dream and that is small for you then, then that's great. It makes sense that we, we have a range for small now, which is like, may, maybe one to five B. Yeah. I'll even put that at, at, at the high end. And so this includes Gemma from Gemini as well. But also includes the Apple Foundation models, which I think Apple Foundation is 3B.[00:13:32] Alessio: Yeah. No, that's great. I mean, I think in the start small just meant cheap. I think today small is actually a more nuanced discussion, you know, that people weren't really having before.[00:13:43] swyx: Yeah, we can keep going. This is a slide that I smiley disagree with Sarah. She's pointing to the scale SEAL leaderboard. I think the Researchers that I talked with at NeurIPS were kind of positive on this because basically you need private test [00:14:00] sets to prevent contamination.[00:14:02] swyx: And Scale is one of maybe three or four people this year that has really made an effort in doing a credible private test set leaderboard. Llama405B does well compared to Gemini and GPT 40. And I think that's good. I would say that. You know, it's good to have an open model that is that big, that does well on those metrics.[00:14:23] swyx: But anyone putting 405B in production will tell you, if you scroll down a little bit to the artificial analysis numbers, that it is very slow and very expensive to infer. Um, it doesn't even fit on like one node. of, uh, of H100s. Cerebras will be happy to tell you they can serve 4 or 5B on their super large chips.[00:14:42] swyx: But, um, you know, if you need to do anything custom to it, you're still kind of constrained. So, is 4 or 5B really that relevant? Like, I think most people are basically saying that they only use 4 or 5B as a teacher model to distill down to something. Even Meta is doing it. So with Lama 3. [00:15:00] 3 launched, they only launched the 70B because they use 4 or 5B to distill the 70B.[00:15:03] swyx: So I don't know if like open source is keeping up. I think they're the, the open source industrial complex is very invested in telling you that the, if the gap is narrowing, I kind of disagree. I think that the gap is widening with O1. I think there are very, very smart people trying to narrow that gap and they should.[00:15:22] swyx: I really wish them success, but you cannot use a chart that is nearing 100 in your saturation chart. And look, the distance between open source and closed source is narrowing. Of course it's going to narrow because you're near 100. This is stupid. But in metrics that matter, is open source narrowing?[00:15:38] swyx: Probably not for O1 for a while. And it's really up to the open source guys to figure out if they can match O1 or not.[00:15:46] Alessio: I think inference time compute is bad for open source just because, you know, Doc can donate the flops at training time, but he cannot donate the flops at inference time. So it's really hard to like actually keep up on that axis.[00:15:59] Alessio: Big, big business [00:16:00] model shift. So I don't know what that means for the GPU clouds. I don't know what that means for the hyperscalers, but obviously the big labs have a lot of advantage. Because, like, it's not a static artifact that you're putting the compute in. You're kind of doing that still, but then you're putting a lot of computed inference too.[00:16:17] swyx: Yeah, yeah, yeah. Um, I mean, Llama4 will be reasoning oriented. We talked with Thomas Shalom. Um, kudos for getting that episode together. That was really nice. Good, well timed. Actually, I connected with the AI meta guy, uh, at NeurIPS, and, um, yeah, we're going to coordinate something for Llama4. Yeah, yeah,[00:16:32] Alessio: and our friend, yeah.[00:16:33] Alessio: Clara Shi just joined to lead the business agent side. So I'm sure we'll have her on in the new year.[00:16:39] swyx: Yeah. So, um, my comment on, on the business model shift, this is super interesting. Apparently it is wide knowledge that OpenAI wanted more than 6. 6 billion dollars for their fundraise. They wanted to raise, you know, higher, and they did not.[00:16:51] swyx: And what that means is basically like, it's very convenient that we're not getting GPT 5, which would have been a larger pre train. We should have a lot of upfront money. And [00:17:00] instead we're, we're converting fixed costs into variable costs, right. And passing it on effectively to the customer. And it's so much easier to take margin there because you can directly attribute it to like, Oh, you're using this more.[00:17:12] swyx: Therefore you, you pay more of the cost and I'll just slap a margin in there. So like that lets you control your growth margin and like tie your. Your spend, or your sort of inference spend, accordingly. And it's just really interesting to, that this change in the sort of inference paradigm has arrived exactly at the same time that the funding environment for pre training is effectively drying up, kind of.[00:17:36] swyx: I feel like maybe the VCs are very in tune with research anyway, so like, they would have noticed this, but, um, it's just interesting.[00:17:43] Alessio: Yeah, and I was looking back at our yearly recap of last year. Yeah. And the big thing was like the mixed trial price fights, you know, and I think now it's almost like there's nowhere to go, like, you know, Gemini Flash is like basically giving it away for free.[00:17:55] Alessio: So I think this is a good way for the labs to generate more revenue and pass down [00:18:00] some of the compute to the customer. I think they're going to[00:18:02] swyx: keep going. I think that 2, will come.[00:18:05] Alessio: Yeah, I know. Totally. I mean, next year, the first thing I'm doing is signing up for Devin. Signing up for the pro chat GBT.[00:18:12] Alessio: Just to try. I just want to see what does it look like to spend a thousand dollars a month on AI?[00:18:17] swyx: Yes. Yes. I think if your, if your, your job is a, at least AI content creator or VC or, you know, someone who, whose job it is to stay on, stay on top of things, you should already be spending like a thousand dollars a month on, on stuff.[00:18:28] swyx: And then obviously easy to spend, hard to use. You have to actually use. The good thing is that actually Google lets you do a lot of stuff for free now. So like deep research. That they just launched. Uses a ton of inference and it's, it's free while it's in preview.[00:18:45] Alessio: Yeah. They need to put that in Lindy.[00:18:47] Alessio: I've been using Lindy lately. I've been a built a bunch of things once we had flow because I liked the new thing. It's pretty good. I even did a phone call assistant. Um, yeah, they just launched Lindy voice. Yeah, I think once [00:19:00] they get advanced voice mode like capability today, still like speech to text, you can kind of tell.[00:19:06] Alessio: Um, but it's good for like reservations and things like that. So I have a meeting prepper thing. And so[00:19:13] swyx: it's good. Okay. I feel like we've, we've covered a lot of stuff. Uh, I, yeah, I, you know, I think We will go over the individual, uh, talks in a separate episode. Uh, I don't want to take too much time with, uh, this stuff, but that suffice to say that there is a lot of progress in each field.[00:19:28] swyx: Uh, we covered vision. Basically this is all like the audience voting for what they wanted. And then I just invited the best people I could find in each audience, especially agents. Um, Graham, who I talked to at ICML in Vienna, he is currently still number one. It's very hard to stay on top of SweetBench.[00:19:45] swyx: OpenHand is currently still number one. switchbench full, which is the hardest one. He had very good thoughts on agents, which I, which I'll highlight for people. Everyone is saying 2025 is the year of agents, just like they said last year. And, uh, but he had [00:20:00] thoughts on like eight parts of what are the frontier problems to solve in agents.[00:20:03] swyx: And so I'll highlight that talk as well.[00:20:05] Alessio: Yeah. The number six, which is the Hacken agents learn more about the environment, has been a Super interesting to us as well, just to think through, because, yeah, how do you put an agent in an enterprise where most things in an enterprise have never been public, you know, a lot of the tooling, like the code bases and things like that.[00:20:23] Alessio: So, yeah, there's not indexing and reg. Well, yeah, but it's more like. You can't really rag things that are not documented. But people know them based on how they've been doing it. You know, so I think there's almost this like, you know, Oh, institutional knowledge. Yeah, the boring word is kind of like a business process extraction.[00:20:38] Alessio: Yeah yeah, I see. It's like, how do you actually understand how these things are done? I see. Um, and I think today the, the problem is that, Yeah, the agents are, that most people are building are good at following instruction, but are not as good as like extracting them from you. Um, so I think that will be a big unlock just to touch quickly on the Jeff Dean thing.[00:20:55] Alessio: I thought it was pretty, I mean, we'll link it in the, in the things, but. I think the main [00:21:00] focus was like, how do you use ML to optimize the systems instead of just focusing on ML to do something else? Yeah, I think speculative decoding, we had, you know, Eugene from RWKB on the podcast before, like he's doing a lot of that with Fetterless AI.[00:21:12] swyx: Everyone is. I would say it's the norm. I'm a little bit uncomfortable with how much it costs, because it does use more of the GPU per call. But because everyone is so keen on fast inference, then yeah, makes sense.[00:21:24] Alessio: Exactly. Um, yeah, but we'll link that. Obviously Jeff is great.[00:21:30] swyx: Jeff is, Jeff's talk was more, it wasn't focused on Gemini.[00:21:33] swyx: I think people got the wrong impression from my tweet. It's more about how Google approaches ML and uses ML to design systems and then systems feedback into ML. And I think this ties in with Lubna's talk.[00:21:45] Synthetic Data and Future Trends[00:21:45] swyx: on synthetic data where it's basically the story of bootstrapping of humans and AI in AI research or AI in production.[00:21:53] swyx: So her talk was on synthetic data, where like how much synthetic data has grown in 2024 in the pre training side, the post training side, [00:22:00] and the eval side. And I think Jeff then also extended it basically to chips, uh, to chip design. So he'd spend a lot of time talking about alpha chip. And most of us in the audience are like, we're not working on hardware, man.[00:22:11] swyx: Like you guys are great. TPU is great. Okay. We'll buy TPUs.[00:22:14] Alessio: And then there was the earlier talk. Yeah. But, and then we have, uh, I don't know if we're calling them essays. What are we calling these? But[00:22:23] swyx: for me, it's just like bonus for late in space supporters, because I feel like they haven't been getting anything.[00:22:29] swyx: And then I wanted a more high frequency way to write stuff. Like that one I wrote in an afternoon. I think basically we now have an answer to what Ilya saw. It's one year since. The blip. And we know what he saw in 2014. We know what he saw in 2024. We think we know what he sees in 2024. He gave some hints and then we have vague indications of what he saw in 2023.[00:22:54] swyx: So that was the Oh, and then 2016 as well, because of this lawsuit with Elon, OpenAI [00:23:00] is publishing emails from Sam's, like, his personal text messages to Siobhan, Zelis, or whatever. So, like, we have emails from Ilya saying, this is what we're seeing in OpenAI, and this is why we need to scale up GPUs. And I think it's very prescient in 2016 to write that.[00:23:16] swyx: And so, like, it is exactly, like, basically his insights. It's him and Greg, basically just kind of driving the scaling up of OpenAI, while they're still playing Dota. They're like, no, like, we see the path here.[00:23:30] Alessio: Yeah, and it's funny, yeah, they even mention, you know, we can only train on 1v1 Dota. We need to train on 5v5, and that takes too many GPUs.[00:23:37] Alessio: Yeah,[00:23:37] swyx: and at least for me, I can speak for myself, like, I didn't see the path from Dota to where we are today. I think even, maybe if you ask them, like, they wouldn't necessarily draw a straight line. Yeah,[00:23:47] Alessio: no, definitely. But I think like that was like the whole idea of almost like the RL and we talked about this with Nathan on his podcast.[00:23:55] Alessio: It's like with RL, you can get very good at specific things, but then you can't really like generalize as much. And I [00:24:00] think the language models are like the opposite, which is like, you're going to throw all this data at them and scale them up, but then you really need to drive them home on a specific task later on.[00:24:08] Alessio: And we'll talk about the open AI reinforcement, fine tuning, um, announcement too, and all of that. But yeah, I think like scale is all you need. That's kind of what Elia will be remembered for. And I think just maybe to clarify on like the pre training is over thing that people love to tweet. I think the point of the talk was like everybody, we're scaling these chips, we're scaling the compute, but like the second ingredient which is data is not scaling at the same rate.[00:24:35] Alessio: So it's not necessarily pre training is over. It's kind of like What got us here won't get us there. In his email, he predicted like 10x growth every two years or something like that. And I think maybe now it's like, you know, you can 10x the chips again, but[00:24:49] swyx: I think it's 10x per year. Was it? I don't know.[00:24:52] Alessio: Exactly. And Moore's law is like 2x. So it's like, you know, much faster than that. And yeah, I like the fossil fuel of AI [00:25:00] analogy. It's kind of like, you know, the little background tokens thing. So the OpenAI reinforcement fine tuning is basically like, instead of fine tuning on data, you fine tune on a reward model.[00:25:09] Alessio: So it's basically like, instead of being data driven, it's like task driven. And I think people have tasks to do, they don't really have a lot of data. So I'm curious to see how that changes, how many people fine tune, because I think this is what people run into. It's like, Oh, you can fine tune llama. And it's like, okay, where do I get the data?[00:25:27] Alessio: To fine tune it on, you know, so it's great that we're moving the thing. And then I really like he had this chart where like, you know, the brain mass and the body mass thing is basically like mammals that scaled linearly by brain and body size, and then humans kind of like broke off the slope. So it's almost like maybe the mammal slope is like the pre training slope.[00:25:46] Alessio: And then the post training slope is like the, the human one.[00:25:49] swyx: Yeah. I wonder what the. I mean, we'll know in 10 years, but I wonder what the y axis is for, for Ilya's SSI. We'll try to get them on.[00:25:57] Alessio: Ilya, if you're listening, you're [00:26:00] welcome here. Yeah, and then he had, you know, what comes next, like agent, synthetic data, inference, compute, I thought all of that was like that.[00:26:05] Alessio: I don't[00:26:05] swyx: think he was dropping any alpha there. Yeah, yeah, yeah.[00:26:07] Alessio: Yeah. Any other new reps? Highlights?[00:26:10] swyx: I think that there was comparatively a lot more work. Oh, by the way, I need to plug that, uh, my friend Yi made this, like, little nice paper. Yeah, that was really[00:26:20] swyx: nice.[00:26:20] swyx: Uh, of, uh, of, like, all the, he's, she called it must read papers of 2024.[00:26:26] swyx: So I laid out some of these at NeurIPS, and it was just gone. Like, everyone just picked it up. Because people are dying for, like, little guidance and visualizations And so, uh, I thought it was really super nice that we got there.[00:26:38] Alessio: Should we do a late in space book for each year? Uh, I thought about it. For each year we should.[00:26:42] Alessio: Coffee table book. Yeah. Yeah. Okay. Put it in the will. Hi, Will. By the way, we haven't introduced you. He's our new, you know, general organist, Jamie. You need to[00:26:52] swyx: pull up more things. One thing I saw that, uh, Okay, one fun one, and then one [00:27:00] more general one. So the fun one is this paper on agent collusion. This is a paper on steganography.[00:27:06] swyx: This is secret collusion among AI agents, multi agent deception via steganography. I tried to go to NeurIPS in order to find these kinds of papers because the real reason Like NeurIPS this year has a lottery system. A lot of people actually even go and don't buy tickets because they just go and attend the side events.[00:27:22] swyx: And then also the people who go and end up crowding around the most popular papers, which you already know and already read them before you showed up to NeurIPS. So the only reason you go there is to talk to the paper authors, but there's like something like 10, 000 other. All these papers out there that, you know, are just people's work that they, that they did on the air and they failed to get attention for one reason or another.[00:27:42] swyx: And this was one of them. Uh, it was like all the way at the back. And this is a deep mind paper that actually focuses on collusion between AI agents, uh, by hiding messages in the text that they generate. Uh, so that's what steganography is. So a very simple example would be the first letter of every word.[00:27:57] swyx: If you Pick that out, you know, and the code sends a [00:28:00] different message than that. But something I've always emphasized is to LLMs, we read left to right. LLMs can read up, down, sideways, you know, in random character order. And it's the same to them as it is to us. So if we were ever to get You know, self motivated, underlined LLMs that we're trying to collaborate to take over the planet.[00:28:19] swyx: This would be how they do it. They spread messages among us in the messages that we generate. And he developed a scaling law for that. So he marked, I'm showing it on screen right now, the emergence of this phenomenon. Basically, for example, for Cypher encoding, GPT 2, Lama 2, mixed trial, GPT 3. 5, zero capabilities, and sudden 4.[00:28:40] swyx: And this is the kind of Jason Wei type emergence properties that people kind of look for. I think what made this paper stand out as well, so he developed the benchmark for steganography collusion, and he also focused on shelling point collusion, which is very low coordination. For agreeing on a decoding encoding format, you kind of need to have some [00:29:00] agreement on that.[00:29:00] swyx: But, but shelling point means like very, very low or almost no coordination. So for example, if I, if I ask someone, if the only message I give you is meet me in New York and you're not aware. Or when you would probably meet me at Grand Central Station. That is the Grand Central Station is a shelling point.[00:29:16] swyx: And it's probably somewhere, somewhere during the day. That is the shelling point of New York is Grand Central. To that extent, shelling points for steganography are things like the, the, the common decoding methods that we talked about. It will be interesting at some point in the future when we are worried about alignment.[00:29:30] swyx: It is not interesting today, but it's interesting that DeepMind is already thinking about this.[00:29:36] Alessio: I think that's like one of the hardest things about NeurIPS. It's like the long tail. I[00:29:41] swyx: found a pricing guy. I'm going to feature him on the podcast. Basically, this guy from NVIDIA worked out the optimal pricing for language models.[00:29:51] swyx: It's basically an econometrics paper at NeurIPS, where everyone else is talking about GPUs. And the guy with the GPUs is[00:29:57] Alessio: talking[00:29:57] swyx: about economics instead. [00:30:00] That was the sort of fun one. So the focus I saw is that model papers at NeurIPS are kind of dead. No one really presents models anymore. It's just data sets.[00:30:12] swyx: This is all the grad students are working on. So like there was a data sets track and then I was looking around like, I was like, you don't need a data sets track because every paper is a data sets paper. And so data sets and benchmarks, they're kind of flip sides of the same thing. So Yeah. Cool. Yeah, if you're a grad student, you're a GPU boy, you kind of work on that.[00:30:30] swyx: And then the, the sort of big model that people walk around and pick the ones that they like, and then they use it in their models. And that's, that's kind of how it develops. I, I feel like, um, like, like you didn't last year, you had people like Hao Tian who worked on Lava, which is take Lama and add Vision.[00:30:47] swyx: And then obviously actually I hired him and he added Vision to Grok. Now he's the Vision Grok guy. This year, I don't think there was any of those.[00:30:55] Alessio: What were the most popular, like, orals? Last year it was like the [00:31:00] Mixed Monarch, I think, was like the most attended. Yeah, uh, I need to look it up. Yeah, I mean, if nothing comes to mind, that's also kind of like an answer in a way.[00:31:10] Alessio: But I think last year there was a lot of interest in, like, furthering models and, like, different architectures and all of that.[00:31:16] swyx: I will say that I felt the orals, oral picks this year were not very good. Either that or maybe it's just a So that's the highlight of how I have changed in terms of how I view papers.[00:31:29] swyx: So like, in my estimation, two of the best papers in this year for datasets or data comp and refined web or fine web. These are two actually industrially used papers, not highlighted for a while. I think DCLM got the spotlight, FineWeb didn't even get the spotlight. So like, it's just that the picks were different.[00:31:48] swyx: But one thing that does get a lot of play that a lot of people are debating is the role that's scheduled. This is the schedule free optimizer paper from Meta from Aaron DeFazio. And this [00:32:00] year in the ML community, there's been a lot of chat about shampoo, soap, all the bathroom amenities for optimizing your learning rates.[00:32:08] swyx: And, uh, most people at the big labs are. Who I asked about this, um, say that it's cute, but it's not something that matters. I don't know, but it's something that was discussed and very, very popular. 4Wars[00:32:19] Alessio: of AI recap maybe, just quickly. Um, where do you want to start? Data?[00:32:26] swyx: So to remind people, this is the 4Wars piece that we did as one of our earlier recaps of this year.[00:32:31] swyx: And the belligerents are on the left, journalists, writers, artists, anyone who owns IP basically, New York Times, Stack Overflow, Reddit, Getty, Sarah Silverman, George RR Martin. Yeah, and I think this year we can add Scarlett Johansson to that side of the fence. So anyone suing, open the eye, basically. I actually wanted to get a snapshot of all the lawsuits.[00:32:52] swyx: I'm sure some lawyer can do it. That's the data quality war. On the right hand side, we have the synthetic data people, and I think we talked about Lumna's talk, you know, [00:33:00] really showing how much synthetic data has come along this year. I think there was a bit of a fight between scale. ai and the synthetic data community, because scale.[00:33:09] swyx: ai published a paper saying that synthetic data doesn't work. Surprise, surprise, scale. ai is the leading vendor of non synthetic data. Only[00:33:17] Alessio: cage free annotated data is useful.[00:33:21] swyx: So I think there's some debate going on there, but I don't think it's much debate anymore that at least synthetic data, for the reasons that are blessed in Luna's talk, Makes sense.[00:33:32] swyx: I don't know if you have any perspectives there.[00:33:34] Alessio: I think, again, going back to the reinforcement fine tuning, I think that will change a little bit how people think about it. I think today people mostly use synthetic data, yeah, for distillation and kind of like fine tuning a smaller model from like a larger model.[00:33:46] Alessio: I'm not super aware of how the frontier labs use it outside of like the rephrase, the web thing that Apple also did. But yeah, I think it'll be. Useful. I think like whether or not that gets us the big [00:34:00] next step, I think that's maybe like TBD, you know, I think people love talking about data because it's like a GPU poor, you know, I think, uh, synthetic data is like something that people can do, you know, so they feel more opinionated about it compared to, yeah, the optimizers stuff, which is like,[00:34:17] swyx: they don't[00:34:17] Alessio: really work[00:34:18] swyx: on.[00:34:18] swyx: I think that there is an angle to the reasoning synthetic data. So this year, we covered in the paper club, the star series of papers. So that's star, Q star, V star. It basically helps you to synthesize reasoning steps, or at least distill reasoning steps from a verifier. And if you look at the OpenAI RFT, API that they released, or that they announced, basically they're asking you to submit graders, or they choose from a preset list of graders.[00:34:49] swyx: Basically It feels like a way to create valid synthetic data for them to fine tune their reasoning paths on. Um, so I think that is another angle where it starts to make sense. And [00:35:00] so like, it's very funny that basically all the data quality wars between Let's say the music industry or like the newspaper publishing industry or the textbooks industry on the big labs.[00:35:11] swyx: It's all of the pre training era. And then like the new era, like the reasoning era, like nobody has any problem with all the reasoning, especially because it's all like sort of math and science oriented with, with very reasonable graders. I think the more interesting next step is how does it generalize beyond STEM?[00:35:27] swyx: We've been using O1 for And I would say like for summarization and creative writing and instruction following, I think it's underrated. I started using O1 in our intro songs before we killed the intro songs, but it's very good at writing lyrics. You know, I can actually say like, I think one of the O1 pro demos.[00:35:46] swyx: All of these things that Noam was showing was that, you know, you can write an entire paragraph or three paragraphs without using the letter A, right?[00:35:53] Creative Writing with AI[00:35:53] swyx: So like, like literally just anything instead of token, like not even token level, character level manipulation and [00:36:00] counting and instruction following. It's, uh, it's very, very strong.[00:36:02] swyx: And so no surprises when I ask it to rhyme, uh, and to, to create song lyrics, it's going to do that very much better than in previous models. So I think it's underrated for creative writing.[00:36:11] Alessio: Yeah.[00:36:12] Legal and Ethical Issues in AI[00:36:12] Alessio: What do you think is the rationale that they're going to have in court when they don't show you the thinking traces of O1, but then they want us to, like, they're getting sued for using other publishers data, you know, but then on their end, they're like, well, you shouldn't be using my data to then train your model.[00:36:29] Alessio: So I'm curious to see how that kind of comes. Yeah, I mean, OPA has[00:36:32] swyx: many ways to publish, to punish people without bringing, taking them to court. Already banned ByteDance for distilling their, their info. And so anyone caught distilling the chain of thought will be just disallowed to continue on, on, on the API.[00:36:44] swyx: And it's fine. It's no big deal. Like, I don't even think that's an issue at all, just because the chain of thoughts are pretty well hidden. Like you have to work very, very hard to, to get it to leak. And then even when it leaks the chain of thought, you don't know if it's, if it's [00:37:00] The bigger concern is actually that there's not that much IP hiding behind it, that Cosign, which we talked about, we talked to him on Dev Day, can just fine tune 4.[00:37:13] swyx: 0 to beat 0. 1 Cloud SONET so far is beating O1 on coding tasks without, at least O1 preview, without being a reasoning model, same for Gemini Pro or Gemini 2. 0. So like, how much is reasoning important? How much of a moat is there in this, like, All of these are proprietary sort of training data that they've presumably accomplished.[00:37:34] swyx: Because even DeepSeek was able to do it. And they had, you know, two months notice to do this, to do R1. So, it's actually unclear how much moat there is. Obviously, you know, if you talk to the Strawberry team, they'll be like, yeah, I mean, we spent the last two years doing this. So, we don't know. And it's going to be Interesting because there'll be a lot of noise from people who say they have inference time compute and actually don't because they just have fancy chain of thought.[00:38:00][00:38:00] swyx: And then there's other people who actually do have very good chain of thought. And you will not see them on the same level as OpenAI because OpenAI has invested a lot in building up the mythology of their team. Um, which makes sense. Like the real answer is somewhere in between.[00:38:13] Alessio: Yeah, I think that's kind of like the main data war story developing.[00:38:18] The Data War: GPU Poor vs. GPU Rich[00:38:18] Alessio: GPU poor versus GPU rich. Yeah. Where do you think we are? I think there was, again, going back to like the small model thing, there was like a time in which the GPU poor were kind of like the rebel faction working on like these models that were like open and small and cheap. And I think today people don't really care as much about GPUs anymore.[00:38:37] Alessio: You also see it in the price of the GPUs. Like, you know, that market is kind of like plummeted because there's people don't want to be, they want to be GPU free. They don't even want to be poor. They just want to be, you know, completely without them. Yeah. How do you think about this war? You[00:38:52] swyx: can tell me about this, but like, I feel like the, the appetite for GPU rich startups, like the, you know, the, the funding plan is we will raise 60 million and [00:39:00] we'll give 50 of that to NVIDIA.[00:39:01] swyx: That is gone, right? Like, no one's, no one's pitching that. This was literally the plan, the exact plan of like, I can name like four or five startups, you know, this time last year. So yeah, GPU rich startups gone.[00:39:12] The Rise of GPU Ultra Rich[00:39:12] swyx: But I think like, The GPU ultra rich, the GPU ultra high net worth is still going. So, um, now we're, you know, we had Leopold's essay on the trillion dollar cluster.[00:39:23] swyx: We're not quite there yet. We have multiple labs, um, you know, XAI very famously, you know, Jensen Huang praising them for being. Best boy number one in spinning up 100, 000 GPU cluster in like 12 days or something. So likewise at Meta, likewise at OpenAI, likewise at the other labs as well. So like the GPU ultra rich are going to keep doing that because I think partially it's an article of faith now that you just need it.[00:39:46] swyx: Like you don't even know what it's going to, what you're going to use it for. You just, you just need it. And it makes sense that if, especially if we're going into. More researchy territory than we are. So let's say 2020 to 2023 was [00:40:00] let's scale big models territory because we had GPT 3 in 2020 and we were like, okay, we'll go from 1.[00:40:05] swyx: 75b to 1. 8b, 1. 8t. And that was GPT 3 to GPT 4. Okay, that's done. As far as everyone is concerned, Opus 3. 5 is not coming out, GPT 4. 5 is not coming out, and Gemini 2, we don't have Pro, whatever. We've hit that wall. Maybe I'll call it the 2 trillion perimeter wall. We're not going to 10 trillion. No one thinks it's a good idea, at least from training costs, from the amount of data, or at least the inference.[00:40:36] swyx: Would you pay 10x the price of GPT Probably not. Like, like you want something else that, that is at least more useful. So it makes sense that people are pivoting in terms of their inference paradigm.[00:40:47] Emerging Trends in AI Models[00:40:47] swyx: And so when it's more researchy, then you actually need more just general purpose compute to mess around with, uh, at the exact same time that production deployments of the old, the previous paradigm is still ramping up,[00:40:58] swyx: um,[00:40:58] swyx: uh, pretty aggressively.[00:40:59] swyx: So [00:41:00] it makes sense that the GPU rich are growing. We have now interviewed both together and fireworks and replicates. Uh, we haven't done any scale yet. But I think Amazon, maybe kind of a sleeper one, Amazon, in a sense of like they, at reInvent, I wasn't expecting them to do so well, but they are now a foundation model lab.[00:41:18] swyx: It's kind of interesting. Um, I think, uh, you know, David went over there and started just creating models.[00:41:25] Alessio: Yeah, I mean, that's the power of prepaid contracts. I think like a lot of AWS customers, you know, they do this big reserve instance contracts and now they got to use their money. That's why so many startups.[00:41:37] Alessio: Get bought through the AWS marketplace so they can kind of bundle them together and prefer pricing.[00:41:42] swyx: Okay, so maybe GPU super rich doing very well, GPU middle class dead, and then GPU[00:41:48] Alessio: poor. I mean, my thing is like, everybody should just be GPU rich. There shouldn't really be, even the GPU poorest, it's like, does it really make sense to be GPU poor?[00:41:57] Alessio: Like, if you're GPU poor, you should just use the [00:42:00] cloud. Yes, you know, and I think there might be a future once we kind of like figure out what the size and shape of these models is where like the tiny box and these things come to fruition where like you can be GPU poor at home. But I think today is like, why are you working so hard to like get these models to run on like very small clusters where it's like, It's so cheap to run them.[00:42:21] Alessio: Yeah, yeah,[00:42:22] swyx: yeah. I think mostly people think it's cool. People think it's a stepping stone to scaling up. So they aspire to be GPU rich one day and they're working on new methods. Like news research, like probably the most deep tech thing they've done this year is Distro or whatever the new name is.[00:42:38] swyx: There's a lot of interest in heterogeneous computing, distributed computing. I tend generally to de emphasize that historically, but it may be coming to a time where it is starting to be relevant. I don't know. You know, SF compute launched their compute marketplace this year, and like, who's really using that?[00:42:53] swyx: Like, it's a bunch of small clusters, disparate types of compute, and if you can make that [00:43:00] useful, then that will be very beneficial to the broader community, but maybe still not the source of frontier models. It's just going to be a second tier of compute that is unlocked for people, and that's fine. But yeah, I mean, I think this year, I would say a lot more on device, We are, I now have Apple intelligence on my phone.[00:43:19] swyx: Doesn't do anything apart from summarize my notifications. But still, not bad. Like, it's multi modal.[00:43:25] Alessio: Yeah, the notification summaries are so and so in my experience.[00:43:29] swyx: Yeah, but they add, they add juice to life. And then, um, Chrome Nano, uh, Gemini Nano is coming out in Chrome. Uh, they're still feature flagged, but you can, you can try it now if you, if you use the, uh, the alpha.[00:43:40] swyx: And so, like, I, I think, like, you know, We're getting the sort of GPU poor version of a lot of these things coming out, and I think it's like quite useful. Like Windows as well, rolling out RWKB in sort of every Windows department is super cool. And I think the last thing that I never put in this GPU poor war, that I think I should now, [00:44:00] is the number of startups that are GPU poor but still scaling very well, as sort of wrappers on top of either a foundation model lab, or GPU Cloud.[00:44:10] swyx: GPU Cloud, it would be Suno. Suno, Ramp has rated as one of the top ranked, fastest growing startups of the year. Um, I think the last public number is like zero to 20 million this year in ARR and Suno runs on Moto. So Suno itself is not GPU rich, but they're just doing the training on, on Moto, uh, who we've also talked to on, on the podcast.[00:44:31] swyx: The other one would be Bolt, straight cloud wrapper. And, and, um, Again, another, now they've announced 20 million ARR, which is another step up from our 8 million that we put on the title. So yeah, I mean, it's crazy that all these GPU pores are finding a way while the GPU riches are also finding a way. And then the only failures, I kind of call this the GPU smiling curve, where the edges do well, because you're either close to the machines, and you're like [00:45:00] number one on the machines, or you're like close to the customers, and you're number one on the customer side.[00:45:03] swyx: And the people who are in the middle. Inflection, um, character, didn't do that great. I think character did the best of all of them. Like, you have a note in here that we apparently said that character's price tag was[00:45:15] Alessio: 1B.[00:45:15] swyx: Did I say that?[00:45:16] Alessio: Yeah. You said Google should just buy them for 1B. I thought it was a crazy number.[00:45:20] Alessio: Then they paid 2. 7 billion. I mean, for like,[00:45:22] swyx: yeah.[00:45:22] Alessio: What do you pay for node? Like, I don't know what the game world was like. Maybe the starting price was 1B. I mean, whatever it was, it worked out for everybody involved.[00:45:31] The Multi-Modality War[00:45:31] Alessio: Multimodality war. And this one, we never had text to video in the first version, which now is the hottest.[00:45:37] swyx: Yeah, I would say it's a subset of image, but yes.[00:45:40] Alessio: Yeah, well, but I think at the time it wasn't really something people were doing, and now we had VO2 just came out yesterday. Uh, Sora was released last month, last week. I've not tried Sora, because the day that I tried, it wasn't, yeah. I[00:45:54] swyx: think it's generally available now, you can go to Sora.[00:45:56] swyx: com and try it. Yeah, they had[00:45:58] Alessio: the outage. Which I [00:46:00] think also played a part into it. Small things. Yeah. What's the other model that you posted today that was on Replicate? Video or OneLive?[00:46:08] swyx: Yeah. Very, very nondescript name, but it is from Minimax, which I think is a Chinese lab. The Chinese labs do surprisingly well at the video models.[00:46:20] swyx: I'm not sure it's actually Chinese. I don't know. Hold me up to that. Yep. China. It's good. Yeah, the Chinese love video. What can I say? They have a lot of training data for video. Or a more relaxed regulatory environment.[00:46:37] Alessio: Uh, well, sure, in some way. Yeah, I don't think there's much else there. I think like, you know, on the image side, I think it's still open.[00:46:45] Alessio: Yeah, I mean,[00:46:46] swyx: 11labs is now a unicorn. So basically, what is multi modality war? Multi modality war is, do you specialize in a single modality, right? Or do you have GodModel that does all the modalities? So this is [00:47:00] definitely still going, in a sense of 11 labs, you know, now Unicorn, PicoLabs doing well, they launched Pico 2.[00:47:06] swyx: 0 recently, HeyGen, I think has reached 100 million ARR, Assembly, I don't know, but they have billboards all over the place, so I assume they're doing very, very well. So these are all specialist models, specialist models and specialist startups. And then there's the big labs who are doing the sort of all in one play.[00:47:24] swyx: And then here I would highlight Gemini 2 for having native image output. Have you seen the demos? Um, yeah, it's, it's hard to keep up. Literally they launched this last week and a shout out to Paige Bailey, who came to the Latent Space event to demo on the day of launch. And she wasn't prepared. She was just like, I'm just going to show you.[00:47:43] swyx: So they have voice. They have, you know, obviously image input, and then they obviously can code gen and all that. But the new one that OpenAI and Meta both have but they haven't launched yet is image output. So you can literally, um, I think their demo video was that you put in an image of a [00:48:00] car, and you ask for minor modifications to that car.[00:48:02] swyx: They can generate you that modification exactly as you asked. So there's no need for the stable diffusion or comfy UI workflow of like mask here and then like infill there in paint there and all that, all that stuff. This is small model nonsense. Big model people are like, huh, we got you in as everything in the transformer.[00:48:21] swyx: This is the multimodality war, which is, do you, do you bet on the God model or do you string together a whole bunch of, uh, Small models like a, like a chump. Yeah,[00:48:29] Alessio: I don't know, man. Yeah, that would be interesting. I mean, obviously I use Midjourney for all of our thumbnails. Um, they've been doing a ton on the product, I would say.[00:48:38] Alessio: They launched a new Midjourney editor thing. They've been doing a ton. Because I think, yeah, the motto is kind of like, Maybe, you know, people say black forest, the black forest models are better than mid journey on a pixel by pixel basis. But I think when you put it, put it together, have you tried[00:48:53] swyx: the same problems on black forest?[00:48:55] Alessio: Yes. But the problem is just like, you know, on black forest, it generates one image. And then it's like, you got to [00:49:00] regenerate. You don't have all these like UI things. Like what I do, no, but it's like time issue, you know, it's like a mid[00:49:06] swyx: journey. Call the API four times.[00:49:08] Alessio: No, but then there's no like variate.[00:49:10] Alessio: Like the good thing about mid journey is like, you just go in there and you're cooking. There's a lot of stuff that just makes it really easy. And I think people underestimate that. Like, it's not really a skill issue, because I'm paying mid journey, so it's a Black Forest skill issue, because I'm not paying them, you know?[00:49:24] Alessio: Yeah,[00:49:25] swyx: so, okay, so, uh, this is a UX thing, right? Like, you, you, you understand that, at least, we think that Black Forest should be able to do all that stuff. I will also shout out, ReCraft has come out, uh, on top of the image arena that, uh, artificial analysis has done, has apparently, uh, Flux's place. Is this still true?[00:49:41] swyx: So, Artificial Analysis is now a company. I highlighted them I think in one of the early AI Newses of the year. And they have launched a whole bunch of arenas. So, they're trying to take on LM Arena, Anastasios and crew. And they have an image arena. Oh yeah, Recraft v3 is now beating Flux 1. 1. Which is very surprising [00:50:00] because Flux And Black Forest Labs are the old stable diffusion crew who left stability after, um, the management issues.[00:50:06] swyx: So Recurve has come from nowhere to be the top image model. Uh, very, very strange. I would also highlight that Grok has now launched Aurora, which is, it's very interesting dynamics between Grok and Black Forest Labs because Grok's images were originally launched, uh, in partnership with Black Forest Labs as a, as a thin wrapper.[00:50:24] swyx: And then Grok was like, no, we'll make our own. And so they've made their own. I don't know, there are no APIs or benchmarks about it. They just announced it. So yeah, that's the multi modality war. I would say that so far, the small model, the dedicated model people are winning, because they are just focused on their tasks.[00:50:42] swyx: But the big model, People are always catching up. And the moment I saw the Gemini 2 demo of image editing, where I can put in an image and just request it and it does, that's how AI should work. Not like a whole bunch of complicated steps. So it really is something. And I think one frontier that we haven't [00:51:00] seen this year, like obviously video has done very well, and it will continue to grow.[00:51:03] swyx: You know, we only have Sora Turbo today, but at some point we'll get full Sora. Oh, at least the Hollywood Labs will get Fulsora. We haven't seen video to audio, or video synced to audio. And so the researchers that I talked to are already starting to talk about that as the next frontier. But there's still maybe like five more years of video left to actually be Soda.[00:51:23] swyx: I would say that Gemini's approach Compared to OpenAI, Gemini seems, or DeepMind's approach to video seems a lot more fully fledged than OpenAI. Because if you look at the ICML recap that I published that so far nobody has listened to, um, that people have listened to it. It's just a different, definitely different audience.[00:51:43] swyx: It's only seven hours long. Why are people not listening? It's like everything in Uh, so, so DeepMind has, is working on Genie. They also launched Genie 2 and VideoPoet. So, like, they have maybe four years advantage on world modeling that OpenAI does not have. Because OpenAI basically only started [00:52:00] Diffusion Transformers last year, you know, when they hired, uh, Bill Peebles.[00:52:03] swyx: So, DeepMind has, has a bit of advantage here, I would say, in, in, in showing, like, the reason that VO2, while one, They cherry pick their videos. So obviously it looks better than Sora, but the reason I would believe that VO2, uh, when it's fully launched will do very well is because they have all this background work in video that they've done for years.[00:52:22] swyx: Like, like last year's NeurIPS, I already was interviewing some of their video people. I forget their model name, but for, for people who are dedicated fans, they can go to NeurIPS 2023 and see, see that paper.[00:52:32] Alessio: And then last but not least, the LLMOS. We renamed it to Ragops, formerly known as[00:52:39] swyx: Ragops War. I put the latest chart on the Braintrust episode.[00:52:43] swyx: I think I'm going to separate these essays from the episode notes. So the reason I used to do that, by the way, is because I wanted to show up on Hacker News. I wanted the podcast to show up on Hacker News. So I always put an essay inside of there because Hacker News people like to read and not listen.[00:52:58] Alessio: So episode essays,[00:52:59] swyx: I remember [00:53:00] purchasing them separately. You say Lanchain Llama Index is still growing.[00:53:03] Alessio: Yeah, so I looked at the PyPy stats, you know. I don't care about stars. On PyPy you see Do you want to share your screen? Yes. I prefer to look at actual downloads, not at stars on GitHub. So if you look at, you know, Lanchain still growing.[00:53:20] Alessio: These are the last six months. Llama Index still growing. What I've basically seen is like things that, One, obviously these things have A commercial product. So there's like people buying this and sticking with it versus kind of hopping in between things versus, you know, for example, crew AI, not really growing as much.[00:53:38] Alessio: The stars are growing. If you look on GitHub, like the stars are growing, but kind of like the usage is kind of like flat. In the last six months, have they done some[00:53:4

UNDERCARD BATTLES: Ari Shield vs Paulina Breeze Jesse Slaton vs Lakshmi Kopparam Andrew Muller vs David Bakker  Lizabanks Campagna vs Philip Gadala Taylor Drew vs Andy Mango MAIN EVENT: Danny Fallon vs Ilya Laksin JUDGES: Lawrence Reese, Gabby Jordan Brown, Jacob Williams, Robbie Goodwin OFFICIALS: Warren Simpson, Amanda Vasco, Gabby Jordan Brown DJ: Fluke Human HOST: Matt Maran Comedy Fight Club is recorded LIVE every Sunday in NYC. Not in the NYC area? You can still watch Comedy Fight Club on youtube and follow us on Instagram @comedyfightnyc If you want access to old episodes and bonus content subscribe to our Patreon page! https://www.patreon.com/comedyfightclub

Anthropic's CEO comes out as a China hawk ... Why so many China hawks in the AI community? ... Gaming out the AGI takeoff timeline ... Last year's OpenAI coup: What did Ilya see? ... Underappreciated dangers of the China chip war ... Are US tech leaders seeing China's perspective clearly? ... Heading to Overtime ...