South Korean band
POPULARITY
Categories
347 episodes with Day6
47 episodes with Day6
7 episodes with Day6
12 episodes with Day6
28 episodes with Day6
7 episodes with Day6
5 episodes with Day6
5 episodes with Day6
4 episodes with Day6
3 episodes with Day6
5 episodes with Day6
3 episodes with Day6
2 episodes with Day6
3 episodes with Day6
2 episodes with Day6
2 episodes with Day6
9 episodes with Day6
3 episodes with Day6
3 episodes with Day6
3 episodes with Day6
2 episodes with Day6
2 episodes with Day6
2 episodes with Day6
2 episodes with Day6
34 episodes with Day6
2 episodes with Day6
3 episodes with Day6
Note: data refund yang disebutkan dalam episode per tanggal rekaman episode ini. Untuk data terbaru silakan cek di akun @mydayberserikat.Fans K-Pop dan K-Drama harus banget aware sama permasalahan ini supaya gak terulang lagi di tahun-tahun mendatang. Tandain semua promotor red flag, ambil sikap tegas, stop transaksi acara mereka sebelum ada perbaikan (entah itu semua uang dari permasalahan sebelumnya sudah di-refund, CD yang dibeli sudah dikirim, dan segala tanggung jawab dan kewajiban mereka sebagai pelaku usaha sudah dijalankan).Fans hampir pasti selalu jadi korban promotor nakal. Here's a little reminder for you guys
6:05 Beth’s Song of the Day6:20 GUEST: Theresa Payton6:35 Origins of the "Good Morning!" soundbyte6:50 RAM Biz Update 7:05 NASCAR HoF requesting funding for upgrade/facelift7:20 City Council Meeting & NASCAR HoF Funding cont.7:35 Tennis vs Pickleball7:50 Tennis vs. Pickleball cont. 8:05 Surf or Sitcom: Beach Boys/John Stamos Tickets8:20 Surf or Sitcom: Beach Boys/John Stamos Tickets Cont.8:35 Dirty Restaurant Tuesday w/ Mark Garrison8:50 Best beaches in the Carolinas 9:05 Theresa Payton (replay)9:20 Jensen's pup, Maggie, has passed away9:35 Brett Jensen in studio - saying goodbye to Maggie9:50 Brett Jensen in studio - saying goodbye to MaggieSee omnystudio.com/listener for privacy information.
250521 Ps.pop 선곡표 1) Runaway Baby-Bruno Mars 2) 어쩌다보니-데이식스(DAY6) 3) Blue Moon-엔플라잉 (N.Flying)
Billingual Episode. Your favorite billingual podcast is here everyone. Hi semua Day By Day Podcat balik lagi untuk membahas lagu barunya Day6 - Maybe Tomorrow. Apa sih Makna dari lagu ini? Terus gimana sih MVnya, semuanya kita bahas di episode kali ini. Jangan lupa dengerin sampai alhir ya, Day By Day lovers. Billingual Episode. Your favorite billingual podcast is here everyone. Hi all Day By Day Podcat is back again to discuss Day6's new song - Maybe Tomorrow. What is the meaning of this song? Then how is the MV, everything we discussed in this episode. Don't forget to listen to the end, Day By Day lovers. don't forget to follow us on spotify, instagram: @mydaysix @daybydaypods
Konser Day6 seharusnya jadi momen bahagia, tapi buat My Day Indonesia, semuanya berubah karena promotor yang nggak profesional. Dari tempat yang tiba-tiba pindah sampai duit miliaran yang nggak balik, juga berjalannya konser yang kacau. Apa yang sebenarnya terjadi? Kita bahas semuanya di Day By Day Podcast. Fakta, rumor, Gosip semuanyaa ada di episode kali ini. Episode lengkap dalam bahasa Inggris udah rilis, kali ini versi bahasa Indonesianya. Langsung saya, tidak perlu menunggu lama. Ini dia Day By Day Podcast episode Ada apa dengan Day6 concert di Jakarta. What happened to Day6 Concert in Jakarta. Follow @mydaysix @daybydaypods Dipandu oleh: @urfakej_ #day6 #mecimapro #mydayindonesia #konserday6jakarta
No one wants to watch a Day6 concert with sadness, tears, and frustration. No one. But it's a different story with My Day Indonesia. A concert is supposed to be a moment where we share joy and happiness—but because the concert promoter didn't do their job properly, this concert became something else entirely. My Day Indonesia went through a lot of mistreatment from the promoter: a sudden venue change, over 3.8 billion rupiah in unrefunded tickets, and a completely messed-up system caused by the promoter. A lot happened during the concert, and some misunderstandings arose about why My Day Indonesia protested during the show. If you're an international My Day or even a non-fan wondering what really happened, we're here to bring you the truth and the tea about the Day6 concert in Jakarta. Hopefully, this helps you understand what My Day Indonesia is fighting for. So don't wait too long—here we go: Day By Day Podcast episode What Happened to Day6 Concert in Jakarta. Full English episode. Follow our Instagram @mydaysix @daybydaypods Hosted by: urfakej_
Chaos Erupts At DAY6's Concert In Jakarta, Fans Wait In Danger.
Welcome to Focus Asia your first window to discover Asia.This week, we have news from Taiwan, Vietnam, Singapore, and South Korea. Find out more episode and listening to Bingkai Suara Podcast.Don't forget to always listen to focus asia every week to update your knowledge about what happens in Asia and updated with our recent news on www.bingkaikarya.com
Katie and Chelsea talk about their concert experience for Treasure and Day6! **Just a heads up, Chelsea's mic was messed up for the first 30 minutes, but will be fixed from then on. Apologies for the sound quality!**FOLLOW US ON TWITTER OR INSTAGRAM: @LOVINGKPOPPODPlease rate, review, and subscribe to our podcast on Apple Podcasts, Stitcher, or wherever you download your podcasts.Special Thank you to Becky for our AMAZING art!! Follow her for the best Kpop pins and art! @borahae_bbTEA TIME SOCIAL MEDIA (OUR POP CULTURE PODCAST!)Twitter: https://twitter.com/teatimewithkc (@teatimewithkc)Instagram: https://www.instagram.com/teatimewithkc/ (@teatimewithkc)Facebook: https://www.facebook.com/teatimewithkc/Email: lovingkpoppod@gmail.comWebsite: https://teatimewithkc.comApple Podcasts: https://podcasts.apple.com/us/podcast/tea-time-with-katie-and-chelsea/id1182863745GEEK TO GEEK MEDIA NETWORKWebsite: https://geektogeekmedia.comBe sure to check out the latest episode of Geek To Geek Podcast, Geektitude, Dragon Quest FM, And Sometimes Rob, Disney Forever: The Best Disney Movie Podcast, & GeekFitnesshttps://itunes.apple.com/us/podcast/geek-to-geek-podcast/id1092737489https://itunes.apple.com/us/podcast/geektitude/id1042398176?mt=2https://podcasts.apple.com/us/podcast/and-sometimes-rob/id1118686573https://anchor.fm/disneyforeverhttps://anchor.fm/geekfitnessBe sure to also check out the network's newest Twitch Streamers:https://www.twitch.tv/capsulejayhttps://www.twitch.tv/troytlepowerJOIN THE CONVERSATIONNetwork Slack Channel -> https://slack.geektogeekcast.comNetwork Discord Server - https://discord.gg/wGPdkkq
Episode 5 Season 3 We're back, everyone!!! Your favorite bilingual podcast has returned. First of all—Happy Mubarak to everyone who's celebrating. May joy and happiness keep dancing around you, Day By Day Lovers. Alrighty, di episode kali ini J-key bakal ngobrolin tentang hal-hal apa aja sih yang J-key pelajari selama jadi My Day hampir 8 tahun (whoa!) dan juga jadi Jars. Hmm, kira-kira pelajaran hidupnya apa aja ya? Kalau kalian para Day By Day Lovers, pelajaran apa yang kalian dapet selama jadi My Day dan Jars? Share dong di komen! Big hugs and thank you to everyone who's tuning in! Don't forget to leave a rating di Spotify, kasih komentar juga ya. Follow Day By Day Podcast di Spotify @daybydaypods dan juga @mydaysix. Stay healthy, stay happy, and stay vibin', everyone!
Recorded 3rd March 2025All Lectures: https://tinyurl.com/VPAD2025MungerMandirvisit: http://beautyofreallove.com/visit: https://sadhumaharaja.net/audio: https://tinyurl.com/BeautyOfRealLove#raganugabhakti #bhaktiyoga #radha #harekrishna #gaudiya_math #gaudiya #hinduism #radhakrishna
主播｜李疏 小伙子 嘉宾｜郑洋日谈看世界三个全新旅行团「四川唐家河·自然保护区探秘之旅」「马来西亚 · 婆罗洲雨林探索之旅」「江苏南京·古都博物人文之旅」正在火热招募中！本期节目，李疏、小伙子和博旅文化创始人郑洋老师，为大家一次性讲解三个团分别玩什么，看什么？从3月到6月，国内自然探秘、海外雨林探险、周末城市漫游全涵盖，集中发布，自由选择，提前规划假期，满足不同旅行偏好。了解详情扫描下方海报二维码，可直接跳转购买，目前仍可加入，错过就要再等啦！唐家河不是河，它是一个充满生机的动植物王国，王国里有什么？有园区里拦路的藏酋猴、山间的扭角羚和斑羚，更有大熊猫、欧亚水獭、红腹锦鸡、川金丝猴等各种珍稀动物；有高海拔的冷杉、云杉原始林和高山草甸，低海拔的常绿阔叶林，还有漫山遍野的紫荆花海，这里洗涤眼睛又净化心灵。红外相机怎么用？森林调查的手段有什么？自然博物馆里有哪些特有动物？如果你也对动物学充满热情，这一趟一定别错过！野生动物还没看够？跟我们去马来西亚婆罗洲探索热带雨林吧！这里长鼻猴管够，还有银叶猴、食蟹猴、红毛猩猩、犀鸟、马来熊的身影。乘船巡游京纳巴当岸河，夜探原始雨林，在三大保育中心和明星物种零距离接触，从清晨到日暮，随时邂逅神奇动物。重返都市还能品尝沙巴风味美食，打卡水上清真寺。不想出国？时间紧张？我们还有两期南京周末短途游。南京红山森林动物园到底优秀在哪里？跟着资深的讲解老师逛一逛就知道了。寻找那一抹“长江的微笑”，野生江豚在哪里能看到？探访南京长江江豚保护区，跟着专家实地观测一下。南京，少不了的是历史底蕴，我们在六朝博物馆揭秘魏晋风流，在帝陵石刻见证南朝兴衰。古都博物人文之旅，期待与你同行！05:02 四川唐家河自然保护区行程基本信息10:10 Day1：绵阳集合，入住保护区，猴子也参加开营仪式12:31 Day2：高海拔动物寻踪，红腹锦鸡、斑羚和中华鬣羚，一起刷大货17:42 Day3：低海拔山野观察，大翠鸟，欧亚水獭，在此邂逅可爱的小生灵25:14 Day4：探索自然博物馆，结束本次旅程28:26 马来西亚婆罗洲雨林行程基本信息39:57 Day1：沙巴机场集合，入住营地41:43 Day2：丛林徒步，京河游船，开启生态冒险42:17 Day3：夜探热带雨林，刺激感直接拉满43:40 Day4：红毛猩猩、马来熊，在三育中心与明星物种零距离接触45:58 Day5：品尝沙巴风味美食，体验特色海钓47:41 Day6：打卡水上清真寺，在亚庇city一下，结束本次旅程51:45 江苏南京古都行程基本信息1:05:25 Day1：南京集合，先观豚，再跟资深讲解逛一逛红山森林动物园1:07:15 Day2：六朝博物馆、南朝帝陵石刻，穿越古今的人文之旅｜Songlist｜阿牛 - 桃花朵朵开/相关图片/四川羚牛（唐家河）藏酋猴（唐家河）欧亚水獭（唐家河）紫荆花（唐家河）红毛猩猩（婆罗洲）长鼻猴（婆罗洲）犀鸟（婆罗洲）马来熊（婆罗洲）南京红山森林动物园（南京）江豚（南京）六朝博物馆（南京）南朝帝陵石刻（南京）【收听平台】小宇宙｜喜马拉雅｜苹果播客｜网易云音乐｜荔枝｜蜻蜓FM｜QQ音乐｜酷我音乐｜酷狗音乐｜懒人听书｜微博音频｜三联中读｜听听FM｜猫耳FM｜Spotify｜YouTube｜关注我们｜移步点击日谈公园品牌官网（链接：https://www.ritanbbpark.com），了解更多微信公众号：日谈公园微博：@日谈公园小红书：日谈公园即刻：日谈李小日B站：日谈公园｜商务合作｜欢迎发送邮件至 bbpark@ritanbbpark.com
世の光 2025年2月15日 若月 御名美｜番組お便り紹介ウィーク Day6
Bilingual Episode (English &Indonesian) Hai.... hai... everyone. Day By Day Podcast is back. Apa kabar teman-teman semua? Episode 3 season 3 Day By Day Podcast sudah rilis nih. Bareng our favorite house J-key/ Joa kali ini kita bahas tentang Day6 &My Days inside Jokes. Apa aja inside jokesnya? Jangan lupa dengerin sampai akhir ya. Hi... hi... everyone. Day By Day Podcast is back. How are you all doing? Episode 3 of Season 3 of the Day By Day Podcast is out now. Together with our favorite host J-key/Joa, this time we're talking about Day6 and My Days' inside jokes. What are the inside jokes? Don't forget to listen until the end! follow our podcast on Spotify, instagram: daybydaypods and our Instagram @mydaysix. don't forget to leave the comments too on Spotify. Love you all❤
沒想到這句話成為了我文章的萬用結尾 第三名是什麼呢？ ---------------------------------------------- ❤️宅女小紅睽違六年新書熱烈販售中❤️
2024 was a wild ride. In this episode, we share our highs, lows, and transformative lessons. From aligning your team for success, to a managing major business pivot or cutting unnecessary costs, we cover the strategies that helped us navigate the challenges of 2024 and set bold goals for 2025. Big plans for brand social, niche targeting, creating sticky offers that clients can't cut and focus on what really moves the needle. Here's 5 things you can get done faster on Wix Studio:● Scale content with dynamic pages and reusable assets● And integrate with Meta CAPI, Zapier, Google Ads and more in seconds● A/B tests are a given—create them in days, not weeks with intuitive design tools● Connect tracking and analytics tools like GA4 & Semrush in seconds● And manage all your clients' social media from one dashboardAll of that right here: https://l.marketingexamined.com/wixpo
2025 is the year to revolutionize your content—that's why in this episode we explore the hottest up-and-coming strategies.From creating cohesive brand narratives to leveraging AI-driven marketing tools, we break down strategies to elevate your content and engagement. Learn about TikTok blitz strategies, apparel brand content pillars, the future of long-form content for brands and the importance of character development for lasting impact. Is dropshipping making a comeback in 2025? Don't miss this insightful discussion packed with actionable ideas for brands and creators alike!Here's 5 things you can get done faster on Wix Studio:● Scale content with dynamic pages and reusable assets● And integrate with Meta CAPI, Zapier, Google Ads and more in seconds● A/B tests are a given—create them in days, not weeks with intuitive design tools● Connect tracking and analytics tools like GA4 & Semrush in seconds● And manage all your clients' social media from one dashboardAll of that right here: https://l.marketingexamined.com/wixpo
我認為這才是影響人生最深遠的一句話 第五名是什麼呢？ ---------------------------------------------- ❤️宅女小紅睽違六年新書熱烈預購中❤️
Happy December everyone! We hope you all are staying warm and taking care of yourselves this holiday season. This episode, we bring you many many songs by DAY6, fun comebacks by QWER and fromis_9, and many more artists.Host: LizzieScript Production: LizzieAudio Editor: LizzieHappy – DAY6매력 (Beat Drum) – Onew of SHINee Pleasure Shop – Key of SHINee Supernova – aespa녹아내려요 (Melt Down) – DAY6 Welcome To The Show – DAY6한 페이지가 될 수 있게 (Time Of Our Life) – DAY6How Sweet – NewJeans 내 이름 맑음 (My Name Is Malguem) – QWER 클락션 (Klaxon) – (G)I-DLESmall Girl feat. D.O.of EXO – Lee Young Ji Sticky – KISS OF LIFE소나기 (Sudden Shower) – ECLIPSE 예뻤어 (You Were Beautiful) – DAY6Supersonic – fromis_9Extra #1: Cookie – NewJeans – Song request from 햄쮜Extra #2: 첫 눈 (The First Snow) – EXOHave a product or more that you would like us to advertise for you? Email us at elizabeth@ktop10.mymti.org and we'll give you the details on our rates. If you want to find out episode song lists and other information on the podcast, or want to send in song requests, don't forget to check out our website, ktop10.mymti.org. And if you accidentally type out ktop10.com, it'll automatically go to our website (: And if you want social media updates on the podcast and on the haps of the K-Pop world, like us on Facebook and follow us on Twitter. Our handle for both is ktop10pod. Are you feeling adventurous? Then check out our sister show, Japan Top 10 at jtop10.mymti.jp for some Japanese music. Loving K-Pop or other Korean music genres? Want to express your love for amazing song releases? Want to join our team? Then check out http://mymti.org/current-openings/ for more information. You will not regret it!Support this podcast at — https://redcircle.com/ktop-10-k-pop-hits/donationsAdvertising Inquiries: https://redcircle.com/brandsPrivacy & Opt-Out: https://redcircle.com/privacy
CMFI Annual Prayer and Fasting Crusade in Koume. From 14th September to 22nd of September 2024
Kwede Hugo - CMFI Annual Prayer and Fasting Crusade in Koume. From 14th September to 22nd of September 2024
CMFI Annual Prayer and Fasting Crusade in Koume. From 14th September to 22nd of September 2024
Matthew Ngo - CMFI Annual Prayer and Fasting Crusade in Koume. From 14th September to 22nd of September 2024
Henriette Mbarga - CMFI Annual Prayer and Fasting Crusade in Koume. From 14th September to 22nd of September 2024
Theodore Andoseh - CMFI Annual Prayer and Fasting Crusade in Koume. From 14th September to 22nd of September 2024
T. Andoseh - CMFI Annual Prayer and Fasting Crusade in Koume. From 14th September to 22nd of September 2024
Alphonse Tawet - CMFI Annual Prayer and Fasting Crusade in Koume. From 14th September to 22nd of September 2024
Johnny Bapack - CMFI Annual Prayer and Fasting Crusade in Koume. From 14th September to 22nd of September 2024
Nicolas Akoa - CMFI Annual Prayer and Fasting Crusade in Koume. From 14th September to 22nd of September 2024
Tap into The Power of Your Mind using Law of Attraction and Hypnosis Techniques
0000021B 00000212 00003849 00003849 00033D2F 00033D2F 00007EE5 00007F05 00002CCB 00002CCB
XDINARY HEROES got us revisiting our emo band days, P1Harmony is singing a sad song that's not sad, and BOYNEXTDOOR are the next big thing and we're OBSESSED! Listen as we discuss what happened in the KPOP world this past week!Listen to our KCON LA 2024 recap episode here: https://open.spotify.com/episode/3livjXeDm0jcmLL2JvW3cE?si=CjSknnhRRFun0PB021ScvwTune in every Tuesday for a new episode and don't forget to follow our social media and let us know what you think.Time stamps:1:40 - DAY6 first win3:17 - NewJeans6:09 - Jessi establishes own label UNNI9:02 - A.C.E - Anymore11:22 - Xdinary Heroes ft. Yoon DoHyun - iNSTEAD!15:28 - P1Harmony - SAD SONG18:24 - BOYNEXTDOOR - Dangerous & Nice Guy25:38 - NCT WISH - Dunk Shot26:37 - Yeonjun - GGUM29:25 - Hwasa - NA32:16 - FIFTYFIFTY - SOS37:20 - Songs of the WeekListen here!Apple: https://podcasts.apple.com/us/podcast/not-your-average-fangirls-a-k-pop-podcast/id1397623744iHeartRadio: https://www.iheart.com/podcast/269-not-your-average-fangirls-30301805/Spotify: https://open.spotify.com/show/4OL4qPjUyRsjfX30FIDczs?si=efdf606f0f24437fThis week's playlist: https://open.spotify.com/playlist/4GRevdSwskRyldUZbzZZPV?si=v9EftC8yQyCiPdkfVpnFzQwww.twitter.com/NYAFangirlswww.twitter.com/HollaItsCarowww.twitter.com/heyitsteeteewww.twitter.com/deekaydi
DAY6 becomes the only artist with more than one ‘Real Time All-Kill' song in 2024 Korean charts.
eaJ came by to talk about his song "burn" feat. salem ilese, upcoming EP when the rain stopped following me, regrets he has about his days with Day6, life as an idol and morw!Stream "burn (feat. salem ilese)" ►► https://distrokid.com/hyperfollow/eaj/burn-feat-salem-ileseYou can always leave us a voicemail - (262) 515-9224!Follow Us On Social!TikTokTwitterInstagramFacebookFollow ZachFollow DanSee Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.
SojuTalk is back at it again as we discuss releases from Rescene, LE SSERAFIM, Fifty Fifty, Day6, Loossemble, and QWER! As always, the Crew keeps you up to date with all the recent Kpop News/Events. And you know we gonna get hype as we declare this week's Spice King and give our State of the Nation!!! Links ◆Email - sojutalkpodcast@gmail.com ◆Discord - discord.gg/3rb74x4 ◆Patreon - patreon.com/sojutalk Timestamps ◆Intro - 0:00 ◆Big New Releases Part 1 - 1:14 ◆Big New Releases Part 2 - 40:17 ◆Spice King - 1:09:29 ◆Show Winners - 1:15:07 ◆News - 1:17:05 ◆Afterhours -
I want to hear your thoughts about the show and this episode. Text us here...In this episode, I talk about -Why an online presence is essential in today's market. -Key platforms for female entrepreneurs and how to choose. -Optimizing your social media profiles for visibility.-Content strategies to build authority and trust.-Common mistakes to avoid when building an online presence. GET MORE SUPPORT
N-1 VICTORY 2024 Day6 8.17八王子大会と Day7 8.18仙台大会のレビューです！ 八王子MOTNは清宮ブリッグス、仙台MOTNは清宮北宮です！きよぴ最高
In this episode, we discuss the songs we just can't get enough of–whether they're new releases or just new to us–from some of our faves in the K-pop industry. We explore ILLIT's new album "Super Real Me," featuring the viral hit "Magnetic". Get the scoop on Day6's return with "Welcome to the Show", and a star-studded music video, signaling a major investment in their resurgence. We wrap up with a discussion on VCHA's energetic, fast-paced comeback "Only One", which fills a fun niche in the K-pop industry. Tune in for all this and more as Idol Talk keeps you updated on your K-pop obsessions! --- Support this podcast: https://podcasters.spotify.com/pod/show/idoltalkpod/support
David Kim is many things but is perhaps best known for his Korean content on Youtube. He has been a huge part of three popular programs over the last seven years: DKDKTV, Ramyun and Chill, and, now, Korean Pizza Club. His content has reached millions and is driven by his positive and generous outlook on life, something even more evident when meeting him in person. We spoke about how hallyu has changed, whether K-pop is still cool, Korean dating culture, and life here in Seoul. We even got political at the end, exploring the challenges of democracy and communism and what hope young people have for the future. Check out David's work online Korean Pizza Club: https://www.youtube.com/@UCVqkbppiAXuI4Kp3AQmauTw DKDKTV: https://www.youtube.com/c/dkdktv Biroso: https://biroso.net/ We are also joined by Seoul Women's University student Soyoon Kim Insta: @celinesoyoon Discussion Outline 0:00 Introduction 10:24 Positivity in the Korean Space 15:42 Culture and Korea 27:47 Is Hallyu Still Popular? 37:20 Streaming Culture and Manipulation 46:48 Dating Culture 52:04 Being Cancelled 1:03:00 Misperceptions of Korea 1:14:20 Education and Competition in Korea 1:23:00 Korean democracy 1:35:20 Recommendations Korea Deconstructed by David Tizzard ▶ Get in touch: datizzard@swu.ac.kr ▶ Support us on Patreon: https://www.patreon.com/user?u=62047873 ▶ Watch us on Youtube: www.youtube.com/@UCXcdboOUCnCFnrAOF5dV1sg ▶ Find us on Insta: https://www.instagram.com/koreadeconstructed ▶ Listen on iTunes: https://podcasts.apple.com/kr/podcast/korea-deconstructed/id1587269128 ▶Listen on Spotify: https://open.spotify.com/show/5zdXkG0aAAHnDwOvd0jXEE ▶ Listen on podcasts: https://koreadeconstructed.libsyn.com/ ▶ Music: Still Something So Beautiful by David Tizzard (Radical Gary)
Our next 2 big events are AI UX and the World's Fair. Join and apply to speak/sponsor!Due to timing issues we didn't have an interview episode to share with you this week, but not to worry, we have more than enough “weekend special” content in the backlog for you to get your Latent Space fix, whether you like thinking about the big picture, or learning more about the pod behind the scenes, or talking Groq and GPUs, or AI Leadership, or Personal AI. Enjoy!AI BreakdownThe indefatigable NLW had us back on his show for an update on the Four Wars, covering Sora, Suno, and the reshaped GPT-4 Class Landscape:and a longer segment on AI Engineering trends covering the future LLM landscape (Llama 3, GPT-5, Gemini 2, Claude 4), Open Source Models (Mistral, Grok), Apple and Meta's AI strategy, new chips (Groq, MatX) and the general movement from baby AGIs to vertical Agents:Thursday Nights in AIWe're also including swyx's interview with Josh Albrecht and Ali Rohde to reintroduce swyx and Latent Space to a general audience, and engage in some spicy Q&A:Dylan Patel on GroqWe hosted a private event with Dylan Patel of SemiAnalysis (our last pod here):Not all of it could be released so we just talked about our Groq estimates:Milind Naphade - Capital OneIn relation to conversations at NeurIPS and Nvidia GTC and upcoming at World's Fair, we also enjoyed chatting with Milind Naphade about his AI Leadership work at IBM, Cisco, Nvidia, and now leading the AI Foundations org at Capital One. We covered:* Milind's learnings from ~25 years in machine learning * His first paper citation was 24 years ago* Lessons from working with Jensen Huang for 6 years and being CTO of Metropolis * Thoughts on relevant AI research* GTC takeaways and what makes NVIDIA specialIf you'd like to work on building solutions rather than platform (as Milind put it), his Applied AI Research team at Capital One is hiring, which falls under the Capital One Tech team.Personal AI MeetupIt all started with a meme:Within days of each other, BEE, FRIEND, EmilyAI, Compass, Nox and LangFriend were all launching personal AI wearables and assistants. So we decided to put together a the world's first Personal AI meetup featuring creators and enthusiasts of wearables. The full video is live now, with full show notes within.Timestamps* [00:01:13] AI Breakdown Part 1* [00:02:20] Four Wars* [00:13:45] Sora* [00:15:12] Suno* [00:16:34] The GPT-4 Class Landscape* [00:17:03] Data War: Reddit x Google* [00:21:53] Gemini 1.5 vs Claude 3* [00:26:58] AI Breakdown Part 2* [00:27:33] Next Frontiers: Llama 3, GPT-5, Gemini 2, Claude 4* [00:31:11] Open Source Models - Mistral, Grok* [00:34:13] Apple MM1* [00:37:33] Meta's $800b AI rebrand* [00:39:20] AI Engineer landscape - from baby AGIs to vertical Agents* [00:47:28] Adept episode - Screen Multimodality* [00:48:54] Top Model Research from January Recap* [00:53:08] AI Wearables* [00:57:26] Groq vs Nvidia month - GPU Chip War* [01:00:31] Disagreements* [01:02:08] Summer 2024 Predictions* [01:04:18] Thursday Nights in AI - swyx* [01:33:34] Dylan Patel - Semianalysis + Latent Space Live Show* [01:34:58] GroqTranscript[00:00:00] swyx: Welcome to the Latent Space Podcast Weekend Edition. This is Charlie, your AI co host. Swyx and Alessio are off for the week, making more great content. We have exciting interviews coming up with Elicit, Chroma, Instructor, and our upcoming series on NSFW, Not Safe for Work AI. In today's episode, we're collating some of Swyx and Alessio's recent appearances, all in one place for you to find.[00:00:32] swyx: In part one, we have our first crossover pod of the year. In our listener survey, several folks asked for more thoughts from our two hosts. In 2023, Swyx and Alessio did crossover interviews with other great podcasts like the AI Breakdown, Practical AI, Cognitive Revolution, Thursday Eye, and Chinatalk, all of which you can find in the Latentspace About page.[00:00:56] swyx: NLW of the AI Breakdown asked us back to do a special on the 4Wars framework and the AI engineer scene. We love AI Breakdown as one of the best examples Daily podcasts to keep up on AI news, so we were especially excited to be back on Watch out and take[00:01:12] NLW: care[00:01:13] AI Breakdown Part 1[00:01:13] NLW: today on the AI breakdown. Part one of my conversation with Alessio and Swix from Latent Space.[00:01:19] NLW: All right, fellas, welcome back to the AI Breakdown. How are you doing? I'm good. Very good. With the last, the last time we did this show, we were like, oh yeah, let's do check ins like monthly about all the things that are going on and then. Of course, six months later, and, you know, the, the, the world has changed in a thousand ways.[00:01:36] NLW: It's just, it's too busy to even, to even think about podcasting sometimes. But I, I'm super excited to, to be chatting with you again. I think there's, there's a lot to, to catch up on, just to tap in, I think in the, you know, in the beginning of 2024. And, and so, you know, we're gonna talk today about just kind of a, a, a broad sense of where things are in some of the key battles in the AI space.[00:01:55] NLW: And then the, you know, one of the big things that I, that I'm really excited to have you guys on here for us to talk about where, sort of what patterns you're seeing and what people are actually trying to build, you know, where, where developers are spending their, their time and energy and, and, and any sort of, you know, trend trends there, but maybe let's start I guess by checking in on a framework that you guys actually introduced, which I've loved and I've cribbed a couple of times now, which is this sort of four wars of the, of the AI stack.[00:02:20] Four Wars[00:02:20] NLW: Because first, since I have you here, I'd love, I'd love to hear sort of like where that started gelling. And then and then maybe we can get into, I think a couple of them that are you know, particularly interesting, you know, in the, in light of[00:02:30] swyx: some recent news. Yeah, so maybe I'll take this one. So the four wars is a framework that I came up around trying to recap all of 2023.[00:02:38] swyx: I tried to write sort of monthly recap pieces. And I was trying to figure out like what makes one piece of news last longer than another or more significant than another. And I think it's basically always around battlegrounds. Wars are fought around limited resources. And I think probably the, you know, the most limited resource is talent, but the talent expresses itself in a number of areas.[00:03:01] swyx: And so I kind of focus on those, those areas at first. So the four wars that we cover are the data wars, the GPU rich, poor war, the multi modal war, And the RAG and Ops War. And I think you actually did a dedicated episode to that, so thanks for covering that. Yeah, yeah.[00:03:18] NLW: Not only did I do a dedicated episode, I actually used that.[00:03:22] NLW: I can't remember if I told you guys. I did give you big shoutouts. But I used it as a framework for a presentation at Intel's big AI event that they hold each year, where they have all their folks who are working on AI internally. And it totally resonated. That's amazing. Yeah, so, so, what got me thinking about it again is specifically this inflection news that we recently had, this sort of, you know, basically, I can't imagine that anyone who's listening wouldn't have thought about it, but, you know, inflection is a one of the big contenders, right?[00:03:53] NLW: I think probably most folks would have put them, you know, just a half step behind the anthropics and open AIs of the world in terms of labs, but it's a company that raised 1. 3 billion last year, less than a year ago. Reed Hoffman's a co founder Mustafa Suleyman, who's a co founder of DeepMind, you know, so it's like, this is not a a small startup, let's say, at least in terms of perception.[00:04:13] NLW: And then we get the news that basically most of the team, it appears, is heading over to Microsoft and they're bringing in a new CEO. And you know, I'm interested in, in, in kind of your take on how much that reflects, like hold aside, I guess, you know, all the other things that it might be about, how much it reflects this sort of the, the stark.[00:04:32] NLW: Brutal reality of competing in the frontier model space right now. And, you know, just the access to compute.[00:04:38] Alessio: There are a lot of things to say. So first of all, there's always somebody who's more GPU rich than you. So inflection is GPU rich by startup standard. I think about 22, 000 H100s, but obviously that pales compared to the, to Microsoft.[00:04:55] Alessio: The other thing is that this is probably good news, maybe for the startups. It's like being GPU rich, it's not enough. You know, like I think they were building something pretty interesting in, in pi of their own model of their own kind of experience. But at the end of the day, you're the interface that people consume as end users.[00:05:13] Alessio: It's really similar to a lot of the others. So and we'll tell, talk about GPT four and cloud tree and all this stuff. GPU poor, doing something. That the GPU rich are not interested in, you know we just had our AI center of excellence at Decibel and one of the AI leads at one of the big companies was like, Oh, we just saved 10 million and we use these models to do a translation, you know, and that's it.[00:05:39] Alessio: It's not, it's not a GI, it's just translation. So I think like the inflection part is maybe. A calling and a waking to a lot of startups then say, Hey, you know, trying to get as much capital as possible, try and get as many GPUs as possible. Good. But at the end of the day, it doesn't build a business, you know, and maybe what inflection I don't, I don't, again, I don't know the reasons behind the inflection choice, but if you say, I don't want to build my own company that has 1.[00:06:05] Alessio: 3 billion and I want to go do it at Microsoft, it's probably not a resources problem. It's more of strategic decisions that you're making as a company. So yeah, that was kind of my. I take on it.[00:06:15] swyx: Yeah, and I guess on my end, two things actually happened yesterday. It was a little bit quieter news, but Stability AI had some pretty major departures as well.[00:06:25] swyx: And you may not be considering it, but Stability is actually also a GPU rich company in the sense that they were the first new startup in this AI wave to brag about how many GPUs that they have. And you should join them. And you know, Imadis is definitely a GPU trader in some sense from his hedge fund days.[00:06:43] swyx: So Robin Rhombach and like the most of the Stable Diffusion 3 people left Stability yesterday as well. So yesterday was kind of like a big news day for the GPU rich companies, both Inflection and Stability having sort of wind taken out of their sails. I think, yes, it's a data point in the favor of Like, just because you have the GPUs doesn't mean you can, you automatically win.[00:07:03] swyx: And I think, you know, kind of I'll echo what Alessio says there. But in general also, like, I wonder if this is like the start of a major consolidation wave, just in terms of, you know, I think that there was a lot of funding last year and, you know, the business models have not been, you know, All of these things worked out very well.[00:07:19] swyx: Even inflection couldn't do it. And so I think maybe that's the start of a small consolidation wave. I don't think that's like a sign of AI winter. I keep looking for AI winter coming. I think this is kind of like a brief cold front. Yeah,[00:07:34] NLW: it's super interesting. So I think a bunch of A bunch of stuff here.[00:07:38] NLW: One is, I think, to both of your points, there, in some ways, there, there had already been this very clear demarcation between these two sides where, like, the GPU pores, to use the terminology, like, just weren't trying to compete on the same level, right? You know, the vast majority of people who have started something over the last year, year and a half, call it, were racing in a different direction.[00:07:59] NLW: They're trying to find some edge somewhere else. They're trying to build something different. If they're, if they're really trying to innovate, it's in different areas. And so it's really just this very small handful of companies that are in this like very, you know, it's like the coheres and jaspers of the world that like this sort of, you know, that are that are just sort of a little bit less resourced than, you know, than the other set that I think that this potentially even applies to, you know, everyone else that could clearly demarcate it into these two, two sides.[00:08:26] NLW: And there's only a small handful kind of sitting uncomfortably in the middle, perhaps. Let's, let's come back to the idea of, of the sort of AI winter or, you know, a cold front or anything like that. So this is something that I, I spent a lot of time kind of thinking about and noticing. And my perception is that The vast majority of the folks who are trying to call for sort of, you know, a trough of disillusionment or, you know, a shifting of the phase to that are people who either, A, just don't like AI for some other reason there's plenty of that, you know, people who are saying, You Look, they're doing way worse than they ever thought.[00:09:03] NLW: You know, there's a lot of sort of confirmation bias kind of thing going on. Or two, media that just needs a different narrative, right? Because they're sort of sick of, you know, telling the same story. Same thing happened last summer, when every every outlet jumped on the chat GPT at its first down month story to try to really like kind of hammer this idea that that the hype was too much.[00:09:24] NLW: Meanwhile, you have, you know, just ridiculous levels of investment from enterprises, you know, coming in. You have, you know, huge, huge volumes of, you know, individual behavior change happening. But I do think that there's nothing incoherent sort of to your point, Swyx, about that and the consolidation period.[00:09:42] NLW: Like, you know, if you look right now, for example, there are, I don't know, probably 25 or 30 credible, like, build your own chatbot. platforms that, you know, a lot of which have, you know, raised funding. There's no universe in which all of those are successful across, you know, even with a, even, even with a total addressable market of every enterprise in the world, you know, you're just inevitably going to see some amount of consolidation.[00:10:08] NLW: Same with, you know, image generators. There are, if you look at A16Z's top 50 consumer AI apps, just based on, you know, web traffic or whatever, they're still like I don't know, a half. Dozen or 10 or something, like, some ridiculous number of like, basically things like Midjourney or Dolly three. And it just seems impossible that we're gonna have that many, you know, ultimately as, as, as sort of, you know, going, going concerned.[00:10:33] NLW: So, I don't know. I, I, I think that the, there will be inevitable consolidation 'cause you know. It's, it's also what kind of like venture rounds are supposed to do. You're not, not everyone who gets a seed round is supposed to get to series A and not everyone who gets a series A is supposed to get to series B.[00:10:46] NLW: That's sort of the natural process. I think it will be tempting for a lot of people to try to infer from that something about AI not being as sort of big or as as sort of relevant as, as it was hyped up to be. But I, I kind of think that's the wrong conclusion to come to.[00:11:02] Alessio: I I would say the experimentation.[00:11:04] Alessio: Surface is a little smaller for image generation. So if you go back maybe six, nine months, most people will tell you, why would you build a coding assistant when like Copilot and GitHub are just going to win everything because they have the data and they have all the stuff. If you fast forward today, A lot of people use Cursor everybody was excited about the Devin release on Twitter.[00:11:26] Alessio: There are a lot of different ways of attacking the market that are not completion of code in the IDE. And even Cursors, like they evolved beyond single line to like chat, to do multi line edits and, and all that stuff. Image generation, I would say, yeah, as a, just as from what I've seen, like maybe the product innovation has slowed down at the UX level and people are improving the models.[00:11:50] Alessio: So the race is like, how do I make better images? It's not like, how do I make the user interact with the generation process better? And that gets tough, you know? It's hard to like really differentiate yourselves. So yeah, that's kind of how I look at it. And when we think about multimodality, maybe the reason why people got so excited about Sora is like, oh, this is like a completely It's not a better image model.[00:12:13] Alessio: This is like a completely different thing, you know? And I think the creative mind It's always looking for something that impacts the viewer in a different way, you know, like they really want something different versus the developer mind. It's like, Oh, I, I just, I have this like very annoying thing I want better.[00:12:32] Alessio: I have this like very specific use cases that I want to go after. So it's just different. And that's why you see a lot more companies in image generation. But I agree with you that. If you fast forward there, there's not going to be 10 of them, you know, it's probably going to be one or[00:12:46] swyx: two. Yeah, I mean, to me, that's why I call it a war.[00:12:49] swyx: Like, individually, all these companies can make a story that kind of makes sense, but collectively, they cannot all be true. Therefore, they all, there is some kind of fight over limited resources here. Yeah, so[00:12:59] NLW: it's interesting. We wandered very naturally into sort of another one of these wars, which is the multimodality kind of idea, which is, you know, basically a question of whether it's going to be these sort of big everything models that end up winning or whether, you know, you're going to have really specific things, you know, like something, you know, Dolly 3 inside of sort of OpenAI's larger models versus, you know, a mid journey or something like that.[00:13:24] NLW: And at first, you know, I was kind of thinking like, For most of the last, call it six months or whatever, it feels pretty definitively both and in some ways, you know, and that you're, you're seeing just like great innovation on sort of the everything models, but you're also seeing lots and lots happen at sort of the level of kind of individual use cases.[00:13:45] Sora[00:13:45] NLW: But then Sora comes along and just like obliterates what I think anyone thought you know, where we were when it comes to video generation. So how are you guys thinking about this particular battle or war at the moment?[00:13:59] swyx: Yeah, this was definitely a both and story, and Sora tipped things one way for me, in terms of scale being all you need.[00:14:08] swyx: And the benefit, I think, of having multiple models being developed under one roof. I think a lot of people aren't aware that Sora was developed in a similar fashion to Dolly 3. And Dolly3 had a very interesting paper out where they talked about how they sort of bootstrapped their synthetic data based on GPT 4 vision and GPT 4.[00:14:31] swyx: And, and it was just all, like, really interesting, like, if you work on one modality, it enables you to work on other modalities, and all that is more, is, is more interesting. I think it's beneficial if it's all in the same house, whereas the individual startups who don't, who sort of carve out a single modality and work on that, definitely won't have the state of the art stuff on helping them out on synthetic data.[00:14:52] swyx: So I do think like, The balance is tilted a little bit towards the God model companies, which is challenging for the, for the, for the the sort of dedicated modality companies. But everyone's carving out different niches. You know, like we just interviewed Suno ai, the sort of music model company, and, you know, I don't see opening AI pursuing music anytime soon.[00:15:12] Suno[00:15:12] swyx: Yeah,[00:15:13] NLW: Suno's been phenomenal to play with. Suno has done that rare thing where, which I think a number of different AI product categories have done, where people who don't consider themselves particularly interested in doing the thing that the AI enables find themselves doing a lot more of that thing, right?[00:15:29] NLW: Like, it'd be one thing if Just musicians were excited about Suno and using it but what you're seeing is tons of people who just like music all of a sudden like playing around with it and finding themselves kind of down that rabbit hole, which I think is kind of like the highest compliment that you can give one of these startups at the[00:15:45] swyx: early days of it.[00:15:46] swyx: Yeah, I, you know, I, I asked them directly, you know, in the interview about whether they consider themselves mid journey for music. And he had a more sort of nuanced response there, but I think that probably the business model is going to be very similar because he's focused on the B2C element of that. So yeah, I mean, you know, just to, just to tie back to the question about, you know, You know, large multi modality companies versus small dedicated modality companies.[00:16:10] swyx: Yeah, highly recommend people to read the Sora blog posts and then read through to the Dali blog posts because they, they strongly correlated themselves with the same synthetic data bootstrapping methods as Dali. And I think once you make those connections, you're like, oh, like it, it, it is beneficial to have multiple state of the art models in house that all help each other.[00:16:28] swyx: And these, this, that's the one thing that a dedicated modality company cannot do.[00:16:34] The GPT-4 Class Landscape[00:16:34] NLW: So I, I wanna jump, I wanna kind of build off that and, and move into the sort of like updated GPT-4 class landscape. 'cause that's obviously been another big change over the last couple months. But for the sake of completeness, is there anything that's worth touching on with with sort of the quality?[00:16:46] NLW: Quality data or sort of a rag ops wars just in terms of, you know, anything that's changed, I guess, for you fundamentally in the last couple of months about where those things stand.[00:16:55] swyx: So I think we're going to talk about rag for the Gemini and Clouds discussion later. And so maybe briefly discuss the data piece.[00:17:03] Data War: Reddit x Google[00:17:03] swyx: I think maybe the only new thing was this Reddit deal with Google for like a 60 million dollar deal just ahead of their IPO, very conveniently turning Reddit into a AI data company. Also, very, very interestingly, a non exclusive deal, meaning that Reddit can resell that data to someone else. And it probably does become table stakes.[00:17:23] swyx: A lot of people don't know, but a lot of the web text dataset that originally started for GPT 1, 2, and 3 was actually scraped from GitHub. from Reddit at least the sort of vote scores. And I think, I think that's a, that's a very valuable piece of information. So like, yeah, I think people are figuring out how to pay for data.[00:17:40] swyx: People are suing each other over data. This, this, this war is, you know, definitely very, very much heating up. And I don't think, I don't see it getting any less intense. I, you know, next to GPUs, data is going to be the most expensive thing in, in a model stack company. And. You know, a lot of people are resorting to synthetic versions of it, which may or may not be kosher based on how far along or how commercially blessed the, the forms of creating that synthetic data are.[00:18:11] swyx: I don't know if Alessio, you have any other interactions with like Data source companies, but that's my two cents.[00:18:17] Alessio: Yeah yeah, I actually saw Quentin Anthony from Luther. ai at GTC this week. He's also been working on this. I saw Technium. He's also been working on the data side. I think especially in open source, people are like, okay, if everybody is putting the gates up, so to speak, to the data we need to make it easier for people that don't have 50 million a year to get access to good data sets.[00:18:38] Alessio: And Jensen, at his keynote, he did talk about synthetic data a little bit. So I think that's something that we'll definitely hear more and more of in the enterprise, which never bodes well, because then all the, all the people with the data are like, Oh, the enterprises want to pay now? Let me, let me put a pay here stripe link so that they can give me 50 million.[00:18:57] Alessio: But it worked for Reddit. I think the stock is up. 40 percent today after opening. So yeah, I don't know if it's all about the Google deal, but it's obviously Reddit has been one of those companies where, hey, you got all this like great community, but like, how are you going to make money? And like, they try to sell the avatars.[00:19:15] Alessio: I don't know if that it's a great business for them. The, the data part sounds as an investor, you know, the data part sounds a lot more interesting than, than consumer[00:19:25] swyx: cosmetics. Yeah, so I think, you know there's more questions around data you know, I think a lot of people are talking about the interview that Mira Murady did with the Wall Street Journal, where she, like, just basically had no, had no good answer for where they got the data for Sora.[00:19:39] swyx: I, I think this is where, you know, there's, it's in nobody's interest to be transparent about data, and it's, it's kind of sad for the state of ML and the state of AI research but it is what it is. We, we have to figure this out as a society, just like we did for music and music sharing. You know, in, in sort of the Napster to Spotify transition, and that might take us a decade.[00:19:59] swyx: Yeah, I[00:20:00] NLW: do. I, I agree. I think, I think that you're right to identify it, not just as that sort of technical problem, but as one where society has to have a debate with itself. Because I think that there's, if you rationally within it, there's Great kind of points on all side, not to be the sort of, you know, person who sits in the middle constantly, but it's why I think a lot of these legal decisions are going to be really important because, you know, the job of judges is to listen to all this stuff and try to come to things and then have other judges disagree.[00:20:24] NLW: And, you know, and have the rest of us all debate at the same time. By the way, as a total aside, I feel like the synthetic data right now is like eggs in the 80s and 90s. Like, whether they're good for you or bad for you, like, you know, we, we get one study that's like synthetic data, you know, there's model collapse.[00:20:42] NLW: And then we have like a hint that llama, you know, to the most high performance version of it, which was one they didn't release was trained on synthetic data. So maybe it's good. It's like, I just feel like every, every other week I'm seeing something sort of different about whether it's a good or bad for, for these models.[00:20:56] swyx: Yeah. The branding of this is pretty poor. I would kind of tell people to think about it like cholesterol. There's good cholesterol, bad cholesterol. And you can have, you know, good amounts of both. But at this point, it is absolutely without a doubt that most large models from here on out will all be trained as some kind of synthetic data and that is not a bad thing.[00:21:16] swyx: There are ways in which you can do it poorly. Whether it's commercial, you know, in terms of commercial sourcing or in terms of the model performance. But it's without a doubt that good synthetic data is going to help your model. And this is just a question of like where to obtain it and what kinds of synthetic data are valuable.[00:21:36] swyx: You know, if even like alpha geometry, you know, was, was a really good example from like earlier this year.[00:21:42] NLW: If you're using the cholesterol analogy, then my, then my egg thing can't be that far off. Let's talk about the sort of the state of the art and the, and the GPT 4 class landscape and how that's changed.[00:21:53] Gemini 1.5 vs Claude 3[00:21:53] NLW: Cause obviously, you know, sort of the, the two big things or a couple of the big things that have happened. Since we last talked, we're one, you know, Gemini first announcing that a model was coming and then finally it arriving, and then very soon after a sort of a different model arriving from Gemini and and Cloud three.[00:22:11] NLW: So I guess, you know, I'm not sure exactly where the right place to start with this conversation is, but, you know, maybe very broadly speaking which of these do you think have made a bigger impact? Thank you.[00:22:20] Alessio: Probably the one you can use, right? So, Cloud. Well, I'm sure Gemini is going to be great once they let me in, but so far I haven't been able to.[00:22:29] Alessio: I use, so I have this small podcaster thing that I built for our podcast, which does chapters creation, like named entity recognition, summarization, and all of that. Cloud Tree is, Better than GPT 4. Cloud2 was unusable. So I use GPT 4 for everything. And then when Opus came out, I tried them again side by side and I posted it on, on Twitter as well.[00:22:53] Alessio: Cloud is better. It's very good, you know, it's much better, it seems to me, it's much better than GPT 4 at doing writing that is more, you know, I don't know, it just got good vibes, you know, like the GPT 4 text, you can tell it's like GPT 4, you know, it's like, it always uses certain types of words and phrases and, you know, maybe it's just me because I've now done it for, you know, So, I've read like 75, 80 generations of these things next to each other.[00:23:21] Alessio: Clutter is really good. I know everybody is freaking out on twitter about it, my only experience of this is much better has been on the podcast use case. But I know that, you know, Quran from from News Research is a very big opus pro, pro opus person. So, I think that's also It's great to have people that actually care about other models.[00:23:40] Alessio: You know, I think so far to a lot of people, maybe Entropic has been the sibling in the corner, you know, it's like Cloud releases a new model and then OpenAI releases Sora and like, you know, there are like all these different things, but yeah, the new models are good. It's interesting.[00:23:55] NLW: My my perception is definitely that just, just observationally, Cloud 3 is certainly the first thing that I've seen where lots of people.[00:24:06] NLW: They're, no one's debating evals or anything like that. They're talking about the specific use cases that they have, that they used to use chat GPT for every day, you know, day in, day out, that they've now just switched over. And that has, I think, shifted a lot of the sort of like vibe and sentiment in the space too.[00:24:26] NLW: And I don't necessarily think that it's sort of a A like full you know, sort of full knock. Let's put it this way. I think it's less bad for open AI than it is good for anthropic. I think that because GPT 5 isn't there, people are not quite willing to sort of like, you know get overly critical of, of open AI, except in so far as they're wondering where GPT 5 is.[00:24:46] NLW: But I do think that it makes, Anthropic look way more credible as a, as a, as a player, as a, you know, as a credible sort of player, you know, as opposed to to, to where they were.[00:24:57] Alessio: Yeah. And I would say the benchmarks veil is probably getting lifted this year. I think last year. People were like, okay, this is better than this on this benchmark, blah, blah, blah, because maybe they did not have a lot of use cases that they did frequently.[00:25:11] Alessio: So it's hard to like compare yourself. So you, you defer to the benchmarks. I think now as we go into 2024, a lot of people have started to use these models from, you know, from very sophisticated things that they run in production to some utility that they have on their own. Now they can just run them side by side.[00:25:29] Alessio: And it's like, Hey, I don't care that like. The MMLU score of Opus is like slightly lower than GPT 4. It just works for me, you know, and I think that's the same way that traditional software has been used by people, right? Like you just strive for yourself and like, which one does it work, works best for you?[00:25:48] Alessio: Like nobody looks at benchmarks outside of like sales white papers, you know? And I think it's great that we're going more in that direction. We have a episode with Adapt coming out this weekend. I'll and some of their model releases, they specifically say, We do not care about benchmarks, so we didn't put them in, you know, because we, we don't want to look good on them.[00:26:06] Alessio: We just want the product to work. And I think more and more people will, will[00:26:09] swyx: go that way. Yeah. I I would say like, it does take the wind out of the sails for GPT 5, which I know where, you know, Curious about later on. I think anytime you put out a new state of the art model, you have to break through in some way.[00:26:21] swyx: And what Claude and Gemini have done is effectively take away any advantage to saying that you have a million token context window. Now everyone's just going to be like, Oh, okay. Now you just match the other two guys. And so that puts An insane amount of pressure on what gpt5 is going to be because it's just going to have like the only option it has now because all the other models are multimodal all the other models are long context all the other models have perfect recall gpt5 has to match everything and do more to to not be a flop[00:26:58] AI Breakdown Part 2[00:26:58] NLW: hello friends back again with part two if you haven't heard part one of this conversation i suggest you go check it out but to be honest they are kind of actually separable In this conversation, we get into a topic that I think Alessio and Swyx are very well positioned to discuss, which is what developers care about right now, what people are trying to build around.[00:27:16] NLW: I honestly think that one of the best ways to see the future in an industry like AI is to try to dig deep on what developers and entrepreneurs are attracted to build, even if it hasn't made it to the news pages yet. So consider this your preview of six months from now, and let's dive in. Let's bring it to the GPT 5 conversation.[00:27:33] Next Frontiers: Llama 3, GPT-5, Gemini 2, Claude 4[00:27:33] NLW: I mean, so, so I think that that's a great sort of assessment of just how the stakes have been raised, you know is your, I mean, so I guess maybe, maybe I'll, I'll frame this less as a question, just sort of something that, that I, that I've been watching right now, the only thing that makes sense to me with how.[00:27:50] NLW: Fundamentally unbothered and unstressed OpenAI seems about everything is that they're sitting on something that does meet all that criteria, right? Because, I mean, even in the Lex Friedman interview that, that Altman recently did, you know, he's talking about other things coming out first. He's talking about, he's just like, he, listen, he, he's good and he could play nonchalant, you know, if he wanted to.[00:28:13] NLW: So I don't want to read too much into it, but. You know, they've had so long to work on this, like unless that we are like really meaningfully running up against some constraint, it just feels like, you know, there's going to be some massive increase, but I don't know. What do you guys think?[00:28:28] swyx: Hard to speculate.[00:28:29] swyx: You know, at this point, they're, they're pretty good at PR and they're not going to tell you anything that they don't want to. And he can tell you one thing and change their minds the next day. So it's, it's, it's really, you know, I've always said that model version numbers are just marketing exercises, like they have something and it's always improving and at some point you just cut it and decide to call it GPT 5.[00:28:50] swyx: And it's more just about defining an arbitrary level at which they're ready and it's up to them on what ready means. We definitely did see some leaks on GPT 4. 5, as I think a lot of people reported and I'm not sure if you covered it. So it seems like there might be an intermediate release. But I did feel, coming out of the Lex Friedman interview, that GPT 5 was nowhere near.[00:29:11] swyx: And you know, it was kind of a sharp contrast to Sam talking at Davos in February, saying that, you know, it was his top priority. So I find it hard to square. And honestly, like, there's also no point Reading too much tea leaves into what any one person says about something that hasn't happened yet or has a decision that hasn't been taken yet.[00:29:31] swyx: Yeah, that's, that's my 2 cents about it. Like, calm down, let's just build .[00:29:35] Alessio: Yeah. The, the February rumor was that they were gonna work on AI agents, so I don't know, maybe they're like, yeah,[00:29:41] swyx: they had two agent two, I think two agent projects, right? One desktop agent and one sort of more general yeah, sort of GPTs like agent and then Andre left, so he was supposed to be the guy on that.[00:29:52] swyx: What did Andre see? What did he see? I don't know. What did he see?[00:29:56] Alessio: I don't know. But again, it's just like the rumors are always floating around, you know but I think like, this is, you know, we're not going to get to the end of the year without Jupyter you know, that's definitely happening. I think the biggest question is like, are Anthropic and Google.[00:30:13] Alessio: Increasing the pace, you know, like it's the, it's the cloud four coming out like in 12 months, like nine months. What's the, what's the deal? Same with Gemini. They went from like one to 1. 5 in like five days or something. So when's Gemini 2 coming out, you know, is that going to be soon? I don't know.[00:30:31] Alessio: There, there are a lot of, speculations, but the good thing is that now you can see a world in which OpenAI doesn't rule everything. You know, so that, that's the best, that's the best news that everybody got, I would say.[00:30:43] swyx: Yeah, and Mistral Large also dropped in the last month. And, you know, not as, not quite GPT 4 class, but very good from a new startup.[00:30:52] swyx: So yeah, we, we have now slowly changed in landscape, you know. In my January recap, I was complaining that nothing's changed in the landscape for a long time. But now we do exist in a world, sort of a multipolar world where Cloud and Gemini are legitimate challengers to GPT 4 and hopefully more will emerge as well hopefully from meta.[00:31:11] Open Source Models - Mistral, Grok[00:31:11] NLW: So speak, let's actually talk about sort of the open source side of this for a minute. So Mistral Large, notable because it's, it's not available open source in the same way that other things are, although I think my perception is that the community has largely given them Like the community largely recognizes that they want them to keep building open source stuff and they have to find some way to fund themselves that they're going to do that.[00:31:27] NLW: And so they kind of understand that there's like, they got to figure out how to eat, but we've got, so, you know, there there's Mistral, there's, I guess, Grok now, which is, you know, Grok one is from, from October is, is open[00:31:38] swyx: sourced at, yeah. Yeah, sorry, I thought you thought you meant Grok the chip company.[00:31:41] swyx: No, no, no, yeah, you mean Twitter Grok.[00:31:43] NLW: Although Grok the chip company, I think is even more interesting in some ways, but and then there's the, you know, obviously Llama3 is the one that sort of everyone's wondering about too. And, you know, my, my sense of that, the little bit that, you know, Zuckerberg was talking about Llama 3 earlier this year, suggested that, at least from an ambition standpoint, he was not thinking about how do I make sure that, you know, meta content, you know, keeps, keeps the open source thrown, you know, vis a vis Mistral.[00:32:09] NLW: He was thinking about how you go after, you know, how, how he, you know, releases a thing that's, you know, every bit as good as whatever OpenAI is on at that point.[00:32:16] Alessio: Yeah. From what I heard in the hallways at, at GDC, Llama 3, the, the biggest model will be, you 260 to 300 billion parameters, so that that's quite large.[00:32:26] Alessio: That's not an open source model. You know, you cannot give people a 300 billion parameters model and ask them to run it. You know, it's very compute intensive. So I think it is, it[00:32:35] swyx: can be open source. It's just, it's going to be difficult to run, but that's a separate question.[00:32:39] Alessio: It's more like, as you think about what they're doing it for, you know, it's not like empowering the person running.[00:32:45] Alessio: llama. On, on their laptop, it's like, oh, you can actually now use this to go after open AI, to go after Anthropic, to go after some of these companies at like the middle complexity level, so to speak. Yeah. So obviously, you know, we estimate Gentala on the podcast, they're doing a lot here, they're making PyTorch better.[00:33:03] Alessio: You know, they want to, that's kind of like maybe a little bit of a shorted. Adam Bedia, in a way, trying to get some of the CUDA dominance out of it. Yeah, no, it's great. The, I love the duck destroying a lot of monopolies arc. You know, it's, it's been very entertaining. Let's bridge[00:33:18] NLW: into the sort of big tech side of this, because this is obviously like, so I think actually when I did my episode, this was one of the I added this as one of as an additional war that, that's something that I'm paying attention to.[00:33:29] NLW: So we've got Microsoft's moves with inflection, which I think pretend, potentially are being read as A shift vis a vis the relationship with OpenAI, which also the sort of Mistral large relationship seems to reinforce as well. We have Apple potentially entering the race, finally, you know, giving up Project Titan and and, and kind of trying to spend more effort on this.[00:33:50] NLW: Although, Counterpoint, we also have them talking about it, or there being reports of a deal with Google, which, you know, is interesting to sort of see what their strategy there is. And then, you know, Meta's been largely quiet. We kind of just talked about the main piece, but, you know, there's, and then there's spoilers like Elon.[00:34:07] NLW: I mean, you know, what, what of those things has sort of been most interesting to you guys as you think about what's going to shake out for the rest of this[00:34:13] Apple MM1[00:34:13] swyx: year? I'll take a crack. So the reason we don't have a fifth war for the Big Tech Wars is that's one of those things where I just feel like we don't cover differently from other media channels, I guess.[00:34:26] swyx: Sure, yeah. In our anti interestness, we actually say, like, we try not to cover the Big Tech Game of Thrones, or it's proxied through Twitter. You know, all the other four wars anyway, so there's just a lot of overlap. Yeah, I think absolutely, personally, the most interesting one is Apple entering the race.[00:34:41] swyx: They actually released, they announced their first large language model that they trained themselves. It's like a 30 billion multimodal model. People weren't that impressed, but it was like the first time that Apple has kind of showcased that, yeah, we're training large models in house as well. Of course, like, they might be doing this deal with Google.[00:34:57] swyx: I don't know. It sounds very sort of rumor y to me. And it's probably, if it's on device, it's going to be a smaller model. So something like a Jemma. It's going to be smarter autocomplete. I don't know what to say. I'm still here dealing with, like, Siri, which hasn't, probably hasn't been updated since God knows when it was introduced.[00:35:16] swyx: It's horrible. I, you know, it, it, it makes me so angry. So I, I, one, as an Apple customer and user, I, I'm just hoping for better AI on Apple itself. But two, they are the gold standard when it comes to local devices, personal compute and, and trust, like you, you trust them with your data. And. I think that's what a lot of people are looking for in AI, that they have, they love the benefits of AI, they don't love the downsides, which is that you have to send all your data to some cloud somewhere.[00:35:45] swyx: And some of this data that we're going to feed AI is just the most personal data there is. So Apple being like one of the most trusted personal data companies, I think it's very important that they enter the AI race, and I hope to see more out of them.[00:35:58] Alessio: To me, the, the biggest question with the Google deal is like, who's paying who?[00:36:03] Alessio: Because for the browsers, Google pays Apple like 18, 20 billion every year to be the default browser. Is Google going to pay you to have Gemini or is Apple paying Google to have Gemini? I think that's, that's like what I'm most interested to figure out because with the browsers, it's like, it's the entry point to the thing.[00:36:21] Alessio: So it's really valuable to be the default. That's why Google pays. But I wonder if like the perception in AI is going to be like, Hey. You just have to have a good local model on my phone to be worth me purchasing your device. And that was, that's kind of drive Apple to be the one buying the model. But then, like Shawn said, they're doing the MM1 themselves.[00:36:40] Alessio: So are they saying we do models, but they're not as good as the Google ones? I don't know. The whole thing is, it's really confusing, but. It makes for great meme material on on Twitter.[00:36:51] swyx: Yeah, I mean, I think, like, they are possibly more than OpenAI and Microsoft and Amazon. They are the most full stack company there is in computing, and so, like, they own the chips, man.[00:37:05] swyx: Like, they manufacture everything so if, if, if there was a company that could do that. You know, seriously challenge the other AI players. It would be Apple. And it's, I don't think it's as hard as self driving. So like maybe they've, they've just been investing in the wrong thing this whole time. We'll see.[00:37:21] swyx: Wall Street certainly thinks[00:37:22] NLW: so. Wall Street loved that move, man. There's a big, a big sigh of relief. Well, let's, let's move away from, from sort of the big stuff. I mean, the, I think to both of your points, it's going to.[00:37:33] Meta's $800b AI rebrand[00:37:33] NLW: Can I, can[00:37:34] swyx: I, can I, can I jump on factoid about this, this Wall Street thing? I went and looked at when Meta went from being a VR company to an AI company.[00:37:44] swyx: And I think the stock I'm trying to look up the details now. The stock has gone up 187% since Lamo one. Yeah. Which is $830 billion in market value created in the past year. . Yeah. Yeah.[00:37:57] NLW: It's, it's, it's like, remember if you guys haven't Yeah. If you haven't seen the chart, it's actually like remarkable.[00:38:02] NLW: If you draw a little[00:38:03] swyx: arrow on it, it's like, no, we're an AI company now and forget the VR thing.[00:38:10] NLW: It's it, it is an interesting, no, it's, I, I think, alessio, you called it sort of like Zuck's Disruptor Arc or whatever. He, he really does. He is in the midst of a, of a total, you know, I don't know if it's a redemption arc or it's just, it's something different where, you know, he, he's sort of the spoiler.[00:38:25] NLW: Like people loved him just freestyle talking about why he thought they had a better headset than Apple. But even if they didn't agree, they just loved it. He was going direct to camera and talking about it for, you know, five minutes or whatever. So that, that's a fascinating shift that I don't think anyone had on their bingo card, you know, whatever, two years ago.[00:38:41] NLW: Yeah. Yeah,[00:38:42] swyx: we still[00:38:43] Alessio: didn't see and fight Elon though, so[00:38:45] swyx: that's what I'm really looking forward to. I mean, hey, don't, don't, don't write it off, you know, maybe just these things take a while to happen. But we need to see and fight in the Coliseum. No, I think you know, in terms of like self management, life leadership, I think he has, there's a lot of lessons to learn from him.[00:38:59] swyx: You know he might, you know, you might kind of quibble with, like, the social impact of Facebook, but just himself as a in terms of personal growth and, and, you know, Per perseverance through like a lot of change and you know, everyone throwing stuff his way. I think there's a lot to say about like, to learn from, from Zuck, which is crazy 'cause he's my age.[00:39:18] swyx: Yeah. Right.[00:39:20] AI Engineer landscape - from baby AGIs to vertical Agents[00:39:20] NLW: Awesome. Well, so, so one of the big things that I think you guys have, you know, distinct and, and unique insight into being where you are and what you work on is. You know, what developers are getting really excited about right now. And by that, I mean, on the one hand, certainly, you know, like startups who are actually kind of formalized and formed to startups, but also, you know, just in terms of like what people are spending their nights and weekends on what they're, you know, coming to hackathons to do.[00:39:45] NLW: And, you know, I think it's a, it's a, it's, it's such a fascinating indicator for, for where things are headed. Like if you zoom back a year, right now was right when everyone was getting so, so excited about. AI agent stuff, right? Auto, GPT and baby a GI. And these things were like, if you dropped anything on YouTube about those, like instantly tens of thousands of views.[00:40:07] NLW: I know because I had like a 50,000 view video, like the second day that I was doing the show on YouTube, you know, because I was talking about auto GPT. And so anyways, you know, obviously that's sort of not totally come to fruition yet, but what are some of the trends in what you guys are seeing in terms of people's, people's interest and, and, and what people are building?[00:40:24] Alessio: I can start maybe with the agents part and then I know Shawn is doing a diffusion meetup tonight. There's a lot of, a lot of different things. The, the agent wave has been the most interesting kind of like dream to reality arc. So out of GPT, I think they went, From zero to like 125, 000 GitHub stars in six weeks, and then one year later, they have 150, 000 stars.[00:40:49] Alessio: So there's kind of been a big plateau. I mean, you might say there are just not that many people that can start it. You know, everybody already started it. But the promise of, hey, I'll just give you a goal, and you do it. I think it's like, amazing to get people's imagination going. You know, they're like, oh, wow, this This is awesome.[00:41:08] Alessio: Everybody, everybody can try this to do anything. But then as technologists, you're like, well, that's, that's just like not possible, you know, we would have like solved everything. And I think it takes a little bit to go from the promise and the hope that people show you to then try it yourself and going back to say, okay, this is not really working for me.[00:41:28] Alessio: And David Wong from Adept, you know, they in our episode, he specifically said. We don't want to do a bottom up product. You know, we don't want something that everybody can just use and try because it's really hard to get it to be reliable. So we're seeing a lot of companies doing vertical agents that are narrow for a specific domain, and they're very good at something.[00:41:49] Alessio: Mike Conover, who was at Databricks before, is also a friend of Latentspace. He's doing this new company called BrightWave doing AI agents for financial research, and that's it, you know, and they're doing very well. There are other companies doing it in security, doing it in compliance, doing it in legal.[00:42:08] Alessio: All of these things that like, people, nobody just wakes up and say, Oh, I cannot wait to go on AutoGPD and ask it to do a compliance review of my thing. You know, just not what inspires people. So I think the gap on the developer side has been the more bottom sub hacker mentality is trying to build this like very Generic agents that can do a lot of open ended tasks.[00:42:30] Alessio: And then the more business side of things is like, Hey, If I want to raise my next round, I can not just like sit around the mess, mess around with like super generic stuff. I need to find a use case that really works. And I think that that is worth for, for a lot of folks in parallel, you have a lot of companies doing evals.[00:42:47] Alessio: There are dozens of them that just want to help you measure how good your models are doing. Again, if you build evals, you need to also have a restrained surface area to actually figure out whether or not it's good, right? Because you cannot eval anything on everything under the sun. So that's another category where I've seen from the startup pitches that I've seen, there's a lot of interest in, in the enterprise.[00:43:11] Alessio: It's just like really. Fragmented because the production use cases are just coming like now, you know, there are not a lot of long established ones to, to test against. And so does it, that's kind of on the virtual agents and then the robotic side it's probably been the thing that surprised me the most at NVIDIA GTC, the amount of robots that were there that were just like robots everywhere.[00:43:33] Alessio: Like, both in the keynote and then on the show floor, you would have Boston Dynamics dogs running around. There was, like, this, like fox robot that had, like, a virtual face that, like, talked to you and, like, moved in real time. There were industrial robots. NVIDIA did a big push on their own Omniverse thing, which is, like, this Digital twin of whatever environments you're in that you can use to train the robots agents.[00:43:57] Alessio: So that kind of takes people back to the reinforcement learning days, but yeah, agents, people want them, you know, people want them. I give a talk about the, the rise of the full stack employees and kind of this future, the same way full stack engineers kind of work across the stack. In the future, every employee is going to interact with every part of the organization through agents and AI enabled tooling.[00:44:17] Alessio: This is happening. It just needs to be a lot more narrow than maybe the first approach that we took, which is just put a string in AutoGPT and pray. But yeah, there's a lot of super interesting stuff going on.[00:44:27] swyx: Yeah. Well, he Let's recover a lot of stuff there. I'll separate the robotics piece because I feel like that's so different from the software world.[00:44:34] swyx: But yeah, we do talk to a lot of engineers and you know, that this is our sort of bread and butter. And I do agree that vertical agents have worked out a lot better than the horizontal ones. I think all You know, the point I'll make here is just the reason AutoGPT and maybe AGI, you know, it's in the name, like they were promising AGI.[00:44:53] swyx: But I think people are discovering that you cannot engineer your way to AGI. It has to be done at the model level and all these engineering, prompt engineering hacks on top of it weren't really going to get us there in a meaningful way without much further, you know, improvements in the models. I would say, I'll go so far as to say, even Devin, which is, I would, I think the most advanced agent that we've ever seen, still requires a lot of engineering and still probably falls apart a lot in terms of, like, practical usage.[00:45:22] swyx: Or it's just, Way too slow and expensive for, you know, what it's, what it's promised compared to the video. So yeah, that's, that's what, that's what happened with agents from, from last year. But I, I do, I do see, like, vertical agents being very popular and, and sometimes you, like, I think the word agent might even be overused sometimes.[00:45:38] swyx: Like, people don't really care whether or not you call it an AI agent, right? Like, does it replace boring menial tasks that I do That I might hire a human to do, or that the human who is hired to do it, like, actually doesn't really want to do. And I think there's absolutely ways in sort of a vertical context that you can actually go after very routine tasks that can be scaled out to a lot of, you know, AI assistants.[00:46:01] swyx: So, so yeah, I mean, and I would, I would sort of basically plus one what let's just sit there. I think it's, it's very, very promising and I think more people should work on it, not less. Like there's not enough people. Like, we, like, this should be the, the, the main thrust of the AI engineer is to look out, look for use cases and, and go to a production with them instead of just always working on some AGI promising thing that never arrives.[00:46:21] swyx: I,[00:46:22] NLW: I, I can only add that so I've been fiercely making tutorials behind the scenes around basically everything you can imagine with AI. We've probably done, we've done about 300 tutorials over the last couple of months. And the verticalized anything, right, like this is a solution for your particular job or role, even if it's way less interesting or kind of sexy, it's like so radically more useful to people in terms of intersecting with how, like those are the ways that people are actually.[00:46:50] NLW: Adopting AI in a lot of cases is just a, a, a thing that I do over and over again. By the way, I think that's the same way that even the generalized models are getting adopted. You know, it's like, I use midjourney for lots of stuff, but the main thing I use it for is YouTube thumbnails every day. Like day in, day out, I will always do a YouTube thumbnail, you know, or two with, with Midjourney, right?[00:47:09] NLW: And it's like you can, you can start to extrapolate that across a lot of things and all of a sudden, you know, a AI doesn't. It looks revolutionary because of a million small changes rather than one sort of big dramatic change. And I think that the verticalization of agents is sort of a great example of how that's[00:47:26] swyx: going to play out too.[00:47:28] Adept episode - Screen Multimodality[00:47:28] swyx: So I'll have one caveat here, which is I think that Because multi modal models are now commonplace, like Cloud, Gemini, OpenAI, all very very easily multi modal, Apple's easily multi modal, all this stuff. There is a switch for agents for sort of general desktop browsing that I think people so much for joining us today, and we'll see you in the next video.[00:48:04] swyx: Version of the the agent where they're not specifically taking in text or anything They're just watching your screen just like someone else would and and I'm piloting it by vision And you know in the the episode with David that we'll have dropped by the time that this this airs I think I think that is the promise of adept and that is a promise of what a lot of these sort of desktop agents Are and that is the more general purpose system That could be as big as the browser, the operating system, like, people really want to build that foundational piece of software in AI.[00:48:38] swyx: And I would see, like, the potential there for desktop agents being that, that you can have sort of self driving computers. You know, don't write the horizontal piece out. I just think we took a while to get there.[00:48:48] NLW: What else are you guys seeing that's interesting to you? I'm looking at your notes and I see a ton of categories.[00:48:54] Top Model Research from January Recap[00:48:54] swyx: Yeah so I'll take the next two as like as one category, which is basically alternative architectures, right? The two main things that everyone following AI kind of knows now is, one, the diffusion architecture, and two, the let's just say the, Decoder only transformer architecture that is popularized by GPT.[00:49:12] swyx: You can read, you can look on YouTube for thousands and thousands of tutorials on each of those things. What we are talking about here is what's next, what people are researching, and what could be on the horizon that takes the place of those other two things. So first of all, we'll talk about transformer architectures and then diffusion.[00:49:25] swyx: So transformers the, the two leading candidates are effectively RWKV and the state space models the most recent one of which is Mamba, but there's others like the Stripe, ENA, and the S four H three stuff coming out of hazy research at Stanford. And all of those are non quadratic language models that scale the promise to scale a lot better than the, the traditional transformer.[00:49:47] swyx: That this might be too theoretical for most people right now, but it's, it's gonna be. It's gonna come out in weird ways, where, imagine if like, Right now the talk of the town is that Claude and Gemini have a million tokens of context and like whoa You can put in like, you know, two hours of video now, okay But like what if you put what if we could like throw in, you know, two hundred thousand hours of video?[00:50:09] swyx: Like how does that change your usage of AI? What if you could throw in the entire genetic sequence of a human and like synthesize new drugs. Like, well, how does that change things? Like, we don't know because we haven't had access to this capability being so cheap before. And that's the ultimate promise of these two models.[00:50:28] swyx: They're not there yet but we're seeing very, very good progress. RWKV and Mamba are probably the, like, the two leading examples, both of which are open source that you can try them today and and have a lot of progress there. And the, the, the main thing I'll highlight for audio e KV is that at, at the seven B level, they seem to have beat LAMA two in all benchmarks that matter at the same size for the same amount of training as an open source model.[00:50:51] swyx: So that's exciting. You know, they're there, they're seven B now. They're not at seven tb. We don't know if it'll. And then the other thing is diffusion. Diffusions and transformers are are kind of on the collision course. The original stable diffusion already used transformers in in parts of its architecture.[00:51:06] swyx: It seems that transformers are eating more and more of those layers particularly the sort of VAE layer. So that's, the Diffusion Transformer is what Sora is built on. The guy who wrote the Diffusion Transformer paper, Bill Pebbles, is, Bill Pebbles is the lead tech guy on Sora. So you'll just see a lot more Diffusion Transformer stuff going on.[00:51:25] swyx: But there's, there's more sort of experimentation with diffusion. I'm holding a meetup actually here in San Francisco that's gonna be like the state of diffusion, which I'm pretty excited about. Stability's doing a lot of good work. And if you look at the, the architecture of how they're creating Stable Diffusion 3, Hourglass Diffusion, and the inconsistency models, or SDXL Turbo.[00:51:45] swyx: All of these are, like, very, very interesting innovations on, like, the original idea of what Stable Diffusion was. So if you think that it is expensive to create or slow to create Stable Diffusion or an AI generated art, you are not up to date with the latest models. If you think it is hard to create text and images, you are not up to date with the latest models.[00:52:02] swyx: And people still are kind of far behind. The last piece of which is the wildcard I always kind of hold out, which is text diffusion. So Instead of using autogenerative or autoregressive transformers, can you use text to diffuse? So you can use diffusion models to diffuse and create entire chunks of text all at once instead of token by token.[00:52:22] swyx: And that is something that Midjourney confirmed today, because it was only rumored the past few months. But they confirmed today that they were looking into. So all those things are like very exciting new model architectures that are, Maybe something that we'll, you'll see in production two to three years from now.[00:52:37] swyx: So the couple of the trends[00:52:38] NLW: that I want to just get your takes on, because they're sort of something that, that seems like they're coming up are one sort of these, these wearable, you know, kind of passive AI experiences where they're absorbing a lot of what's going on around you and then, and then kind of bringing things back.[00:52:53] NLW: And then the, the other one that I, that I wanted to see if you guys had thoughts on were sort of this next generation of chip companies. Obviously there's a huge amount of emphasis. On on hardware and silicon and, and, and different ways of doing things, but, y
A course for leaders, missionaries, church planters, house church leaders, pastors etc in Koume from 26th - March - 5th April 2024
A course for leaders, missionaries, church planters, house church leaders, pastors etc in Koume from 26th - March - 5th April 2024
XIKERS are in their Beastie Boys era, The Boyz return to their cute days with Nectar, and Day6 welcome us to the show in their latest comeback. Listen as we discuss what happened in the KPOP world this past week!Tune in every Tuesday for a new episode and don't forget to follow our social media and let us know what you think.Time stamps:4:03 - VIXX Hyuk enlisting4:45 - Stray Kids headlining Lollapalooza 2024 in Chicago6:28 - XIKERS - We Don't Stop9:24 - The Boyz - Nectar 15:35 - TNX - Fuego17:35 - Lucy - The knight who can't cry and the silk cradle20:52 - Day6 - Welcome to the Show31:06 - V - Fri(end)s 34:24 - Chungha ft. Hongjoong - Eenie Meenie40:42 - Songs of the WeekListen here!Apple: https://podcasts.apple.com/us/podcast...iHeartRadio: https://www.iheart.com/podcast/269-no...Spotify: https://open.spotify.com/show/4OL4qPj...This week's playlist: https://open.spotify.com/playlist/55wh2iphlsdIhI9BLi2TVJ?si=12d09b3bf69a49bcwww.twitter.com/NYAFangirlswww.twitter.com/HollaItsCarowww.twitter.com/heyitsteeteewww.twitter.com/deekaydi
世の光 2024年3月23日 若月 御名美｜番組お便り紹介ウィーク Day6
今日格言"The only way to do great work is to love what you do." - Steve Jobs 做出伟大的工作的唯一途径是热爱自己的工作。Day 6 挑战问题What are your top accomplishments? What achievements are you most proud of?你最大的成就是什么？你最自豪的成就是什么？My top accomplishments include establishing the first volunteer tour guide service in China and working in several Fortune 500 companies such as Accenture and EA Games. I'm also proud of creating a podcast and having visited, lived, or worked in over 40 countries. I believe I'm most proud of my experiences traveling across Europe through couchsurfing by train and living and traveling for 10 years.我的最大的成就包括创建了中国第一个志愿导游服务，并在多家财富500强公司工作，如埃森哲和艺电游戏。我也为自己创建了一档播客，还访问、居住、工作过40多个国家感到自豪。我认为我最自豪的成就是透过沙发冲浪和火车旅行穿越欧洲，以及在过去的十年里生活和旅行的经历。***为了这个找到IKIGAI/生命目的的系列，我特别制作了一个探索的手册，请大家到我的官方帐号去下载Line的官方帐号是@flywithlily微信的官方帐号是 Englishfit回覆文字ikigai （这个字是日文就是“此生之目的”）我们这个30天的挑战就是基于这个有名的此生目的的一种探索形式。也可以透过我的网站flywithlily.com/30 下载
SojuTalk is back at it again as we discuss releases from V, Wendy, Day6, and VCHA! As always, the Crew keeps you up to date with all the recent Kpop News/Events. And you know we gonna get hype as we declare this week's Spice King and give our State of the Nation!!! Links ◆Email - sojutalkpodcast@gmail.com ◆Discord - discord.gg/3rb74x4 ◆Patreon - patreon.com/sojutalk Timestamps ◆Intro - 0:00 ◆Big New Releases - 1:36 ◆Spice King - 40:49 ◆Show Winners - 48:28 ◆News - 50:06 ◆Afterhours - 1:15:22
21 and 42 Days Session of the School of knowing and serving God in Ndoumbi.
Day6_Q&A Learn more about your ad choices. Visit megaphone.fm/adchoices
데키라 송년회 with 하하, 이이경 & DAY6(데이식스)
© 2020-2025 Ivy Podcast Discovery LLC
