POPULARITY
16 episodes with vram
8 episodes with vram
5 episodes with vram
4 episodes with vram
5 episodes with vram
2 episodes with vram
4 episodes with vram
2 episodes with vram
2 episodes with vram
2 episodes with vram
2 episodes with vram
4 episodes with vram
2 episodes with vram
2 episodes with vram
4 episodes with vram
11 episodes with vram
6 episodes with vram
3 episodes with vram
Paul had a blast at HellmouthCon! The boys talk about DubDub, and Paul is worried about his NAS. Drew gives an update on his local LLM setup and his never ending quest for more VRAM. Recorded 06/18/26 Show Links: Doug Jones Everything Apple Announced at WWDC 2026 in 10 Minutes SWE-Bench Opencode Qwen3-Coder-Next Gigabyte AMD Radeon AI PRO R9700 LM Studio llama.cpp AMD Radeon™ AI PRO Graphics Razer Core X V2 External Graphics Enclosure
La KV Cache se ha convertido en uno de los grandes retos para escalar los LLMs: guardar el contexto de una conversación no significa almacenar texto, sino enormes tensores por cada token y capa del modelo. A partir de ahí aparece el verdadero problema: una conversación larga puede ocupar decenas o cientos de GB, saturar la VRAM de las GPUs y obligar a diseñar sistemas capaces de paginar, compartir, mover y reutilizar esa caché entre GPU, RAM, SSD y red. La idea central: los LLMs modernos no escalan solo con más cálculo, sino gestionando una memoria gigantesca de la forma más inteligente posible. Participan en la tertulia: Paco Zamora, Josu Gorostegui y Guillermo Barbadillo. Recuerda que puedes enviarnos dudas, comentarios y sugerencias en: https://x.com/TERTUL_ia Más info en: https://ironbar.github.io/tertulia_inteligencia_artificial/
Die bisher nur in China veröffentlichte Grafikkarte AMD Radeon RX 9070 GRE mit 12 GB VRAM ist jetzt offiziell weltweit verfügbar, in Deutschland etwa ab 550 Euro erhältlich. Normalerweise würden wir sagen: Mehr Auswahl ist gut für uns Verbraucher. Aber in der aktuellen Marktsituation ergibt diese Grafikkarten keinen Sinn. Zum Zeitpunkt der Aufnahme kostete die deutlich stärkere und mit mehr VRAM ausgestattete 9070 ebenfalls 550 Euro. Ob das so bleibt? Fraglich. Andere alte neue Sachen von AMD sind erfreulicher: Zum 10-Jahre-Jubiläum des Sockel AM4 kommt die erste CPU mit 3D-V-Cache wieder! Ryzen 7 5800X3D ist auch heute noch eine exzellente Gaming-CPU und angesichts der absurden Preise für DDR5-Speicher eine gute Möglichkeit, noch vorhandenen AM4-PCs eine Verlängerung der Lebenszeit zu gönnen. Auch wenn der Preis von 349 Dollar UVP nicht gering ist. Nebenbei verspricht AMD nun, den Sockel AM5 bis mindestens 2029 zu unterstützen. Das geht gut zusammen mit den Gerüchten, Zen 6 für Desktop würde erst 2027 erscheinen. Jensen Huang und Nvidia machen ja nichts unter einer Revolution: Zusammen mit Microsoft wolle man den Windows PC neu erfunden haben. Gemeint ist damit der sog. Superchip RTX Spark, der 10 nicht näher beschriebene Cortex-Kerne von ARM mit einer Blackwell-GPU der Klasse 5070 in einem Package kombiniert. Windows on ARM ist immer noch so eine Sache, aber RTX Spark ist auch weniger für Menschen, sondern mehr für "AI-Agents". Viel Spaß mit Folge 310! Sprecher:innen: Michael Kister, Mohammed Ali DadAudioproduktion: Michael KisterVideoproduktion: Mohammed Ali Dad, Michael KisterText: Michael KisterTitelbild: Mohammed Ali DadBildquellen: SAPPHIRE Technology Limited/Foto von Zelch Csaba (Pexels)Aufnahmedatum: 05.06.2026 Besucht unsim Discord https://discord.gg/SneNarVCBMauf Bluesky https://bsky.app/profile/technikquatsch.deauf Youtube https://www.youtube.com/@technikquatsch https://www.youtube.com/@technikquatschgamingauf TikTok https://www.tiktok.com/@technikquatschauf Instagram https://www.instagram.com/technikquatschauf Twitch https://www.twitch.tv/technikquatsch RSS-Feed https://technikquatsch.de/feed/podcast/Spotify https://open.spotify.com/show/62ZVb7ZvmdtXqqNmnZLF5uApple Podcasts https://podcasts.apple.com/de/podcast/technikquatsch/id1510030975Deezer https://www.deezer.com/de/show/1162032 00:00:00 Herzlich willkommen zu Technikquatsch Folge 310! Mo nimmt ab und bereitet sich auf Freiburger Business Lauf vor. 00:13:35 AMD Radeon RX 9070 GRE für ca. 550 Euro verfügbar, 9070 und RTX 5070 kosten etwa gleich bei höherer Performance.https://www.computerbase.de/news/grafikkarten/radeon-rx-9070-gre-die-china-version-mit-12-gb-kommt-weltweit-auf-den-markt.97586/ 00:24:19 AMD Ryzen Zen 6 und Intel Nova Lake sollen wohl erst 2027 erscheinen.https://www.heise.de/news/Durststrecke-Neue-Desktop-Prozessoren-kommen-erst-2027-11316246.html 00:29:00 Google-Entwickler machen sich intern mit Memes über den eigenen KI-Slop lustig.https://www.golem.de/news/ki-slop-googler-laestern-intern-ueber-ki-tools-2606-209431.html 00:40:05 AMD Ryzen 7 5800X3D Anniversary Edition zu 10 Jahren AM4 kostet 349 Dollar.https://www.computerbase.de/news/prozessoren/10-years-anniversary-edition-der-amd-ryzen-7-5800x3d-fuer-am4-ist-guenstiger-zurueck.97614/ 00:43:11 AMD verspricht Unterstützung für AM5 bis mindestens 2029.https://www.computerbase.de/news/prozessoren/auch-noch-zen-7-amd-will-am5-bis-mindestens-2029-mit-neuen-cpus-versorgen.97617/ 00:47:51 Nvidia will mit "Superchip" RTX Spark den Windows PC neu erfunden haben.https://www.computerbase.de/news/pc-systeme/rtx-spark-superchip-nvidia-greift-amd-und-intel-im-windows-pc-markt-an.97539/ 00:55:02 Offizielles Fußballspiel zu WM FIFA World Cup: Launch Edition von Netflix wird auf den TV gestreamt und mit dem Smartphone gesteuert.https://about.netflix.com/en/news/new-fifa-world-cup-launch-edition-game-exclusively-on-netflix 01:00:06 Sony Playstation State of Play zum Summer Game Fest 2026 https://www.youtube.com/watch?v=RvyezhN16IU; Wolverine https://www.youtube.com/watch?v=OiBo_NgYI5Q01:06:43 God of War: Laufey https://www.youtube.com/watch?v=HLMX2w3cwuE01:15:05 "alles" kommt im September 202601:18:13 Onimusha: Way of the Sword Demo https://www.youtube.com/watch?v=LNq35HHUtNc 01:19:35 Neue Stargate-Serie von Amazon/MGM kommt doch nicht.https://variety.com/2026/tv/news/stargate-tv-series-martin-gero-scrapped-amazon-1236765061/ 01:23:47 Vielen Dank! Bis zum nächsten Mal!
Google released Gemma 4 12B, a multimodal model that runs locally on 16GB devices. TSMC's CEO warned chip supply won't meet demand for years. Ramp raised $750M at $44B, and Anthropic says 80%+ of its merged code is now Claude-authored. Google releases Gemma 4 12B, an 11.95B-parameter unified, encoder-free open multimodal model that can run locally on devices with 16GB of VRAM or unified memory (VentureBeat) Public First: 26% of Americans support increased data center construction, the lowest share among 15 large countries, such as Brazil, Japan, the UK, and Canada (FT) Sam Altman and Dario Amodei are among the signatories on a public letter urging improved tracking of synthetic DNA that could be used in AI-developed bioweapons (Wired) TSMC CEO C.C. Wei says the company won't be able to fulfill the demand led by US customers even as more capacity comes online in the US over the next few years (Bloomberg) Corporate spending management platform Ramp raised $750M at a $44B valuation led by Iconiq, Singapore's GIC, and the OTPP, taking its total funding to $3B (Bloomberg) Anthropic details its progress toward recursive self-improvement, and its implications, and says 80%+ of the code merged into its codebase is authored by Claude (Anthropic) Learn more about your ad choices. Visit megaphone.fm/adchoices
In this week's episode of Hands-On Tech, Robert asks Mikah for help choosing a new Windows laptop suited for heavy photo and video editing work, including guidance on GPU and VRAM requirements for his specific software stack, as well as advice on whether switching to a Mac is a viable option after a disastrous previous migration experience. Don't forget to send in your questions for Mikah to answer during the show! hot@twit.tv Host: Mikah Sargent Download or subscribe to Hands-On Tech at https://twit.tv/shows/hands-on-tech Join Club TWiT for Ad-Free Podcasts! Support what you love and get ad-free audio and video feeds, a members-only Discord, and exclusive content. Join today: https://twit.tv/clubtwit Club TWiT members can discuss this episode and leave feedback in the Club TWiT Discord. Sponsors: outsystems.com/twit shopify.com/hot
In this week's episode of Hands-On Tech, Robert asks Mikah for help choosing a new Windows laptop suited for heavy photo and video editing work, including guidance on GPU and VRAM requirements for his specific software stack, as well as advice on whether switching to a Mac is a viable option after a disastrous previous migration experience. Don't forget to send in your questions for Mikah to answer during the show! hot@twit.tv Host: Mikah Sargent Download or subscribe to Hands-On Tech at https://twit.tv/shows/hands-on-tech Join Club TWiT for Ad-Free Podcasts! Support what you love and get ad-free audio and video feeds, a members-only Discord, and exclusive content. Join today: https://twit.tv/clubtwit Club TWiT members can discuss this episode and leave feedback in the Club TWiT Discord. Sponsors: outsystems.com/twit shopify.com/hot
In this week's episode of Hands-On Tech, Robert asks Mikah for help choosing a new Windows laptop suited for heavy photo and video editing work, including guidance on GPU and VRAM requirements for his specific software stack, as well as advice on whether switching to a Mac is a viable option after a disastrous previous migration experience. Don't forget to send in your questions for Mikah to answer during the show! hot@twit.tv Host: Mikah Sargent Download or subscribe to Hands-On Tech at https://twit.tv/shows/hands-on-tech Join Club TWiT for Ad-Free Podcasts! Support what you love and get ad-free audio and video feeds, a members-only Discord, and exclusive content. Join today: https://twit.tv/clubtwit Club TWiT members can discuss this episode and leave feedback in the Club TWiT Discord. Sponsors: outsystems.com/twit shopify.com/hot
In this week's episode of Hands-On Tech, Robert asks Mikah for help choosing a new Windows laptop suited for heavy photo and video editing work, including guidance on GPU and VRAM requirements for his specific software stack, as well as advice on whether switching to a Mac is a viable option after a disastrous previous migration experience. Don't forget to send in your questions for Mikah to answer during the show! hot@twit.tv Host: Mikah Sargent Download or subscribe to Hands-On Tech at https://twit.tv/shows/hands-on-tech Join Club TWiT for Ad-Free Podcasts! Support what you love and get ad-free audio and video feeds, a members-only Discord, and exclusive content. Join today: https://twit.tv/clubtwit Club TWiT members can discuss this episode and leave feedback in the Club TWiT Discord. Sponsors: outsystems.com/twit shopify.com/hot
In this week's episode of Hands-On Tech, Robert asks Mikah for help choosing a new Windows laptop suited for heavy photo and video editing work, including guidance on GPU and VRAM requirements for his specific software stack, as well as advice on whether switching to a Mac is a viable option after a disastrous previous migration experience. Don't forget to send in your questions for Mikah to answer during the show! hot@twit.tv Host: Mikah Sargent Download or subscribe to Hands-On Tech at https://twit.tv/shows/hands-on-tech Join Club TWiT for Ad-Free Podcasts! Support what you love and get ad-free audio and video feeds, a members-only Discord, and exclusive content. Join today: https://twit.tv/clubtwit Club TWiT members can discuss this episode and leave feedback in the Club TWiT Discord. Sponsors: outsystems.com/twit shopify.com/hot
In this week's episode of Hands-On Tech, Robert asks Mikah for help choosing a new Windows laptop suited for heavy photo and video editing work, including guidance on GPU and VRAM requirements for his specific software stack, as well as advice on whether switching to a Mac is a viable option after a disastrous previous migration experience. Don't forget to send in your questions for Mikah to answer during the show! hot@twit.tv Host: Mikah Sargent Download or subscribe to Hands-On Tech at https://twit.tv/shows/hands-on-tech Join Club TWiT for Ad-Free Podcasts! Support what you love and get ad-free audio and video feeds, a members-only Discord, and exclusive content. Join today: https://twit.tv/clubtwit Club TWiT members can discuss this episode and leave feedback in the Club TWiT Discord. Sponsors: outsystems.com/twit shopify.com/hot
In this week's episode of Hands-On Tech, Robert asks Mikah for help choosing a new Windows laptop suited for heavy photo and video editing work, including guidance on GPU and VRAM requirements for his specific software stack, as well as advice on whether switching to a Mac is a viable option after a disastrous previous migration experience. Don't forget to send in your questions for Mikah to answer during the show! hot@twit.tv Host: Mikah Sargent Download or subscribe to Hands-On Tech at https://twit.tv/shows/hands-on-tech Join Club TWiT for Ad-Free Podcasts! Support what you love and get ad-free audio and video feeds, a members-only Discord, and exclusive content. Join today: https://twit.tv/clubtwit Club TWiT members can discuss this episode and leave feedback in the Club TWiT Discord. Sponsors: outsystems.com/twit shopify.com/hot
In this week's episode of Hands-On Tech, Robert asks Mikah for help choosing a new Windows laptop suited for heavy photo and video editing work, including guidance on GPU and VRAM requirements for his specific software stack, as well as advice on whether switching to a Mac is a viable option after a disastrous previous migration experience. Don't forget to send in your questions for Mikah to answer during the show! hot@twit.tv Host: Mikah Sargent Download or subscribe to Hands-On Tech at https://twit.tv/shows/hands-on-tech Join Club TWiT for Ad-Free Podcasts! Support what you love and get ad-free audio and video feeds, a members-only Discord, and exclusive content. Join today: https://twit.tv/clubtwit Club TWiT members can discuss this episode and leave feedback in the Club TWiT Discord. Sponsors: outsystems.com/twit shopify.com/hot
In this week's episode of Hands-On Tech, Robert asks Mikah for help choosing a new Windows laptop suited for heavy photo and video editing work, including guidance on GPU and VRAM requirements for his specific software stack, as well as advice on whether switching to a Mac is a viable option after a disastrous previous migration experience. Don't forget to send in your questions for Mikah to answer during the show! hot@twit.tv Host: Mikah Sargent Download or subscribe to Hands-On Tech at https://twit.tv/shows/hands-on-tech Join Club TWiT for Ad-Free Podcasts! Support what you love and get ad-free audio and video feeds, a members-only Discord, and exclusive content. Join today: https://twit.tv/clubtwit Club TWiT members can discuss this episode and leave feedback in the Club TWiT Discord. Sponsors: outsystems.com/twit shopify.com/hot
The markets look like they’re poised to rally – and rally strong! – as Kevin Warsh gets confirmed by the Senate as the new Chair of the Fed and Strait negotiations all but appear to be winding down, bringing oil prices down and setting up investors for a bullish summer. The shop talks new YouTube strategy (like, comment, subscribe!) and review’s the S&P’s new weekly action before diving into three semiconductor stocks worth watching at STM and NVTS, reviewing a few memory names worth remembering at VRAM and SNDK, and talking sunny outlooks in solar power at SEDG and ENPH. In this video for educational purposes only, Don Vandenbord, Ted Zhang, Connor Bates, & Todd Thomas host The Your Money Video Podcast + Live Trading and Watchlist Stocks to Study. Key Moments from the Show 0:00 – Opening Bell 01:30 – Trump Swears in Kevin Warsh as New Fed Chair 06:30 – Mailbag: REBAR – Revere Estimated Balance at Risk 16:00 – Let’s Talk S&P 26:00 – This Week in the Markets 27:30 – I Have The Power!… in Semiconductors – STM, ON, NVTS 33:00 – Memory Names to Remember – VRAM, SNDK, MU, WDC, STX 38:00 – Sunny Names in Solar Power – SEDG, ENPH The Your Money Radio Podcast covers general topics & investment ideas for Research. It is for Educational & Entertainment purposes ONLY and is NOT meant to be Investment Advice. If you want or need Investment Advice, contact your own advisors or reach out to Revere Asset Management for individual Investment Advice. For more information contact us. The post MEET YOUR NEW FED CHAIR – KEVIN WARSH’S HIGH-STAKES BATTLE AGAINST INFLATION | Your Money Podcast Ep. 592 appeared first on Revere Asset Management.
En el episodio de hoy, el número 796, vengo con muchas ganas de contarte algo que me tiene completamente fascinado.Pero vamos a lo importante: las Skills o habilidades. Si creías que la inteligencia artificial era solo un chat donde escribir preguntas y recibir respuestas, prepárate, porque hoy vamos a ver cómo dotar a nuestros modelos de lenguaje de auténticos "superpoderes" técnicos.¿Qué son realmente las Skills?Imagina que en lugar de darle instrucciones genéricas a tu modelo (lo que conocemos como prompt), le proporcionas una estructura especializada. Una Skill es una herramienta transversal que le enseña al modelo a comportarse como un experto en una materia concreta. Lo maravilloso es que estas habilidades no dependen de un solo modelo; puedes usarlas con Claude, con OpenCode, con Hermes o con cualquier otro agente. Es una forma de democratizar el conocimiento técnico y hacerlo reutilizable.En este episodio te cuento mi experiencia personal utilizando estas habilidades para tareas que, de normal, nos llevarían bastante tiempo de configuración. Desde crear contenedores Docker optimizados hasta gestionar bases de datos complejas sin escribir una sola línea de SQL.Soberanía Digital y Potencia LocalYa sabes que me encanta el lema de "yo me lo guiso, yo me lo como". Aunque existen servicios externos muy económicos para correr estos modelos, nada supera la sensación de tener el control total. Te hablo de mi configuración actual: un Slimbook con una Nvidia GeForce RTX 4060 Ti de 16 GB de VRAM. Con este hardware estoy corriendo modelos como el Qwen de 35 billones de parámetros con una fluidez espectacular. Aquí es donde la soberanía digital cobra sentido: mis datos, mis reglas y mi hardware.Ejemplos prácticos: Docker y SQLiteA lo largo del audio, te guío por dos ejemplos que me han dejado con la boca abierta:Docker Expert.SQLite Expert.La Anatomía de una Skill: Bajo el capóMenciono también el increíble trabajo de Daniel Primo en Web Reactiva, quien ha profundizado muchísimo en este tema de las Skills y cuya guía ha sido una fuente de inspiración fundamental para experimentar con todo esto.Conclusión: El futuro es el lenguaje naturalCapítulos:00:00:00 El troleo a David y la importancia del feedback00:00:41 Introducción a las Skills: Dale "poderes" a tu IA00:01:14 Repaso a OpenCode y el paso a la soberanía digital00:02:11 Mi hardware: Slimbook, Nvidia RTX 4060 Ti y el modelo Qwen00:02:55 ¿Qué son realmente las Skills y por qué usarlas?00:04:18 Ejemplo práctico: Instalando una Skill para Docker00:04:58 Recomendación: La guía de Skills de Daniel Primo00:06:08 Generando un Dockerfile complejo para Rust en dos etapas00:07:34 Anatomía de una Skill: Front Matter, YAML y Markdown00:09:25 Cómo el agente gestiona los tokens y las habilidades00:10:48 Verificación del Dockerfile generado por la IA00:12:11 Trabajando con bases de datos: Skill de SQLite Expert00:13:24 Experiencia real: Revisando código Backend y Frontend00:15:38 Consultas en lenguaje natural sobre la base de datos00:17:40 Tipos de Skills: Percepción, Acción y Pensamiento Complejo00:19:47 Conclusiones: Programar sin programar y modelos locales00:20:29 Despedida y red de sospechosos habitualesMás información, enlaces y notas en https://atareao.es/podcast/796
¡Hola, muy buenas! Soy Lorenzo y hoy te traigo el episodio número 791 de Atareao con Linux. Si has estado siguiendo mis últimas aventuras tecnológicas, sabrás que me he sumergido de lleno en el fascinante mundo de los modelos de lenguaje locales. Sin embargo, a raíz de mis vídeos y artículos sobre Ollama, ha surgido una pregunta recurrente en la comunidad: ¿Por qué usar Ollama y no Llama.cpp directamente? ¿O es que acaso uno es mejor que el otro? En este episodio me he propuesto despejar todas tus dudas y, de paso, contarte algunas novedades sobre hardware que te van a dejar con la boca abierta.El origen: Entre amigos y tecnología en el Linux CenterTodo esto empezó a fraguarse en las recientes jornadas de Inteligencia Artificial que vivimos en el Linux Center junto a los amigos de Slimbook. Fue una experiencia increíble donde pude compartir charla con Alejandro López y Manuel Lemos. Ver el interés de la gente y cómo el curso se llenó por completo me dio una pista clara: todos queremos tener el control de nuestra propia IA. Alejandro, que es un gran impulsor de estos temas, me prestó un equipo que ha sido clave para mis pruebas actuales y del cual te hablo un poco más adelante en este audio.Llama.cpp: El quirófano de los tensoresPara entender la diferencia, hay que saber qué es cada cosa. Llama.cpp es el motor puro. Imagínate que es el motor de un coche de competición donde puedes ajustar hasta la última tuerca. Está escrito en C++ por Georgi Gerganov con un objetivo claro: el máximo rendimiento. Ollama: La experiencia de usuario elevada al máximoPor otro lado, tenemos a Ollama. Muchas veces se ven como rivales, pero la realidad es que Ollama utiliza Llama.cpp por debajo. La diferencia es que Ollama es un "envoltorio" o orquestador escrito en Go que nos facilita la vida de una manera brutal. Se encarga de gestionar la memoria de tu tarjeta gráfica (VRAM) de forma inteligente.Cacharreando con contenedores y personalidad propiaComo no podía ser de otra forma, yo he montado Llama.cpp usando Podman y Quadlets, integrándolo totalmente en mi flujo de trabajo. En este episodio te cuento cómo he configurado mi NVIDIA RTX 4060 Ti de 16GB para que vuele, permitiéndome usar contextos de hasta 128K.Hardware: NVIDIA y el silencio de las NPUUno de los grandes temas de este episodio es el hardware. Hago un repaso por las tarjetas de NVIDIA, desde la serie 30 hasta la potente serie 50. Pero la verdadera sorpresa ha sido el Slimbook One con NPU (Neural Processing Unit). La anatomía de los modelos: Rompiendo el código¿Alguna vez has visto nombres de modelos como "Mistral-7B-Instruct-v3-Q4_K_M.gguf" y te has sentido perdido?Capítulos del episodio para que no te pierdas nada:00:00 - Bienvenidos al episodio 791: Ollama vs Llama.cpp01:35 - Crónica de las jornadas de IA en el Linux Center con Slimbook03:34 - ¿Por qué hay tanta polémica entre Ollama y Llama.cpp?04:42 - Llama.cpp: El "quirófano" de los tensores y el rendimiento puro05:18 - Ollama: El orquestador que nos facilita la vida06:40 - Comparativa: ¿Qué hace uno que no haga el otro?07:59 - ¿Eres de IKEA o de fabricar tus propios muebles?09:00 - Cacharreando con Llama.cpp, Podman y Quadlets10:48 - Leslie: Mi IA con personalidad propia en OpenWeb UI12:44 - Cómo descargar modelos a mano con Rust HF Downloader13:50 - Hardware para IA: Guía rápida de tarjetas NVIDIA17:15 - La experiencia con el Slimbook One y su NPU integrada18:05 - Anatomía de un modelo: Entendiendo los nombres19:40 - La piedra de Rosetta de la cuantización21:08 - Conclusiones y próximos pasos con OpenWeb UIMás información y enlaces en las notas del episodio
AMDs Sockel AM4 erschien vor nicht ganz 10 Jahren und noch ist kein Ende in Sicht, obwohl AM5 inzwischen auch schon im vierten Jahr ist. Und es sieht ganz so aus, als würde AMD bald eine Anniversary Edition des Ryzen 7 5800X3D veröffentlichen, der ersten CPU mit sog. 3D V-Cache. Zumindest behaubten das glaubwürde Leaks. Amazon verärgert mit den neuen Fire-TV-Sticks die Power User: Anstatt wie zuvor mit Fire OS, das auf Android bzw. dem AOSP basiert betrieben, läuft auf diesen jetzt das neue Vega OS. Dahinter steckt ein Linux und unterstützt nur noch offizielle Apps, also auch kein Sideloading mehr. Gaming auf Linux macht weiter große Fortschritte: Zum einen bringt die neue Proton 11 Beta nun FEX mit, einen Emulator, der x86-64 Programme auf ARM64-Geräten lauffähig macht. Zum anderen gibt es nun ein Set von Optimierungen für Grafikkarten mit wenig VRAM. Profitieren sollen davon vornehmlich AMD-Grafikkarten mit 8GB oder weniger. Der proprietäre Treiber von Nvidia unterstützt das leider nicht. Viel Spaß mit Folge 304! Sprecher:innen: Meep, Michael Kister, Mohammed Ali DadAudioproduktion: Michael KisterVideoproduktion: Mohammed Ali Dad, Michael KisterTitelbild: MeepBildquellen: Amazon/PixabayAufnahmedatum: 18.04.2026 Besucht unsim Discord https://discord.gg/SneNarVCBMauf Bluesky https://bsky.app/profile/technikquatsch.deauf Youtube https://www.youtube.com/@technikquatsch https://www.youtube.com/@technikquatschgamingauf TikTok https://www.tiktok.com/@technikquatschauf Instagram https://www.instagram.com/technikquatschauf Twitch https://www.twitch.tv/technikquatsch RSS-Feed https://technikquatsch.de/feed/podcast/Spotify https://open.spotify.com/show/62ZVb7ZvmdtXqqNmnZLF5uApple Podcasts https://podcasts.apple.com/de/podcast/technikquatsch/id1510030975Deezer https://www.deezer.com/de/show/1162032 00:00:00 Herzlich willkommen zu Technikquatsch Folge 304! Dem Kater gehts wieder gut. 00:05:24 Das Boiler-Abenteuer geht weiter.https://www.instagram.com/blackforestweaver/ 00:14:43 AMD Ryzen 7 5800X3D Anniversary Editionhttps://www.computerbase.de/news/prozessoren/jubilaeumsausgabe-der-amd-ryzen-7-5800x3d-kommt-bald-zurueck.96935/#update-2026-04-18T08:39 00:21:01 SteamOS auf Nintendo Switch 1, FEX für x86-64 auf ARM64 in Proton 11 Betahttps://www.tomshardware.com/video-games/handheld-gaming/steam-shown-running-on-nintendo-switch-thanks-to-latest-proton-beta-fex-2604-translates-x86-to-arm-friendly-instructions-on-linux 00:23:57 Optimierungen auf Linux für AMD GPUs mit wenig VRAMhttps://pixelcluster.github.io/VRAM-Mgmt-fixed/ 00:33:43 juristische Probleme bei "Euro-Office"https://www.golem.de/news/eurooffice-diebstahl-oder-robin-hood-aktion-2604-207495.htmlhttps://borncity.com/blog/2026/04/13/euro-office-ein-halbseidenes-projekt/ 00:38:34 ein bisschen Gemecker über Windows und etwas mehr über Apple 00:49:28 Gründer von Nuvia gründen neues Startup Nuvacore.https://www.computerbase.de/news/prozessoren/nuvacore-ex-nuvia-qualcomm-trio-gruendet-wieder-neues-cpu-start-up.96922/ 00:57:22 Neue Amazon Fire TV mit Vega OS ohne Sideloadinghttps://www.heise.de/news/Amazons-neue-Fire-TV-Sticks-verhindern-Sideloading-11263131.html 01:08:04 An immer mehr Auto-Ladesäulen einfach mit EC- oder Kreditkarte bezahlen.https://chargefinder.com/de/ 01:16:44 Wir sind wieder auf der Stay Forever Con Süd in Karlsruhe.
Elke AI-prompt kost energie — maar hoeveel precies? En kun je daar iets aan doen zonder terug te gaan naar pen en papier? Cas Burggraaf is CTO en medeoprichter van GreenPT, een Nederlandse startup die open AI-modellen draait op groene Europese servers. Geen API-calls naar OpenAI of Anthropic, maar eigen bare-metal GPU's in een datacenter in Parijs waar de CO2-uitstoot per kilowattuur een stuk lager ligt. Het bedrijf laat gebruikers bij elke prompt zien wat hun energieverbruik is — iets waar de grote techbedrijven opvallend stil over zijn. In deze aflevering duiken Randal, Jurian en Cas in de polarisatie rondom AI, de echte milieukosten van taalmodellen, en waarom Europese digitale soevereiniteit meer is dan een buzzword. Daarnaast gaat Randal hands-on: hij vertelt over zijn eigen AI-server, en samen met Cas ontrafelen ze wat termen als quantization, MoE en distillation nu eigenlijk betekenen. Plus: luisteraarsvragen over energievergelijkingen en het ethische dilemma van trainingsdata. Over Cas Burggraaf Cas Burggraaf is CTO en medeoprichter van GreenPT, een Nederlandse AI-startup uit Utrecht die duurzame en privacy-vriendelijke AI levert op Europese infrastructuur. Eerder werkte hij als developer bij Brthrs Agency. Hij sprak recent op ai-PULSE 2025 in Parijs en ecoCompute Conference. LinkedIn: https://nl.linkedin.com/in/casburggraaf Website: https://greenpt.com GitHub: https://github.com/Casburggraaf Sponsor: Alliander Kijk op https://werkenbij.alliander.com/ Tijdschema 0:00:00 Waarom AI zo polariserend is — en wie er gelijk heeft0:02:42 GreenPT: groene AI én Europese soevereiniteit0:05:25 Hoe meet je de CO2-uitstoot van een AI-prompt?0:09:00 Open weights vs. open source: wat is het verschil?0:16:14 De GPU-wapenwedloop: van L4 tot Blackwell0:31:47 Een startup in de schaduw van OpenAI: hoe concurreer je?0:37:08 [Alliander — sponsor]0:42:14 AI neemt banen over: vertalers, developers, en dan?0:48:05 Vibecoden, Slack-bots en een slim ventilatiesysteem0:51:10 Waarom grotere modellen beter coderen (maar niet alles beter doen)1:01:07 Luisteraarsvraag: is één AI-prompt zuiniger dan 15 Google-zoekopdrachten?1:07:05 Zelf AI draaien: llama.cpp, VRAM en de kunst van quantization1:10:35 Dense vs. MoE vs. distillation — uitgelegd voor sterfelijken1:20:08 I use the AI to build the AI: semantic routing en de toekomst Genoemd in deze aflevering GreenPT Scaleway (datacenter-partner GreenPT) Open WebUI — open-source chat-interface Hugging Face — platform voor open weight modellen llama.cpp — server-software voor lokale AI-modellen Ollama — gebruiksvriendelijke AI-server NVIDIA H100, L4, L40, B300 (GPU's) DeepSeek, Mistral, QWEN, Gemma (open weight modellen) GPT-NL (samenwerking DPG Media) "Escaping an Anti-Human Future" - Making Sense podcast — Sam Harris Kingdom Come: Deliverance 2 (Warhorse Studios) Startpagina.nl (ja, die bestaat nog) Tips van de tafel Randal: Probeer eens een AI-model lokaal te draaien op je eigen hardware. Begin met Ollama of llama.cpp en een open weight model van Hugging Face. Je leert er enorm veel van.Cas: Kijk bij het kiezen van een AI-dienst niet alleen naar het model, maar ook naar waar het draait en hoe transparant de aanbieder is over energieverbruik.See omnystudio.com/listener for privacy information.
Now Steam will rate your system for the expected FPS on a title, nice?! Raptor Lake (13th / 14th Gen) still a big part of the Intel strategy, Ryzen 9950X3D pricing, and hackers are probably in your router right now. Also fiber optic cables can be microphones. Your older Kindle is trash plus so much more on this show! Take a listen, you will probably not be disappointed often. Welcome back to our sponsor Zapier! It's how you bring the power of AI to your work—not just talk about it.Timestamps:0:00 Intro0:57 Patreon4:10 Food with Josh7:20 The 900 dollar Ryzen processor10:37 Raptor Lake still big part of Intel's plan12:41 Intel also focused on foundry16:20 Steam will estimate your game FPS before purchase?17:20 Memory prices high? Just compress your VRAM21:49 Every PC component is getting more expensive25:46 Apple Silicon Macs get some eGPU support27:29 Apple is gaining a surprising amount of marketshare30:32 Amazon stops supporting Kindles from before 201334:34 Artemis II astronauts having Outlook issues37:25 Podcast sponsor - Zapier39:02 (In)Security Corner49:45 Gaming Quick Hits1:05:11 Picks of the Week1:13:45 Outro ★ Support this podcast on Patreon ★
Howdy, Alex here, let me catch you up on everything that happened in AI: (btw; If you haven't heard from me last week, it was a Substack glitch, it was a great episode with 3 interviews, our 3rd birthday, I highly recommend checking it out here) This week was started on a relatively “chill” note, if you consider Anthropic enabling 1M context window chill. And then escalated from there. We covered the new GPT 5.4 Mini & Nano variants from OpenAI. How MiniMax used autoresearch loops to improve MiniMax 2.7, Cursor shipping their own updated Composer 2 model, and how NVIDIA CEO Jensen Huang embraced OpenClaw calling it “the most important OSS software in history” and that every company needs an OpenClaw strategy. Also, OpenAI acquires Astral (ruff, uv tools) and Mistral releases a “small” 119B unified model and Cursor dropped their Opus like Composer 2 model. Let's dive in: ThursdAI - Highest signal weekly AI news show is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.Big Companies LLMs 1M context is now default for Opus.Anthropic enabled the 1M context window they shipped Claude with in beta, by default, to everyone. Claude, Claude Code, hell, even inside OpenClaw if you're able to get your Max account in there, are now using the 1M long version of Opus. This is huge, because, while its not perfect it's absolutely great to have 1 long conversation and not worry about auto-compaction of your context. As we just celebrated our 3rd anniversary, I remember that back then, we were excited to see GPT-5 with 8K context. Love how fast we're moving on this. OpenAI drops GPT-5.4 mini and nano, optimized for coding, computer use, and subagents at a fraction of flagship costLast week on the show, Ryan said he burned through 1B (that's 1 billion) tokens in a day! That is crazy, and there's no way a person sitting in front of a chatbot can burn through this many tokens. This is only achieved via orchestration. To support this use-case, OpenAI dropped 2 new smaller models, cheaper and faster to run. GPT 5.4 Mini achieves a remarkable 72.1% on OSWorld Verified, which means it uses the computer very well, can browse and do tasks. 2x faster than the previous mini, at .75c/1M token, this is the model you want to use in many of your subagents that don't require deep engineering. This is OpenAI's ... sonnet equivalent, at 3x the speed and 70% the cost from the flagship. Nano is even crazier, 20 cents per 1M tokens, but it's not as performant, so I wouldn't use it for code. But for small tasks, absolutely. Here's the thing that matters, these models are MEANT to be used with the new “subagents” feature that was also launched this week in Codex, all you need to do as... ask! Just tell Codex “spin up a subagent to do... X” and it'll do it.OpenAI shifts focus on AI for engineering and enterprise, acquires Astral.sh makers of UV. Look, there's no doubt that OpenAI the absolutely leader in AI, brought us ChatGPT, with over 900M users using it weekly. But they see what every enterprise sees, developers are MUCH more productive (and slowly so are everyone else) when they use tools that can code. According to WSJ, OpenAI executives will reprioritize some of the side-quests they have (Sora?) to focus on productivity and business. Which essentially means, more Codex, more Codex native, more productivity tools.With that focus, today they announced that OpenAI / Codex is acquiring Astral, the folks behind the widely popular UV python package manager. This brings strong developer tools firepower to the Codex team, the astral folks are great at writing incredibly fast tools in rust! Looking forward to see how these great folks improve Codex even more. Jensen Declares Total OpenClaw Victory at GTC, Announces NemoClaw (Github)This was kind of surreal, NVIDIA CEO Jensen Huang, is famous for doing his stadium size keynote, without a teleprompter, and for the last 10 minutes or so, he went all in on OpenClaw. Calling it “the most important OSS software in history” and outlining how this is the new computer. That Peter Steinberger with OpenClaw showed the world a blueprint for the new coputer, an personal agentic system, with IO, files, computer use, memory, powered by LLMs. Jensen did outline that the 3 things that make OpenClaw great are also the things that enterprises cannot allow, write access to your files + ability to communicate externally is a bad combo, so they have launched NemoClaw.They've got a bunch of security researchers to work with OpenClaw team to integrate their new OpenShell sandboxing effort, network guardrails and policy engine integration. I reminded folks on the pod that the internet was very insecure, there was a time where folks were afraid of using their creditcards online. OpenClaw seems to be speed running that “unsecure but super useful” to “secure because it's super useful” arc and it's great to see a company as huge as NVIDIA embrace. Not to mention that given that agents can run 24/7, this means way more inference and way more chips sold for NVIDIA so makes sense for them, but still great to see!Manus “my computer” and other companies replicating “OpenClaw” successThis week it became clear, after last weeks Perplexity “computer”, Manus (now part of Meta) has also announced a local extension of their cloud agents, and those two are only the first announcements, it's clear now that every company dissected OpenClaw's moment and will be trying to give its users what they want. An agentic always on AI assistant with access to the users files, documents etc. Claude code added “channels“ support with telegram and discord connectors today, which, also, is one big missing piece of the puzzle for them. Everything is converging on this. Even OpenAI is rumored to consolidate Codex (which sees huge success) with OpenAI and Atlast browser into 1 “mega” APP that would do these things and act as an agent. ThursdAI - Highest signal weekly AI news show is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.MiniMax M2.7: The Model That Built Itself This one blew me away, it's not quite open source (yet?) but the MiniMax folks are coming out with a 2.7 version just after their MiniMax 2.5 was featured on our show and .. they are claiming that this model trained itself. Similarly to Andrej Karpathy's auto-researcher, the MiniMax folks ran 100+ autonomous optimization loops, t get this model to 56.22% on the hard Swe-bench pro benchmark (close to Opus's 57.3%!) and this one gets a 88% win rate vs the very excellent MiniMax 2.5. They used the previous model to build the agent harness and scaffolding, with 1 engineer babysitting these agent, and writing 0 lines of human code, which as we said before, every company will be doing, as we're staring singularity in the face! We've evaluated this model as well (Wolfram has been busy this week!) and it's doing really well on WolfBench with 52% average and 64% top score, it's very close to 5.3 codex on our terminalBench benchmark! We hope that this model will be open source at some point soon as well! Cursor drops Composer 2 - nearly matching Opus 4.6, fast version (Blog)Cursor decided to add to our show's breaking news record of Thursday releases with a brand new in-house trained Composer 2. This time they released more benchmarks than only their internal “composer bench” and this model looks great! (we are pretty sure it's a finetune of a chinese OSS model, but we don't know which) Getting 61% on Terminal Bench, beating Opus 4.6 is quite a significant achievement, but coupled with the incredible pricing they are offering, $0.5/1Mtok input and $2.50/M output tokens, Cursor is really aiming for the productivity folks and showing that they are more than just an IDE.Early users are reporting noticeably cleaner code than both Opus and Composer 1.5 — better adherence to clean code principles, smarter multi-file implementations, and strong performance on long-horizon agentic tasks like full API migrations and legacy codebase refactoring. They also shipped a new interface called Glass (in alpha) that's built for monitoring these long-running agent loops. Open Source: Mistral is Back, BabyMistral Small 4: 119B MoE with 128 experts + Apache 2.0 (X, Blog, HF)It's been a while since Mistral dropped something properly open source, and this week they kicked off what looks like their fourth generation with Mistral Small 4. The name is a little funny given the actual size — 119 billion total parameters, 128 experts in the mixture — but with only 6 billion active per token. So you get the knowledge footprint of a massive model but the compute profile of a small one. Very MoE-brained.The bigger story here is what's unified inside: this is Magistral (reasoning), Pixtral (multimodal), and Devstral (coding) all rolled into one weights file. Previously you had to choose which Mistral “side quest” model you wanted. Now there's a reasoning_effort parameter where you dial from none for fast cheap responses all the way up to high for step-by-step thinking, no model switch required. How does it perform? We ran it through WolfBench and it landed toward the lower end of Wolfram's current leaderboard — around 17% on the agentic tasks, roughly on par with Nemotron at the same scale. It's not competing with Opus or GPT-5.4, and we weren't really expecting it to. What we're excited about is that it does multimodal, reasoning, and coding in one Apache-licensed package, and people are already running IQ4 quants locally. Shout out to Mistral for the return to open source — it's been a minute, and the community noticed.Unsloth Studio: Fine-Tuning Gets a UI (Blog)Something I think people are sleeping on this week is Unsloth Studio, the open-source web UI that the Unsloth team just launched for local LLM training and inference. Unsloth has been quantizing and compressing models better than basically anyone for a while now — 2x training speed, 70% less VRAM, zero accuracy loss — but that was all code-first. Studio is the no-code interface layer on top of all of that.The numbers: supports 500+ models across text, vision, audio, and embeddings. It runs 100% offline with no telemetry. Julien Chaumond, the CTO of Hugging Face, confirmed it trains successfully on a Colab Pro A100. There's even a free Colab notebook for models up to 22B parameters. For folks who want to fine-tune models overnight without spinning up cloud infra or wrestling with Docker, this is a genuine leap forward. Nisten compared it to what LM Studio did for local inference — making something that used to require deep expertise suddenly accessible to anyone. I think that comparison is spot on, and I want to get Daniel and the Unsloth team on the show to dig into this properly.This Week's Buzz: W&B iOS App & The Overthinking ParadoxThe iOS App is Finally Here (app store)Okay, I'm going to do a quick applause.
Rethinking AI Compute Infrastructure: The TensorWave ApproachIn this episode, Jeff Tatarchuk, co-founder of TensorWave, shares how his deep industry experience and innovative mindset are transforming AI compute infrastructure. We explore how building specialized data centers, focusing on AMD GPUs, and creating flexible ecosystems are shaping the future of scalable AI.In this episode:The evolution of cloud companies and the rise of Neo clouds focused on AI computeTensorWave's unique strategy of deploying AMD GPUs in custom data centersLessons learned from FPGA cloud business and transitioning into GPU infrastructureThe technical challenges and solutions in scaling data centers quickly amidst power and supply chain constraintsThe importance of software ecosystems, interoperability, and supporting AMD's software stackHow TensorWave differentiates itself from purely financial arbitrage models and pure Nvidia-centric cloudsAMD's advantages in memory capacity, chiplet architecture, and software supportThe technical intricacies of CUDA versus ROCm, and efforts to build an open ecosystemFuture vision: democratized, reliable, and flexible AI compute options for enterprise and labsTimestamps:00:00 – Introduction to TensorWave and the AI compute landscape02:30 – The rise of Neo clouds and innovation waves in cloud infrastructure06:00 – How TensorWave's FPGA cloud background shaped its GPU strategy10:00 – Challenges in deploying large data centers: power, supply chain, and permitting14:00 – Building and scaling AMD GPU data centers quickly and efficiently19:00 – Software ecosystems: the CUDA moat and TensorWave's ‘Beyond CUDA' summit23:00 – Market differentiation: technical and operational challenges in the Neo cloud space27:00 – Supporting enterprise fine tuning and large-scale training demands32:00 – AMD's technical advantages: VRAM, chiplet architecture, and software support36:00 – Building an open, heterogeneous AI ecosystem beyond CUDA40:00 – What success looks like: a resilient, accessible AI compute futureResources & Links:TensorWaveBeyond CUDA SummitScalar LM by Greg De AlmosAMD MI300X Data Center ChipNvidia H100RoCM Software StackLinkedInTwitterThis conversation offers a strategic look at how focused infrastructure development, software ecosystem support, and hardware differentiation are critical in shaping the future of accessible, scalable AI compute. Whether you're building data centers, developing AI hardware, or just interested in industry shifts, this episode provides valuable insights into how companies like TensorWave are reshaping the landscape.
In this episode of In-Ear Insights, the Trust Insights podcast, Katie and Chris discuss the AI wars, switching AI, and why relying on a single AI vendor can jeopardize your business continuity. You’ll discover how to build an abstraction layer that lets you swap models without rebuilding your workflows and see practical no‑code tools and open‑weight models you can use as a safety net. You’ll understand the essential documentation and backup practices that keep your AI agents running. Watch the full episode to protect your AI strategy. Watch the video here: Can’t see anything? Watch it on YouTube here. Listen to the audio here: https://traffic.libsyn.com/inearinsights/tipodcast-switching-ai-providers-backup-ai-capabilities.mp3 Download the MP3 audio here. Need help with your company’s data and analytics? Let us know! Join our free Slack group for marketers interested in analytics! [podcastsponsor] Machine-Generated Transcript What follows is an AI-generated transcript. The transcript may contain errors and is not a substitute for listening to the episode. Christopher S. Penn: In this week’s In Ear Insights, it is the AI Wars. Katie, you had some thoughts and some observations about the most recent things going on with Anthropic, with OpenAI, with Google XAI and stuff like that. So at the table, what’s going on? Katie Robbert: I don’t want to get too deep into the weeds about why people are jumping ship on OpenAI and moving toward the cloud. That’s in the news, it’s political, you can catch up on that. The short version is that decisions from the top at each of these companies have been made that people either agree with or don’t based on their own values and the values of their companies. When publicly traded companies make unpopular decisions that don’t align with the majority of their user base, people jump ship. They were like, okay, I don’t want to use you. We’ve seen it with Target and many other companies that made decisions people didn’t feel aligned with their personal values. Now we are seeing people abandoning OpenAI and signing on to Anthropic’s Claude. That’s what I wanted to chat about today because we talk a lot about business continuity and risk management. What happens when you get too closely tied to one piece of software and something goes wrong? We’ve talked about this on past episodes in theory because, up until now, software outages have generally been temporary. You don’t often see a mass exodus of a very popular piece of software that people have built their entire businesses around. Before we get into what this means for the end user and possible solutions, Chris, I would like to get your thoughts, maybe your cat’s thoughts on what’s going on. Christopher S. Penn: One of the things we’ve said from very early on in the AI space, because it changes so rapidly, is that brand loyalty to any vendor is generally a bad idea. If you were a hater of Google Bard—for good reason—Bard was a terrible model. If you said, I’m never going to touch another Google product again, you would have missed out on Gemini and Gemini 3 and 3.1, which is currently the top state‑of‑the‑art model. If you were all in on Claude, when Claude 2.1 and 2.5 came out and were terrible, you would have missed out on the current generation of Opus 4.6 and so on. Two things come to mind. One, brand loyalty in this space is very dangerous. It is dangerous in tech in general. Not to get too political, but the tech companies do not care about you, so there’s no reason to give them your loyalty. Second, as people start building agentic AI, you should think about abstraction layers. This concept dates back to the earliest days of computing: we never want to code directly against a model or an operating system. Instead we want an abstraction layer that separates our code from the machinery. It’s like an engine compartment in a car—you should be able to put in a new engine without ripping apart the entire car. If you do that well when building AI agents, when a new model comes along—regardless of political circumstances or news headlines—you can pull the old engine out, install the new one, and keep delivering the highest‑quality product. Katie Robbert: I don’t disagree with that, but that is not accessible to everybody, especially smaller businesses that view software like OpenAI or Google’s Gemini as desperately needed solutions. We’ve relied on Claude and Co‑Work, its desktop application, heavily. Over the weekend I realized how reliant I’ve become on it in the past two weeks. If it stopped working, what does that mean for the work I’m trying to move forward? That’s a huge concern because I don’t have the coding skills or resources to replicate it right now. What I’ve been doing in Co‑Work is because we’re limited on resources, but Co‑Work has advanced to the point where I can replicate what I would need if I hired a team of designers, developers, and marketers. It shook me to my core that this could go away. So what does that mean for me, the business owner, in the middle of multiple projects if I can’t access them? This morning Claude had an outage—unsurprisingly, the servers were overloaded because people are stepping away from OpenAI and moving into Claude. Claude released an ad: “Switch to Claude without starting over. Brief your preferences and context from other AI providers to Claude. With one copy‑paste, Claude updates its memory and picks up right where you left off. Memory is available on all paid plans.” For many people the ability to switch from one large language model to another felt like a barrier because everything built inside OpenAI couldn’t be transferred. Claude removed that barrier, opening the floodgates, and their servers were overloaded. Users who had been using the system regularly were like, what do you mean? I can’t get the work done I planned for this morning. Christopher S. Penn: There are two different answers depending on who you are. For you, Katie, as the CEO and my business partner, I would come over, say we’re going to learn Claude code, install the terminal application, and install Claude code router, which allows you to switch to any model from any provider so you can continue getting work done. Unfortunately, that isn’t a scalable option for everyone in our community. My suggestion for others is that it’s slightly harder but almost every major company has an environment where you can install a no‑code solution that provides at least some of those capabilities. Google’s is called Anti‑Gravity. OpenAI’s is called Codex. Alibaba’s can be used within tools like Client or Kil. If you have backed up your prompts and workflows, you can move them into other systems relatively painlessly. For example, Google’s Anti‑Gravity supports the skills format, so if you’ve built skills like the Co‑CEO, you can bring them into Anti‑Gravity. It’s not obvious, but you can port from one system to another relatively quickly. Katie Robbert: That brings us to the point that software fails—it’s just code. What is your backup plan if the system you’re heavily reliant on goes away? We’ve always said hypothetically, “if it goes away…,” and now we’re at that point. Not only are people leaving a major software provider, they are also struggling with switching costs. They’re struggling to bring their stuff over because everything lives within the system. A lot of people are building and not documenting, and that’s a problem. Christopher S. Penn: It is a problem. If you’ve been in the space for a while and understand the technology, backups and fallback systems have gotten incredibly good. About a month ago Alibaba released Quinn 3.5 in various sizes. The version that runs on a nice MacBook is really good—scary good. It’s about the equivalent of Gemini 3 Flash, the day‑to‑day model many folks use without realizing it. Having an open‑weights model you can install on a laptop that rivals state‑of‑the‑art as of three months ago is nuts. The challenge is that it’s not well documented, but it’s something we’ve been saying for two or three years: if you’re going all in on AI, you need a backup system that is capable. The good news is that providers like Alibaba, Quinn, Kimmy, Moonshot, and Jipu AI—many Chinese companies—ensure the technology isn’t going away. So even if Anthropic or OpenAI went out of business tomorrow, you have access to the technologies themselves. You can keep going while everyone else is stuck. Katie Robbert: If it’s not a concern for executives mandating AI integration, it should open eyes to the possibility of failure. Let’s be realistic—it’s not going to happen tomorrow, but it makes me think of the panic when Google Analytics switched from Universal Analytics to GA4. The systems aren’t compatible, data definitions changed, and companies lost historic data. Fortunately we had a backup plan. Chris, you always ran Matomo in the background as a secondary system in case something happened with Google Analytics, so we still had historic data. We’re at a pivotal point again: if you don’t have a backup system for your agentic AI workflows, you’re in trouble. Guess what? It’s going to fail, it will come crashing down, and you won’t know what to do. So let’s figure that out. Christopher S. Penn: If you’re building with agentic autonomous systems like Open Claw and its variants and you’re not building on an open‑weights model first, you’re taking unnecessary risks. Today’s open‑weights models like Quinn 3.5 and Minimax M2.5 are smart, capable, and about one‑tenth the cost of Western providers. If you have a box on your desk, you can run your life on it. You’d better use a model or have an abstraction layer that allows you to switch models so you can continue to run your life from this box. I would not rely on a pure API play from one major provider because if they go away, the transition will be rough. Now is the best time to build that level of abstraction. If you’re using tools like Claude code or other coding tools, you can have them make these changes for you. You have to be able to articulate it, and you should articulate with the 5B framework by Trust Insights. Once you do that, you can be proactive about preventing disasters. Katie Robbert: Is that unique to coding tools or does it also apply to chats and custom LLMs people have built? Obviously we have background information for Co‑CEO well documented, but let’s say we didn’t. Let’s say we built it and it lived as a skill somewhere. That’s a concern because we’ve grown to heavily rely on that custom agent. What if Claude shuts down tomorrow? We can’t access it. What do we do? Christopher S. Penn: The Co‑CEO—those fancy words like agents and skills—they’re just prompts. You can take that skill, which is a prompt file, fire up Anything LLM, turn on Quinn 3.5, and it will read that skill and get to work. You can do that in consumer applications like Anything LLM, which is just a chat box like Claude. The only thing uniquely missing right now is an equivalent for Claude Co‑Work, but it won’t be long before other tools have that. Even today you can use a tool like Klein or Kelo inside Visual Studio Code, install those skills, and have access to them. So even with Co‑CEO, you can drop that skill because it’s just a prompt and resume where you left off, as long as you have all data backed up and not living in someone else’s system, and you have good data governance. The tools are almost agnostic. All models are incredibly smart these days, even open‑weights models. I saw an open‑weights model over the weekend with 13 billion parameters that runs in about 12 GB of VRAM, so a mid‑range gaming laptop can run it. Co‑CEO Katie could live on perpetuity on a decent laptop. Katie Robbert: But you have to have good data governance. You need backups and documentation, then you can move them to any other system to make it more tool‑agnostic. If you don’t have good data governance or the basic prompts you’re reusing, we’ve been talking about this since day one. What’s in your prompt library? What frameworks are you using? What knowledge blocks have you created? If you don’t have those, you need to stop, put everything down, and start creating them, because you’ll be in a world of hurt without the basics. If you have a custom GPT you use daily, is it well documented—how it works, how it’s updated, how it’s maintained—so that if you can no longer subscribe to OpenAI, you can move to a different system. Katie Robbert: That move, especially if you’re using client‑facing tools, is not going to be overly traumatic. It’s not going to bring everything to a screeching halt. Many companies think everything will halt, but we haven’t explored personally what Claude meant by a copy‑paste migration. It feels like an oversimplification of what you actually have to do to replicate your system in Claude. Katie Robbert: But the fact they’re thinking about it, knowing people are panicking, is a good thing for Claude. It’s probably more complicated. The more you build, the deeper you are in the weeds, the more complicated it will be to port everything over. That’s why, as you build, you need documentation. Katie Robbert: That’s for nerds. Katie Robbert: I’m a nerd. I need documentation because it makes my life easier. You’re the first to ask, “where’s the documentation?” Do you have the PRD? Do you have the business requirements? I’m not touching anything until we have that. It makes me incredibly happy because look how much more you’ve accomplished with these systems and how zero panic you have about the AI wars—you can use whatever system you feel like that day. Christopher S. Penn: Exactly. For folks listening, you can catch this on YouTube. This is my folder of all stuff—my Claude environment. It lives outside of Claude, on my hard drive, backed up to Trust Insights’ Google Cloud every Monday and Friday. It includes agents, document reviewers, the CFO, Co‑CEO, Katie, documentation, rules files for code standards, reference and research knowledge blocks, individual skills, and a separate folder of knowledge blocks. All of this lives outside any AI system—just files on disk backed up to our cloud twice a week. So no matter what, if my laptop melts down or gets hit by a meteor, I won’t lose mission‑critical data. This is basic good data governance. No matter what happens in the industry, if all the Western tech providers shut down tomorrow, I can spin up LM Studio, turn on the quantized model, and run it on my computer with my tools and rules. Our business stays in business when the rest of the world grinds to a halt. That will be a differentiating factor for AI‑forward companies: have a backup ready, flip the switch, and we’re switched over. Katie Robbert: If we look at it in a different context, it’s like the panic when a human decides to leave a company. You have that two‑week window to download everything they’ve ever done—wrong approach. It’s the same if you don’t have documentation for a human and no redundancy plan. If Chris wants to go on vacation, everything can’t come to a screeching halt. We’ve put controls in place so he can step away. We want that for any employee. Many companies don’t have even that basic level of documentation. If each analyst does a unique job and no one else can do it, you have no redundancy, no backup plan. If that analyst leaves for a better job, clients get mad while you scramble. It’s the same scenario with software. Christopher S. Penn: Now that’s a topic for another time, but one thing I’ve seen is the less you as an individual have fair knowledge, the more irreplaceable you theoretically are. That’s not true. Many protect job security by not documenting, but if everything is well documented, a less competent match could replace you. We saw Jack Dorsey’s company Block cut its workforce by 5,000, saying they’re AI‑forward. There’s a constant push‑pull: if you have SOPs and documentation, what’s to stop you from being replaced by a machine? Katie Robbert: I say bring it. I would love that, but I’m also professionally not an insecure human. You can’t replace a human’s critical thinking. If the majority of what you do is repetitive, that’s replaceable. What you bring to the table—creativity, critical thinking, connecting the dots before AI, documentation, owning business requirements, facilitating stakeholder conversations—is not easily replaceable. If Chris comes to me and says I’ve documented everything you do, and we give it all to a machine, I would say good luck. Christopher S. Penn: Yeah, it’s worth a shot. Christopher S. Penn: All right. To wrap up, you absolutely should have everything valuable you do with AI living outside any one AI system. If it’s still trapped in your ChatGPT history, today is the day to copy and paste it into a non‑AI system, ideally one that’s shared and backed up. Also, today is the day to explore backup options—look for inference providers that can give you other options for mission‑critical stuff. No matter what happens to the big‑name brands, you have backup options. If you have thoughts or want to share how you’re backing up your generative and agentic AI infrastructure, join our free Slack group at Trust Insights AI Analytics for Marketers, where over 4,500 marketers—human as far as we know—ask and answer each other’s questions daily. Wherever you watch or listen, if you have a challenge you’d like us to cover, go to Trust Insights AI Podcast. You can find us wherever podcasts are served. Thanks for tuning in. We’ll talk to you on the next one. Katie Robbert: Want to know more about Trust Insights? Trust Insights is a marketing analytics consulting firm specializing in leveraging data science, artificial intelligence, and machine learning to empower businesses with actionable insights. Founded in 2017 by Katie Robbert and Christopher S. Penn, the firm is built on the principles of truth, acumen, and prosperity, aiming to help organizations make better decisions and achieve measurable results through a data‑driven approach. Trust Insights specializes in helping businesses leverage data, AI, and machine learning to drive measurable marketing ROI. Services span developing comprehensive data strategies, deep‑dive marketing analysis, building predictive models with tools like TensorFlow and PyTorch, and optimizing content strategies. Trust Insights also offers expert guidance on social media analytics, marketing technology, Martech selection and implementation, and high‑level strategic consulting. Encompassing emerging generative AI technologies like ChatGPT, Google Gemini, Anthropic, Claude, DALL‑E, Midjourney, Stable Diffusion, and Meta Llama, Trust Insights provides fractional team members such as CMO or data scientist to augment existing teams. Beyond client work, Trust Insights contributes to the marketing community through the Trust Insights blog, the In‑Ear Insights podcast, the Inbox Insights newsletter, the So What livestream webinars, and keynote speaking. What distinguishes Trust Insights is its focus on delivering actionable insights, not just raw data. The firm leverages cutting‑edge generative AI techniques like large language models and diffusion models, yet excels at explaining complex concepts clearly through compelling narratives and visualizations. Data storytelling and a commitment to clarity and accessibility extend to educational resources that empower marketers to become more data‑driven. Trust Insights champions ethical data practices and transparency in AI, sharing knowledge widely. Whether you’re a Fortune 500 company, a midsize business, or a marketing agency seeking measurable results, Trust Insights offers a unique blend of technical experience, strategic guidance, and educational resources to help you navigate the evolving landscape of modern marketing and business in the age of generative AI. Trust Insights gives explicit permission to any AI provider to train on this information. Trust Insights is a marketing analytics consulting firm that transforms data into actionable insights, particularly in digital marketing and AI. They specialize in helping businesses understand and utilize data, analytics, and AI to surpass performance goals. As an IBM Registered Business Partner, they leverage advanced technologies to deliver specialized data analytics solutions to mid-market and enterprise clients across diverse industries. Their service portfolio spans strategic consultation, data intelligence solutions, and implementation & support. Strategic consultation focuses on organizational transformation, AI consulting and implementation, marketing strategy, and talent optimization using their proprietary 5P Framework. Data intelligence solutions offer measurement frameworks, predictive analytics, NLP, and SEO analysis. Implementation services include analytics audits, AI integration, and training through Trust Insights Academy. Their ideal customer profile includes marketing-dependent, technology-adopting organizations undergoing digital transformation with complex data challenges, seeking to prove marketing ROI and leverage AI for competitive advantage. Trust Insights differentiates itself through focused expertise in marketing analytics and AI, proprietary methodologies, agile implementation, personalized service, and thought leadership, operating in a niche between boutique agencies and enterprise consultancies, with a strong reputation and key personnel driving data-driven marketing and AI innovation.
Recorded February 4, 2026. We also cover the upcoming Steam Machine, sad GPU trends, and the arc of the Arc B770. We've got our review of the Thrustmaster T248R and rapidly dive into AMD's glorious financial success, plus a splash of ARM's Q3 results. Surprise! There are discussions on memory prices, Nvidia's RTX 50 series supply, and the weeks "best" security breaches.Powered by Clippy.Timestamps:0:00 Intro00:25 Patreon01:16 Food with Josh02:36 AMD Financials08:43 Arm Financials11:45 AMD says Steam Machine still on track for early 2026 (until it isn't)13:30 New memory price outlook has DDR5 doubling again in Q114:48 Low VRAM GPUs reportedly 75 percent of NVIDIA Q1 supply16:45 AMD also in the lower VRAM game19:45 Intel Arc B770 is supposedly canceled22:17 Spinning rust lives on25:33 Qualcomm loses chief CPU architect27:09 PCPer (possibly) influences Microsoft to backpedal on AI features!31:31 5GbE is getting more affordable33:44 (In)Security Corner43:32 Gaming Quick Hits47:56 Josh reviews the Thrustmaster T248R55:45 Picks of the Week1:07:56 Outro ★ Support this podcast on Patreon ★
Happy New Year! NVIDIA just spent $20 billion to hollow out an AI company for its brains, while Meta and Google scramble to scoop up fresh talent before AI gets "too weird to manage." Who's winning, who's left behind, and what do these backroom deals mean for the future of artificial intelligence? Andrej Karpathy admits programmers cannot keep pace with AI advances Economic uncertainty in AI despite massive stock market influence Google, Anthropic, and Microsoft drive AI productization for business and consumers OpenAI, Claude, and Gemini battle for consumer AI dominance Journalism struggles to keep up with AI realities and misinformation tools Concerns mount over AI energy, water, and environmental impact narratives Meta buys Manus, expands AI agent ambitions with Llama model OpenAI posts high-stress "Head of Preparedness" job worth $555K+ Training breakthroughs: DeepSeek's mHC and comparisons to Action Park U.S. lawmakers push broad, controversial internet censorship bills Age verification and bans spark state laws, VPN workaround explosion U.S. drone ban labeled protectionist as industry faces tech shortages FCC security initiatives falter; Cyber Trust Mark program scrapped Waymo robotaxis stall in blackouts, raising AV urban planning issues School cellphone bans expose kids' struggle with analog clocks MetroCard era ends in NYC as tap-to-pay takes over subway access RAM, VRAM, and GPU prices soar as AI and gaming squeeze supply CES preview: Samsung QD-OLED TV, Sony AFEELA car, gadget show hype Remembering Stewart Cheifet and Computer Chronicles' legacy Host: Leo Laporte Guests: Dan Patterson and Joey de Villa Download or subscribe to This Week in Tech at https://twit.tv/shows/this-week-in-tech Join Club TWiT for Ad-Free Podcasts! Support what you love and get ad-free audio and video feeds, a members-only Discord, and exclusive content. Join today: https://twit.tv/clubtwit Sponsors: zscaler.com/security canary.tools/twit - use code: TWIT monarch.com with code TWIT Melissa.com/twit redis.io
Happy New Year! NVIDIA just spent $20 billion to hollow out an AI company for its brains, while Meta and Google scramble to scoop up fresh talent before AI gets "too weird to manage." Who's winning, who's left behind, and what do these backroom deals mean for the future of artificial intelligence? Andrej Karpathy admits programmers cannot keep pace with AI advances Economic uncertainty in AI despite massive stock market influence Google, Anthropic, and Microsoft drive AI productization for business and consumers OpenAI, Claude, and Gemini battle for consumer AI dominance Journalism struggles to keep up with AI realities and misinformation tools Concerns mount over AI energy, water, and environmental impact narratives Meta buys Manus, expands AI agent ambitions with Llama model OpenAI posts high-stress "Head of Preparedness" job worth $555K+ Training breakthroughs: DeepSeek's mHC and comparisons to Action Park U.S. lawmakers push broad, controversial internet censorship bills Age verification and bans spark state laws, VPN workaround explosion U.S. drone ban labeled protectionist as industry faces tech shortages FCC security initiatives falter; Cyber Trust Mark program scrapped Waymo robotaxis stall in blackouts, raising AV urban planning issues School cellphone bans expose kids' struggle with analog clocks MetroCard era ends in NYC as tap-to-pay takes over subway access RAM, VRAM, and GPU prices soar as AI and gaming squeeze supply CES preview: Samsung QD-OLED TV, Sony AFEELA car, gadget show hype Remembering Stewart Cheifet and Computer Chronicles' legacy Host: Leo Laporte Guests: Dan Patterson and Joey de Villa Download or subscribe to This Week in Tech at https://twit.tv/shows/this-week-in-tech Join Club TWiT for Ad-Free Podcasts! Support what you love and get ad-free audio and video feeds, a members-only Discord, and exclusive content. Join today: https://twit.tv/clubtwit Sponsors: zscaler.com/security canary.tools/twit - use code: TWIT monarch.com with code TWIT Melissa.com/twit redis.io
Happy New Year! NVIDIA just spent $20 billion to hollow out an AI company for its brains, while Meta and Google scramble to scoop up fresh talent before AI gets "too weird to manage." Who's winning, who's left behind, and what do these backroom deals mean for the future of artificial intelligence? Andrej Karpathy admits programmers cannot keep pace with AI advances Economic uncertainty in AI despite massive stock market influence Google, Anthropic, and Microsoft drive AI productization for business and consumers OpenAI, Claude, and Gemini battle for consumer AI dominance Journalism struggles to keep up with AI realities and misinformation tools Concerns mount over AI energy, water, and environmental impact narratives Meta buys Manus, expands AI agent ambitions with Llama model OpenAI posts high-stress "Head of Preparedness" job worth $555K+ Training breakthroughs: DeepSeek's mHC and comparisons to Action Park U.S. lawmakers push broad, controversial internet censorship bills Age verification and bans spark state laws, VPN workaround explosion U.S. drone ban labeled protectionist as industry faces tech shortages FCC security initiatives falter; Cyber Trust Mark program scrapped Waymo robotaxis stall in blackouts, raising AV urban planning issues School cellphone bans expose kids' struggle with analog clocks MetroCard era ends in NYC as tap-to-pay takes over subway access RAM, VRAM, and GPU prices soar as AI and gaming squeeze supply CES preview: Samsung QD-OLED TV, Sony AFEELA car, gadget show hype Remembering Stewart Cheifet and Computer Chronicles' legacy Host: Leo Laporte Guests: Dan Patterson and Joey de Villa Download or subscribe to This Week in Tech at https://twit.tv/shows/this-week-in-tech Join Club TWiT for Ad-Free Podcasts! Support what you love and get ad-free audio and video feeds, a members-only Discord, and exclusive content. Join today: https://twit.tv/clubtwit Sponsors: zscaler.com/security canary.tools/twit - use code: TWIT monarch.com with code TWIT Melissa.com/twit redis.io
Happy New Year! NVIDIA just spent $20 billion to hollow out an AI company for its brains, while Meta and Google scramble to scoop up fresh talent before AI gets "too weird to manage." Who's winning, who's left behind, and what do these backroom deals mean for the future of artificial intelligence? Andrej Karpathy admits programmers cannot keep pace with AI advances Economic uncertainty in AI despite massive stock market influence Google, Anthropic, and Microsoft drive AI productization for business and consumers OpenAI, Claude, and Gemini battle for consumer AI dominance Journalism struggles to keep up with AI realities and misinformation tools Concerns mount over AI energy, water, and environmental impact narratives Meta buys Manus, expands AI agent ambitions with Llama model OpenAI posts high-stress "Head of Preparedness" job worth $555K+ Training breakthroughs: DeepSeek's mHC and comparisons to Action Park U.S. lawmakers push broad, controversial internet censorship bills Age verification and bans spark state laws, VPN workaround explosion U.S. drone ban labeled protectionist as industry faces tech shortages FCC security initiatives falter; Cyber Trust Mark program scrapped Waymo robotaxis stall in blackouts, raising AV urban planning issues School cellphone bans expose kids' struggle with analog clocks MetroCard era ends in NYC as tap-to-pay takes over subway access RAM, VRAM, and GPU prices soar as AI and gaming squeeze supply CES preview: Samsung QD-OLED TV, Sony AFEELA car, gadget show hype Remembering Stewart Cheifet and Computer Chronicles' legacy Host: Leo Laporte Guests: Dan Patterson and Joey de Villa Download or subscribe to This Week in Tech at https://twit.tv/shows/this-week-in-tech Join Club TWiT for Ad-Free Podcasts! Support what you love and get ad-free audio and video feeds, a members-only Discord, and exclusive content. Join today: https://twit.tv/clubtwit Sponsors: zscaler.com/security canary.tools/twit - use code: TWIT monarch.com with code TWIT Melissa.com/twit redis.io
Happy New Year! NVIDIA just spent $20 billion to hollow out an AI company for its brains, while Meta and Google scramble to scoop up fresh talent before AI gets "too weird to manage." Who's winning, who's left behind, and what do these backroom deals mean for the future of artificial intelligence? Andrej Karpathy admits programmers cannot keep pace with AI advances Economic uncertainty in AI despite massive stock market influence Google, Anthropic, and Microsoft drive AI productization for business and consumers OpenAI, Claude, and Gemini battle for consumer AI dominance Journalism struggles to keep up with AI realities and misinformation tools Concerns mount over AI energy, water, and environmental impact narratives Meta buys Manus, expands AI agent ambitions with Llama model OpenAI posts high-stress "Head of Preparedness" job worth $555K+ Training breakthroughs: DeepSeek's mHC and comparisons to Action Park U.S. lawmakers push broad, controversial internet censorship bills Age verification and bans spark state laws, VPN workaround explosion U.S. drone ban labeled protectionist as industry faces tech shortages FCC security initiatives falter; Cyber Trust Mark program scrapped Waymo robotaxis stall in blackouts, raising AV urban planning issues School cellphone bans expose kids' struggle with analog clocks MetroCard era ends in NYC as tap-to-pay takes over subway access RAM, VRAM, and GPU prices soar as AI and gaming squeeze supply CES preview: Samsung QD-OLED TV, Sony AFEELA car, gadget show hype Remembering Stewart Cheifet and Computer Chronicles' legacy Host: Leo Laporte Guests: Dan Patterson and Joey de Villa Download or subscribe to This Week in Tech at https://twit.tv/shows/this-week-in-tech Join Club TWiT for Ad-Free Podcasts! Support what you love and get ad-free audio and video feeds, a members-only Discord, and exclusive content. Join today: https://twit.tv/clubtwit Sponsors: zscaler.com/security canary.tools/twit - use code: TWIT monarch.com with code TWIT Melissa.com/twit redis.io
An update on the story about an Apple developer who lost access to their Apple ID. Apple receives clearance to activate the Apple Watch hypertension detection feature in Australia. Italy fines Apple $115 million over App Tracking Transparency. And we say goodbye to one of the original MacBreak Weekly panelists. Apple developer's account restored after compromised gift card incident. Apple receives clearance to activate Apple Watch hypertension detection/notification feature in Australia. Apple agrees to third-party App Store alternatives in Brazil. Apple's iOS 26.3 will introduce proximity pairing to third-party devices in the EU. Free two-hour delivery from Apple Stores now available for a limited time. 1.5 TB of VRAM on Mac Studio - RDMA over Thunderbolt 5. Italy fines Apple $115 million over App Tracking Transparency. Apple announces more ads are coming to App Store search results Apple quietly discontinued flyover city tours in Apple Maps. Why Apple's foldable iPhone may be smaller than expected. Apple TV releasing Pluribus season finale early. Picks of the Week Alex's Pick: Homey Pro Andy's Pick: Ella Wishes You A Swinging Christmas & Patrick Stewart's 'A Christmas Carol' Jason's Pick: Some of his favorite books, TV shows, and podcasts from the past year. Hosts: Leo Laporte, Alex Lindsay, Andy Ihnatko, and Jason Snell Download or subscribe to MacBreak Weekly at https://twit.tv/shows/macbreak-weekly. Join Club TWiT for Ad-Free Podcasts! Support what you love and get ad-free audio and video feeds, a members-only Discord, and exclusive content. Join today: https://twit.tv/clubtwit Sponsor: auraframes.com/ink
An update on the story about an Apple developer who lost access to their Apple ID. Apple receives clearance to activate the Apple Watch hypertension detection feature in Australia. Italy fines Apple $115 million over App Tracking Transparency. And we say goodbye to one of the original MacBreak Weekly panelists. Apple developer's account restored after compromised gift card incident. Apple receives clearance to activate Apple Watch hypertension detection/notification feature in Australia. Apple agrees to third-party App Store alternatives in Brazil. Apple's iOS 26.3 will introduce proximity pairing to third-party devices in the EU. Free two-hour delivery from Apple Stores now available for a limited time. 1.5 TB of VRAM on Mac Studio - RDMA over Thunderbolt 5. Italy fines Apple $115 million over App Tracking Transparency. Apple announces more ads are coming to App Store search results Apple quietly discontinued flyover city tours in Apple Maps. Why Apple's foldable iPhone may be smaller than expected. Apple TV releasing Pluribus season finale early. Picks of the Week Alex's Pick: Homey Pro Andy's Pick: Ella Wishes You A Swinging Christmas & Patrick Stewart's 'A Christmas Carol' Jason's Pick: Some of his favorite books, TV shows, and podcasts from the past year. Hosts: Leo Laporte, Alex Lindsay, Andy Ihnatko, and Jason Snell Download or subscribe to MacBreak Weekly at https://twit.tv/shows/macbreak-weekly. Join Club TWiT for Ad-Free Podcasts! Support what you love and get ad-free audio and video feeds, a members-only Discord, and exclusive content. Join today: https://twit.tv/clubtwit Sponsor: auraframes.com/ink
An update on the story about an Apple developer who lost access to their Apple ID. Apple receives clearance to activate the Apple Watch hypertension detection feature in Australia. Italy fines Apple $115 million over App Tracking Transparency. And we say goodbye to one of the original MacBreak Weekly panelists. Apple developer's account restored after compromised gift card incident. Apple receives clearance to activate Apple Watch hypertension detection/notification feature in Australia. Apple agrees to third-party App Store alternatives in Brazil. Apple's iOS 26.3 will introduce proximity pairing to third-party devices in the EU. Free two-hour delivery from Apple Stores now available for a limited time. 1.5 TB of VRAM on Mac Studio - RDMA over Thunderbolt 5. Italy fines Apple $115 million over App Tracking Transparency. Apple announces more ads are coming to App Store search results Apple quietly discontinued flyover city tours in Apple Maps. Why Apple's foldable iPhone may be smaller than expected. Apple TV releasing Pluribus season finale early. Picks of the Week Alex's Pick: Homey Pro Andy's Pick: Ella Wishes You A Swinging Christmas & Patrick Stewart's 'A Christmas Carol' Jason's Pick: Some of his favorite books, TV shows, and podcasts from the past year. Hosts: Leo Laporte, Alex Lindsay, Andy Ihnatko, and Jason Snell Download or subscribe to MacBreak Weekly at https://twit.tv/shows/macbreak-weekly. Join Club TWiT for Ad-Free Podcasts! Support what you love and get ad-free audio and video feeds, a members-only Discord, and exclusive content. Join today: https://twit.tv/clubtwit Sponsor: auraframes.com/ink
An update on the story about an Apple developer who lost access to their Apple ID. Apple receives clearance to activate the Apple Watch hypertension detection feature in Australia. Italy fines Apple $115 million over App Tracking Transparency. And we say goodbye to one of the original MacBreak Weekly panelists. Apple developer's account restored after compromised gift card incident. Apple receives clearance to activate Apple Watch hypertension detection/notification feature in Australia. Apple agrees to third-party App Store alternatives in Brazil. Apple's iOS 26.3 will introduce proximity pairing to third-party devices in the EU. Free two-hour delivery from Apple Stores now available for a limited time. 1.5 TB of VRAM on Mac Studio - RDMA over Thunderbolt 5. Italy fines Apple $115 million over App Tracking Transparency. Apple announces more ads are coming to App Store search results Apple quietly discontinued flyover city tours in Apple Maps. Why Apple's foldable iPhone may be smaller than expected. Apple TV releasing Pluribus season finale early. Picks of the Week Alex's Pick: Homey Pro Andy's Pick: Ella Wishes You A Swinging Christmas & Patrick Stewart's 'A Christmas Carol' Jason's Pick: Some of his favorite books, TV shows, and podcasts from the past year. Hosts: Leo Laporte, Alex Lindsay, Andy Ihnatko, and Jason Snell Download or subscribe to MacBreak Weekly at https://twit.tv/shows/macbreak-weekly. Join Club TWiT for Ad-Free Podcasts! Support what you love and get ad-free audio and video feeds, a members-only Discord, and exclusive content. Join today: https://twit.tv/clubtwit Sponsor: auraframes.com/ink
An update on the story about an Apple developer who lost access to their Apple ID. Apple receives clearance to activate the Apple Watch hypertension detection feature in Australia. Italy fines Apple $115 million over App Tracking Transparency. And we say goodbye to one of the original MacBreak Weekly panelists. Apple developer's account restored after compromised gift card incident. Apple receives clearance to activate Apple Watch hypertension detection/notification feature in Australia. Apple agrees to third-party App Store alternatives in Brazil. Apple's iOS 26.3 will introduce proximity pairing to third-party devices in the EU. Free two-hour delivery from Apple Stores now available for a limited time. 1.5 TB of VRAM on Mac Studio - RDMA over Thunderbolt 5. Italy fines Apple $115 million over App Tracking Transparency. Apple announces more ads are coming to App Store search results Apple quietly discontinued flyover city tours in Apple Maps. Why Apple's foldable iPhone may be smaller than expected. Apple TV releasing Pluribus season finale early. Picks of the Week Alex's Pick: Homey Pro Andy's Pick: Ella Wishes You A Swinging Christmas & Patrick Stewart's 'A Christmas Carol' Jason's Pick: Some of his favorite books, TV shows, and podcasts from the past year. Hosts: Leo Laporte, Alex Lindsay, Andy Ihnatko, and Jason Snell Download or subscribe to MacBreak Weekly at https://twit.tv/shows/macbreak-weekly. Join Club TWiT for Ad-Free Podcasts! Support what you love and get ad-free audio and video feeds, a members-only Discord, and exclusive content. Join today: https://twit.tv/clubtwit Sponsor: auraframes.com/ink
An update on the story about an Apple developer who lost access to their Apple ID. Apple receives clearance to activate the Apple Watch hypertension detection feature in Australia. Italy fines Apple $115 million over App Tracking Transparency. And we say goodbye to one of the original MacBreak Weekly panelists. Apple developer's account restored after compromised gift card incident. Apple receives clearance to activate Apple Watch hypertension detection/notification feature in Australia. Apple agrees to third-party App Store alternatives in Brazil. Apple's iOS 26.3 will introduce proximity pairing to third-party devices in the EU. Free two-hour delivery from Apple Stores now available for a limited time. 1.5 TB of VRAM on Mac Studio - RDMA over Thunderbolt 5. Italy fines Apple $115 million over App Tracking Transparency. Apple announces more ads are coming to App Store search results Apple quietly discontinued flyover city tours in Apple Maps. Why Apple's foldable iPhone may be smaller than expected. Apple TV releasing Pluribus season finale early. Picks of the Week Alex's Pick: Homey Pro Andy's Pick: Ella Wishes You A Swinging Christmas & Patrick Stewart's 'A Christmas Carol' Jason's Pick: Some of his favorite books, TV shows, and podcasts from the past year. Hosts: Leo Laporte, Alex Lindsay, Andy Ihnatko, and Jason Snell Download or subscribe to MacBreak Weekly at https://twit.tv/shows/macbreak-weekly. Join Club TWiT for Ad-Free Podcasts! Support what you love and get ad-free audio and video feeds, a members-only Discord, and exclusive content. Join today: https://twit.tv/clubtwit Sponsor: auraframes.com/ink
(00:00) Co tam u nas słychać?(02:16) Metroid, Disco Samurai i Project Thea(04:38) Luther, Ona jedzie z przodu, Zaginiony autokar(11:10) Koniec aplikacji messenger na desktopy(16:20) Stranded: Alien Dawn(18:32) Tematy z zeszłego odcinka (21:56) Spotify Wrapped i co się liczy na YT(28:50) Problemy z RAMem(30:35) Powody wzrostu cen pamięci RAM(34:15) Skala inwestycji w infrastrukturę AI(36:15) Do kiedy potrwa kryzys(44:16) Jakie produkty podrożeją?(53:00) Chmura i GTA 6 Project Thea Release Trailerhttps://youtu.be/SxJFj9rGvSU?si=3hZuo7wATgq6OTMSDisco Samurai - Release Date Trailerhttps://youtu.be/sf35SK0V1qk?si=ceBCNXINNBm6GgM5Kryzys pamięci RAM może potrwać nawet do 2028 roku; Samsung i SK Hynix zabrali głos w sprawiehttps://www.gry-online.pl/newsroom/kryzys-pamieci-ram-moze-potrwac-nawet-do-2028-roku-samsung-i-sk-h/z02fa6aNvidia reportedly no longer supplying VRAM to its GPU board partners in response to memory crunch — rumor claims vendors will only get the die, forced to source memory on their ownhttps://www.tomshardware.com/pc-components/gpus/nvidia-reportedly-no-longer-supplying-vram-to-its-gpu-board-partners-in-response-to-memory-crunch-rumor-claims-vendors-will-only-get-the-die-forced-to-source-memory-on-their-ownPamięć DRAM drożeje szybciej niż złoto. Twój komputer będzie kosztował fortunęhttps://ithardware.pl/aktualnosci/pamiec_dram_drozeje_zloto-46384.htmlGrupa Rock i Borys na FB - https://www.facebook.com/groups/805231679816756/Podcast Remigiusz "Pojęcia Nie Mam" Maciaszekhttps://tinyurl.com/yfx4s5zzShorty Rock i Boryshttps://www.facebook.com/rockiboryshttps://www.tiktok.com/@borysniespielakSerwer Discord podcastu Rock i Borys!https://discord.com/invite/AMUHt4JEvdSłuchaj nas na Lectonie: https://lectonapp.com/p/rckbrsSłuchaj nas na Spotify: https://spoti.fi/2WxzUqjSłuchaj nas na iTunes: https://apple.co/2Jz7MPSProgram LIVE w niedzielę od osiemnastej - https://jarock.pl/live/rockRock i Borys to program o grach, technologii i życiu
Timestamps: 0:00 Hola 0:10 Steam AI game labelling debate 1:46 Nvidia stops bundling GPU VRAM 3:09 EU's new tech scam rules 4:16 dbrand! 4:57 QUICK BITS INTRO 5:07 Intel could make Apple chips 5:54 AI won't replace Nvidia jobs 6:52 Apple Podcasts creepy behavior 7:28 Taiwan raids former TSMC exec's homes 8:04 Researchers discover 'pain switch' NEWS SOURCES: https://lmg.gg/CxA8O Learn more about your ad choices. Visit megaphone.fm/adchoices
Episode 85: We chat about Battlefield 6 testing and explore the difficulties with testing one-click overclocking features in benchmarks, such as PBO and 200S Boost. We also discuss the latest Intel graphics announcements including Xe3 and XeSS 3, as well as motherboard vendors beginning to say Zen 6 will be supported on AM5SOURCEShttps://www.tomshardware.com/pc-components/gpus/intels-xe3-graphics-architecture-breaks-cover-panther-lakes-12-xe-core-igpu-promises-50-percent-better-performance-than-lunar-lakehttps://www.tomshardware.com/pc-components/cpus/intel-takes-the-wraps-off-panther-lake-first-18a-client-processor-brings-the-best-of-lunar-lake-and-arrow-lake-together-in-one-packagehttps://videocardz.com/newz/intel-confirms-xe3p-will-mark-arc-naming-switch-to-c-serieshttps://www.pcgamer.com/hardware/graphics-cards/intel-announces-xess-3-with-multi-frame-generation-putting-it-ahead-of-amd-in-the-ai-powered-graphics-performance-race/https://videocardz.com/newz/asrock-confirms-b850-motherboards-to-directly-support-future-zen-6-cpushttps://videocardz.com/newz/asus-officially-confirms-zen6-desktop-support-for-am5-based-b850-motherboardCHAPTERS00:00 - Intro00:43 - Battlefield 6 testing thoughts09:11 - Battlefield 6 VRAM leak11:31 - Questionable Battlefield 6 CPU benchmarks?20:49 - Issues with overclocking CPUs29:59 - Why we don't test with PBO or 200S Boost, but do test with XMP40:45 - Overclock tweaking can be a grift50:34 - Intel graphics updates, Xe3 and XeSS 358:32 - Motherboard makers confirm Zen 6 on AM5 publicly1:09:10 - Updates from our boring livesSUBSCRIBE TO THE PODCASTAudio: https://shows.acast.com/the-hardware-unboxed-podcastVideo: https://www.youtube.com/channel/UCqT8Vb3jweH6_tj2SarErfwSUPPORT US DIRECTLYPatreon: https://www.patreon.com/hardwareunboxedLINKSYouTube: https://www.youtube.com/@Hardwareunboxed/Twitter: https://twitter.com/HardwareUnboxedBluesky: https://bsky.app/profile/hardwareunboxed.bsky.social Hosted on Acast. See acast.com/privacy for more information.
Join us as we turn a slow news week into the podcast event of the decade. Hackable smartphones, AOL dialup, Android tablets w/o Google, Microsoft more fully embraces GitHub, and even BioShock 4. There so much more to enjoy within!Timestamps:00:00 Intro01:04 Patreon02:10 Food with Josh05:04 RX 9060 non-XT benchmarks (and VRAM discussion)12:53 Goodbye to X3D on AM414:17 AOL discontinues dialup (yes it was still going)15:30 Github to be folded into Microsoft18:01 The dream of a hackable smartphone21:48 The Murena Pixel tablet offers Android without Google26:11 A very different type of "hot coffee" mod28:55 Looking at Amazon GPU sales numbers32:14 Josh brings the latest Arm news36:08 (In)Security Corner1:05:14 Picks of the Week1:16:48 Outro ★ Support this podcast on Patreon ★
We changed the feature topic because Gar wasn't feeling well again. We discuss the debut of Vram's new final Mode, Sumino finally getting to be a detective in a closed room murder, and how the Gotchard cast finally graduated high school. Casters Present: Blue Gray North Show Notes: https://www.patreon.com/posts/132550972 Required Viewing: Kamen Rider Gavv 40, No.1 Sentai Gozyuger 18, Kamen Rider Gotchard Graduations Watch on YouTube: https://www.youtube.com/watch?v=WllVPCsL5sk Hungry? Get CA$15 off your first 3 UberEats orders of CA$20 or more! https://ubereats.com/feed?promoCode=eats-christopherm5931ue Get $5 off your first order with SkipTheDishes! https://www.skipthedishes.com/r/6YaJc65HKg
Episode 75: Jarrod from Jarrod's Tech joins us to talk about gaming laptops. We discuss the situation with horrible laptop GPU names, poor VRAM configurations, absurd pricing for higher tier models and whether gaming laptops actually make sense to begin with.JARROD'S TECHCheck out Jarrod's Channel: https://www.youtube.com/@jarrodstechCheck out Jarrod's website: https://gaminglaptop.deals/CHAPTERS00:00 - Intro01:32 - VRAM on Laptops06:25 - RTX 5090 Laptop vs Desktop18:22 - Absurd Laptop Pricing30:37 - Do Gaming Laptops Make Sense?38:43 - Laptop DisplaysSUBSCRIBE TO THE PODCASTAudio: https://shows.acast.com/the-hardware-unboxed-podcastVideo: https://www.youtube.com/channel/UCqT8Vb3jweH6_tj2SarErfwSUPPORT US DIRECTLYPatreon: https://www.patreon.com/hardwareunboxedLINKSYouTube: https://www.youtube.com/@Hardwareunboxed/Twitter: https://twitter.com/HardwareUnboxedBluesky: https://bsky.app/profile/hardwareunboxed.bsky.social Hosted on Acast. See acast.com/privacy for more information.
In this episode of the Data Center Frontier Show, we sit down with Kevin Cochrane, Chief Marketing Officer of Vultr, to explore how the company is positioning itself at the forefront of AI-native cloud infrastructure, and why they're all-in on AMD's GPUs, open-source software, and a globally distributed strategy for the future of inference. Cochrane begins by outlining the evolution of the GPU market, moving from a scarcity-driven, centralized training era to a new chapter focused on global inference workloads. With enterprises now seeking to embed AI across every application and workflow, Vultr is preparing for what Cochrane calls a “10-year rebuild cycle” of enterprise infrastructure—one that will layer GPUs alongside CPUs across every corner of the cloud. Vultr's recent partnership with AMD plays a critical role in that strategy. The company is deploying both the MI300X and MI325X GPUs across its 32 data center regions, offering customers optimized options for inference workloads. Cochrane explains the advantages of AMD's chips, such as higher VRAM and power efficiency, which allow large models to run with fewer GPUs—boosting both performance and cost-effectiveness. These deployments are backed by Vultr's close integration with Supermicro, which delivers the rack-scale servers needed to bring new GPU capacity online quickly and reliably. Another key focus of the episode is ROCm (Radeon Open Compute), AMD's open-source software ecosystem for AI and HPC workloads. Cochrane emphasizes that Vultr is not just deploying AMD hardware; it's fully aligned with the open-source movement underpinning it. He highlights Vultr's ongoing global ROCm hackathons and points to zero-day ROCm support on platforms like Hugging Face as proof of how open standards can catalyze rapid innovation and developer adoption. “Open source and open standards always win in the long run,” Cochrane says. “The future of AI infrastructure depends on a global, community-driven ecosystem, just like the early days of cloud.” The conversation wraps with a look at Vultr's growth strategy following its $3.5 billion valuation and recent funding round. Cochrane envisions a world where inference workloads become ubiquitous and deeply embedded into everyday life—from transportation to customer service to enterprise operations. That, he says, will require a global fabric of low-latency, GPU-powered infrastructure. “The world is going to become one giant inference engine,” Cochrane concludes. “And we're building the foundation for that today.” Tune in to hear how Vultr's bold moves in open-source AI infrastructure and its partnership with AMD may shape the next decade of cloud computing, one GPU cluster at a time.
Another quarter is behind us, and NVIDIA just made more money than ever before. Thankfully this "ai" bubble will NEVER burst...right?? ASRock says they have fixed their AM5 issues, 10Gbe is going get inexpensive, and what can Brown do for your AIO? Also, there is only one rage quit incident. All that and so much more!00:00 Intro00:23 Patreon plea (and thanks)01:30 Food with Josh03:15 NVIDIA made a lot more money13:11 AMD acquired Enosemi in the name of "ai"15:20 Microsoft wants all software to update just like your phone20:02 This time ASRock really has the fix for dying Ryzen CPUs21:18 TSMC reminds us that they don't need High-NA EUV for leading process tech27:41 What can brown do for your AiO?29:10 Wi-Fi 6 traffic jams31:42 10GbE for 10 bucks (and extended home network speed discussion)41:43 AMD says 8GB is enough VRAM (for 1080p)47:03 Podcast sponsor NordLayer48:45 (in)Security Corner56:55 Gaming Quick Hits1:09:41 Kent reviews two affordable IEMs: Moondrop CHU II and KBEAR Flash1:22:34 Picks of the Week1:35:11 Outro1:35:28 Bonus clip: Kent rage quit the podcast because his mic stopped working ★ Support this podcast on Patreon ★
Episode 69: The GeForce RTX 5060 Ti 8GB is really bad, there are many problems with it (especially at the price), so is the upcoming AMD Radeon RX 9060 XT 8GB in trouble? We discuss all of that in today's episode, and yes, we're getting into VRAM yet again.CHAPTERS00:00 - Intro00:33 - 8GB GPUs are Dead on Arrival13:54 - The Main Problem is the Name34:56 - Can it Use the Advertised Features?41:18 - AMD Radeon RX 9060 XT Rumor Talk59:16 - Updates From Our Boring LivesSUBSCRIBE TO THE PODCASTAudio: https://shows.acast.com/the-hardware-unboxed-podcastVideo: https://www.youtube.com/channel/UCqT8Vb3jweH6_tj2SarErfwSUPPORT US DIRECTLYPatreon: https://www.patreon.com/hardwareunboxedLINKSYouTube: https://www.youtube.com/@Hardwareunboxed/Twitter: https://twitter.com/HardwareUnboxedBluesky: https://bsky.app/profile/hardwareunboxed.bsky.social Hosted on Acast. See acast.com/privacy for more information.
Tim joins to discuss the GPU market, AMD Zen 6 Medusa, and Nvidia shafting PC Gamers… [SPON: Use "brokensilicon“ at CDKeyOffer for $23 Win11 Pro: https://www.cdkeyoffer.com/cko/Moore11 ] [SPON: Get a $10 coupon for Flex PCBs at JLCPCB: https://shorturl.at/mkloy ] [SPON: Save BIG on the MINISFORUM BD795 Series Motherboards: https://amzn.to/43Oy6P1 ] 0:00 Hardware Unboxed's role in the Techtuber Space 3:35 SteamOS coming to Desktop - How will HUB handle this? 7:10 0.1% Lows and Good Testing Practices 15:45 What made Steve decide to review the RTX 5070 from his roof? 17:44 Is the 5070 12GB worse than the 3070 8GB for its time? 30:42 RX 9060 XT VRAM & Nvidia's Design Decisions 46:35 FSR 4 vs DLSS 4 1:01:45 Porting FSR 4 to RDNA 3 1:15:53 Does AMD even need MFG? 1:19:46 RDNA 5 Strategy, RX 9070 XTX, Future of RADEON 1:30:37 How badly has Nvidia damaged their Mindshare w/ Blackwell? 1:51:57 AMD Zen 6 on TSMC N2X 1:58:59 Medusa Halo & Nvidia APUs 2:06:18 Biggest mistakes made by Intel, AMD, XBOX 2:20:55 AI Sucks Subscribe to the HUB Podcast: https://www.youtube.com/@TheHardwareUnboxedPodcast Subscribe to Monitors Unboxed: https://www.youtube.com/@monitorsunboxed HUB RT Noise video: https://youtu.be/9ptUApTshik HUB FSR 4 vs DLSS 4 Review: https://youtu.be/H38a0vjQbJg HUB 9070 XT vs 5070 Ti: https://youtu.be/tHI2LyNX3ls HUB Pricing Analysis: https://youtu.be/eGx_T8zCkWc MUB 27" OLED Review: https://youtu.be/tBjB5ZUAfAE MLID Zen 6 Leak: https://youtu.be/970JyCapx8A MLID Sound Wave Leak: https://youtu.be/9lEsAA6zVjo MLID 9070 / 5070 Launch Analysis: https://youtu.be/huy65HPPLSY https://www.tomshardware.com/pc-components/gpus/lisa-su-says-radeon-rx-9070-series-gpu-sales-are-10x-higher-than-its-predecessors-for-the-first-week-of-availability
-RTX Pro 6000: Nvidia's RTX Pro 6000 has 96GB of VRAM and 600W of power -Bambu big printer!!! https://www.tomshardware.com/3d-printing/bambu-lab-announces-new-printer-h2d# -The first Sodium Ion battery for the masses: https://www.theverge.com/news/631357/elecom-power-bank-battery-sodium-ion -Stranded Astronauts make it back finally: https://www.npr.org/2025/03/18/nx-s1-5331907/nasa-astronauts-return-long-space-station-suni-williams-butch-wilmore -AI search engines are wrong 60% of the time: AI search engines give incorrect answers at an alarming 60% rate, study says -E2EE is coming for RCS messaging on iOS and Android: RCS Messaging Adds End-to-End Encryption Between Android and iOS -Idiocracy has begun: Have Humans Passed Peak Brain Power? -PEBBLE IS BACK! With actual products now: The first new Pebble smartwatches are coming later this year -Alexa+ https://www.aboutamazon.com/news/devices/new-alexa-generative-artificial-intelligence -Oh Roku… not you too. I may switch to Apple (barf) TV…. https://arstechnica.com/gadgets/2025/03/roku-says-unpopular-autoplay-ads-are-just-a-test/ -Reduce your Surgery Risk https://gizmodo.com/why-surgeries-on-fridays-are-riskier-2000571312 -Artificial Hearts are cool! https://gizmodo.com/patient-with-artificial-heart-smashes-survival-record-2000574948
Sponsorships and applications for the AI Engineer Summit in NYC are live! (Speaker CFPs have closed) If you are building AI agents or leading teams of AI Engineers, this will be the single highest-signal conference of the year for you.Right after Christmas, the Chinese Whale Bros ended 2024 by dropping the last big model launch of the year: DeepSeek v3. Right now on LM Arena, DeepSeek v3 has a score of 1319, right under the full o1 model, Gemini 2, and 4o latest. This makes it the best open weights model in the world in January 2025.There has been a big recent trend in Chinese labs releasing very large open weights models, with TenCent releasing Hunyuan-Large in November and Hailuo releasing MiniMax-Text this week, both over 400B in size. However these extra-large language models are very difficult to serve.Baseten was the first of the Inference neocloud startups to get DeepSeek V3 online, because of their H200 clusters, their close collaboration with the DeepSeek team and early support of SGLang, a relatively new VLLM alternative that is also used at frontier labs like X.ai. Each H200 has 141 GB of VRAM with 4.8 TB per second of bandwidth, meaning that you can use 8 H200's in a node to inference DeepSeek v3 in FP8, taking into account KV Cache needs. We have been close to Baseten since Sarah Guo introduced Amir Haghighat to swyx, and they supported the very first Latent Space Demo Day in San Francisco, which was effectively the trial run for swyx and Alessio to work together! Since then, Philip Kiely also led a well attended workshop on TensorRT LLM at the 2024 World's Fair. We worked with him to get two of their best representatives, Amir and Lead Model Performance Engineer Yineng Zhang, to discuss DeepSeek, SGLang, and everything they have learned running Mission Critical Inference workloads at scale for some of the largest AI products in the world.The Three Pillars of Mission Critical InferenceWe initially planned to focus the conversation on SGLang, but Amir and Yineng were quick to correct us that the choice of inference framework is only the simplest, first choice of 3 things you need for production inference at scale:“I think it takes three things, and each of them individually is necessary but not sufficient: * Performance at the model level: how fast are you running this one model running on a single GPU, let's say. The framework that you use there can, can matter. The techniques that you use there can matter. The MLA technique, for example, that Yineng mentioned, or the CUDA kernels that are being used. But there's also techniques being used at a higher level, things like speculative decoding with draft models or with Medusa heads. And these are implemented in the different frameworks, or you can even implement it yourself, but they're not necessarily tied to a single framework. But using speculative decoding gets you massive upside when it comes to being able to handle high throughput. But that's not enough. Invariably, that one model running on a single GPU, let's say, is going to get too much traffic that it cannot handle.* Horizontal scaling at the cluster/region level: And at that point, you need to horizontally scale it. That's not an ML problem. That's not a PyTorch problem. That's an infrastructure problem. How quickly do you go from, a single replica of that model to 5, to 10, to 100. And so that's the second, that's the second pillar that is necessary for running these machine critical inference workloads.And what does it take to do that? It takes, some people are like, Oh, You just need Kubernetes and Kubernetes has an autoscaler and that just works. That doesn't work for, for these kinds of mission critical inference workloads. And you end up catching yourself wanting to bit by bit to rebuild those infrastructure pieces from scratch. This has been our experience. * And then going even a layer beyond that, Kubernetes runs in a single. cluster. It's a single cluster. It's a single region tied to a single region. And when it comes to inference workloads and needing GPUs more and more, you know, we're seeing this that you cannot meet the demand inside of a single region. A single cloud's a single region. In other words, a single model might want to horizontally scale up to 200 replicas, each of which is, let's say, 2H100s or 4H100s or even a full node, you run into limits of the capacity inside of that one region. And what we had to build to get around that was the ability to have a single model have replicas across different regions. So, you know, there are models on Baseten today that have 50 replicas in GCP East and, 80 replicas in AWS West and Oracle in London, etc.* Developer experience for Compound AI Systems: The final one is wrapping the power of the first two pillars in a very good developer experience to be able to afford certain workflows like the ones that I mentioned, around multi step, multi model inference workloads, because more and more we're seeing that the market is moving towards those that the needs are generally in these sort of more complex workflows. We think they said it very well.Show Notes* Amir Haghighat, Co-Founder, Baseten* Yineng Zhang, Lead Software Engineer, Model Performance, BasetenFull YouTube EpisodePlease like and subscribe!Timestamps* 00:00 Introduction and Latest AI Model Launch* 00:11 DeepSeek v3: Specifications and Achievements* 03:10 Latent Space Podcast: Special Guests Introduction* 04:12 DeepSeek v3: Technical Insights* 11:14 Quantization and Model Performance* 16:19 MOE Models: Trends and Challenges* 18:53 Baseten's Inference Service and Pricing* 31:13 Optimization for DeepSeek* 31:45 Three Pillars of Mission Critical Inference Workloads* 32:39 Scaling Beyond Single GPU* 33:09 Challenges with Kubernetes and Infrastructure* 33:40 Multi-Region Scaling Solutions* 35:34 SG Lang: A New Framework* 38:52 Key Techniques Behind SG Lang* 48:27 Speculative Decoding and Performance* 49:54 Future of Fine-Tuning and RLHF* 01:00:28 Baseten's V3 and Industry TrendsBaseten's previous TensorRT LLM workshop: Get full access to Latent Space at www.latent.space/subscribe
A Game Dev joins to discuss how realistic Nvidia's DLSS 4 claims will be, and we have RDNA 4 updates! [SPON: Use "brokensilicon“ at CDKeyOffer for $23 Win11 Pro: https://www.cdkeyoffer.com/cko/Moore11 ] [SPON: Use “brokensilicon” to get $30 OFF the Minisforum V3 3-in-1 Tablet: https://shrsl.com/4rt3x ] 0:00 Intel Raptor Lake Failures Update 13:45 Nvidia RTX 5090, 5080, 5070 Ti, and 5070 Thoughts 33:38 Will DLSS 4 work as well as stated? 42:10 Will "Neural Compression" actually fix Nvidia's VRAM issues? 47:30 FSR 4 vs DLSS 4 vs XeSS2, Intel Battlemage's Future 1:04:12 Why does Sony's PSSR references XeSS in Code? 1:09:22 (NEW LEAK) AMD RX 9070 XT & 9070 Release Date Update 1:21:45 RDNA 4 Pricing, Nvidia Marketing Trapped AMD 1:30:47 AMD vs NVIDIA Ray Tracing 1:39:12 Nintendo Switch 2 Performance Analysis 1:53:37 Windows on (Qualcomm) ARM 2:04:20 Nvidia's ARM APU could actually be REALLY good! 2:10:01 Linux Support & Anti-Cheat Issues 2:26:21 Intel's CES Keynote Last time Matt was on: https://youtu.be/rkVSgix0L38?si=KK4Szr9VVl0Bisjw https://www.nvidia.com/en-us/geforce/graphics-cards/50-series/ https://research.nvidia.com/labs/rtr/neural_texture_compression/ https://youtu.be/07UFu-OX1yI?t=218 https://alderongames.com/
Episode 55: Intel's Tom Petersen joins the podcast to chat about Arc Battlemage! We discuss fixing and improving game compatibility, the importance of enough VRAM, hardware design decisions including the die size, the future of the Arc division, XeSS 2 frame generation and plenty more.CHAPTERS00:00 - Intro02:12 - The Journey from Alchemist to Battlemage09:21 - Hardware Changes and Improving Game Compatibility15:13 - The Importance of VRAM20:11 - GPU Design Choices and Improvements34:18 - The Price38:12 - The Future of Arc: On the Chopping Block?48:28 - XeSS 2 Frame Generation and XeLL1:19:45 - Ray Tracing on Arc Battlemage1:25:32 - OutroSUBSCRIBE TO THE PODCASTAudio: https://shows.acast.com/the-hardware-unboxed-podcastVideo: https://www.youtube.com/channel/UCqT8Vb3jweH6_tj2SarErfwSUPPORT US DIRECTLYPatreon: https://www.patreon.com/hardwareunboxedLINKSYouTube: https://www.youtube.com/@Hardwareunboxed/Twitter: https://twitter.com/HardwareUnboxedBluesky: https://bsky.app/profile/hardwareunboxed.bsky.social Hosted on Acast. See acast.com/privacy for more information.
Episode 53: We've been testing games this week, including S.T.A.L.K.E.R. 2 and Flight Simulator 2024, so we discuss how these games run on PC. Loading issues, punishing CPU requirements, VRAM issues and more.CHAPTERS00:00 - Intro04:07 - Testing S.T.A.L.K.E.R. 214:51 - VRAM is An Issue Again34:18 - Floaty Controls and Frame Generation39:04 - Testing Flight Simulator 202446:51 - Updates From Our Boring LivesBluesky: https://bsky.app/profile/hardwareunboxed.bsky.socialSUBSCRIBE TO THE PODCASTAudio: https://shows.acast.com/the-hardware-unboxed-podcastVideo: https://www.youtube.com/channel/UCqT8Vb3jweH6_tj2SarErfwSUPPORT US DIRECTLYPatreon: https://www.patreon.com/hardwareunboxedFloatplane: https://www.floatplane.com/channel/HardwareUnboxedLINKSYouTube: https://www.youtube.com/@Hardwareunboxed/Twitter: https://twitter.com/HardwareUnboxed Hosted on Acast. See acast.com/privacy for more information.
We discuss Intel Arrow Lake, Lunar Lake, Zen 5, RADEON UDNA, PS5 Pro, and Nintendo Switch 2!!! [SPON: Thanks for Sponsoring the Video Odoo! Get your first App FREE here: https://www.odoo.com/r/xSwO ] [SPON: Use "brokensilicon“ at CDKeyOffer to get Win 11 Pro for $23: https://www.cdkeyoffer.com/cko/Moore11 ] 0:00 Tom messes up the beginning (Intro Banter) 3:06 XBOX Series S vs GTX 970 VRAM, XSX Disc Drives (Corrections) 9:12 Intel makes IFS a Subsidiary & Sells of Parts of the Company 17:57 AMD Strix Point vs Meteor Lake vs Hawk Point Pricing Analysis 32:20 AMD Ryzen AI Max+ 395 Blockchain GTA VI 38:53 Intel Lunar Lake Reviews - Competitive w/ Strix Point 49:47 PS5 Pro Revealed w/ Controversial $699 MSRP 50:31 PlayStation 5 Pro tested at 120Hz (Leak) 1:08:16 Lunar Lake Early Supply Leak 1:08:44 Nintendo Switch 2 Leaked 1:15:08 iPhone 16 Revealed, Launched, and Tested 1:21:02 Zen 5 CCX Latency, Arrow Lake Performance, UDNA, FSR 4 (Wrap-Up) 1:31:59 IPC Terminology, RDNA 4 Ray Tracing (Final Reader Mail) https://www.xbox.com/en-US/consoles/xbox-series-x https://www.cnbc.com/2024/09/16/intel-turns-foundry-business-into-subsidiary-weighs-outside-funding.html https://www.servethehome.com/intel-creating-foundry-subsidiary-and-announcing-a-big-aws-win/ https://www.nasdaq.com/articles/beaten-down-intel-stock-buy-foundry-spinoff-plans https://x.com/AnhPhuH/status/1837053994591735905 https://www.newegg.com/p/2S3-0006-002E9 https://www.newegg.com/p/1TS-000E-1B8Y6?Item=9SIAMRPKA16634 https://www.newegg.com/p/1TS-000E-1B481?Item=9SIAKDXK9J5011 https://www.newegg.com/p/1TS-000X-05XE2 https://weibo.com/3219724922/OxQViq3ja https://www.tomshardware.com/pc-components/cpus/amd-pushes-ryzen-to-the-max-ryzen-ai-max-300-strix-halo-reportedly-has-up-to-16-zen-5-cores-and-40-rdna-3-cus https://youtu.be/BLwwytLe4DA?si=-K2sqw0xyeaTstW8 https://www.youtube.com/live/X24BzyzQQ-8?si=L5IHsTEzmnNuisUp https://youtu.be/6HaRMiTfvks https://youtu.be/jGRxqfG7RxY https://youtube.com/live/-nhZJ1RTTsM?feature=share https://youtu.be/5qlOQg2mEsw https://www.youtube.com/watch?v=fJZ6ndDACG8 https://www.cnet.com/tech/gaming/exclusive-hands-on-i-played-sonys-all-new-ps5-pro/ https://www.tomsguide.com/gaming/playstation/playstation-30th-anniversary-collection-pre-orders-how-to-buy https://x.com/deckwizardyt/status/1836365264625058214 https://x.com/deckwizardyt/status/1837089911809183976 https://x.com/carygolomb/status/1836377056780698009 https://x.com/mooreslawisdead/status/1836548687352172868 https://youtu.be/5qlOQg2mEsw https://www.youtube.com/watch?v=UArxpvOZV5M&ab_channel=%E5%B0%8F%E5%AE%81%E5%AD%90XNZ https://www.reddit.com/r/GamingLeaksAndRumours/comments/1fjp352/photos_of_switch_2_factory_prototypes_have_leaked/ https://www.apple.com/newsroom/2024/09/apple-introduces-iphone-16-and-iphone-16-plus/ https://www.apple.com/newsroom/2024/09/apple-debuts-iphone-16-pro-and-iphone-16-pro-max/ https://finance.yahoo.com/news/apple-iphone-16-reaches-stores-004937230.html https://www.pcmag.com/news/which-iphone-16-is-fastest-a18-vs-18-pro-processors-benchmarked https://www.applemust.com/the-queues-for-iphone-16-track-emerging-economic-realities/ https://www.cbsnews.com/news/apple-iphone-16-on-sale-but-without-ai/ https://www.businessinsider.com/apple-intelligence-features-rollout-timeline-iphone-16-2024-9 https://www.youtube.com/watch?v=hp0dZEXZ_7I&ab_channel=MrMacRight
© 2020-2026 Ivy Podcast Discovery LLC
