AI news discussion and interviews by AI researchers, so you can know what is actually happening with AI and what is just clickbait headlines.
The Let's Talk AI podcast is an outstanding resource for anyone interested in staying up to date with the latest developments in the field of artificial intelligence. Hosted by Andrey Kurenkov and Jeremy Harris, this podcast provides a comprehensive overview of AI news, research, tools, policies, and other important areas. The hosts are highly knowledgeable and credible, offering insightful analysis and bringing different perspectives to each episode. They do an excellent job of summarizing complex technical papers and distilling the most important information for their listeners. The amount of work they put into covering a vast amount of information each week is truly commendable.
One of the best aspects of this podcast is its ability to cover a wide range of topics without overwhelming the listener. Unlike other podcasts that dive too deep into specific subjects, Let's Talk AI strikes the right balance between providing informative content and keeping it accessible for all listeners. The hosts' engaging dynamic and likable personalities make every episode enjoyable to listen to. Additionally, their consistent weekly releases help to keep pace with the rapidly evolving field of AI.
While there are numerous positive aspects to this podcast, one potential downside is the length of each episode. Some episodes can run for 90 minutes or more, which might be too long for some listeners who prefer shorter podcasts. However, there are bookmarks available to allow skipping ahead to specific topics if desired.
In conclusion, The Let's Talk AI podcast is an indispensable source of information for anyone interested in artificial intelligence. With its knowledgeable hosts, broad coverage of topics, and commitment to quality content, this podcast stands out as a top choice for staying updated on AI news. Whether you're a ML engineer working with AI technologies or simply a curious listener eager to learn more about this exciting field, Let's Talk AI delivers valuable insights and analysis week after week.
Our 211th episode with a summary and discussion of last week's big AI news! Recorded on 05/31/2025 Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. Join our Discord here! https://discord.gg/nTyezGSKwP In this episode: Recent AI podcast covers significant AI news: startups, new tools, applications, investments in hardware, and research advancements. Discussions include the introduction of various new tools and applications such as Flux's new image generating models and Perplexity's new spreadsheet and dashboard functionalities. A notable segment focuses on OpenAI's partnership with the UAE and discussions on potential legislation aiming to prevent states from regulating AI for a decade. Concerns around model behaviors and safety are discussed, highlighting incidents like Claude Opus 4's blackmail attempt and Palisade Research's tests showing AI models bypassing shutdown commands. Timestamps + Links: (00:00:10) Intro / Banter (00:01:39) News Preview (00:02:50) Response to Listener Comments Tools & Apps (00:07:10) Anthropic launches a voice mode for Claude (00:10:35) Black Forest Labs' Kontext AI models can edit pics as well as generate them (00:15:30) Perplexity's new tool can generate spreadsheets, dashboards, and more (00:18:43) xAI to pay Telegram $300M to integrate Grok into the chat app (00:22:42) Opera's new AI browser promises to write code while you sleep (00:24:17) Google Photos debuts redesigned editor with new AI tools Applications & Business (00:25:13) Top Chinese memory maker expected to abandon DDR4 manufacturing at the behest of Beijing (00:30:04) Oracle to Buy $40 Billion Worth of Nvidia Chips for First Stargate Data Center (00:31:47) UAE makes ChatGPT Plus subscription free for all residents as part of deal with OpenAI (00:35:34) NVIDIA Corporation (NVDA) to Launch Cheaper Blackwell AI Chip for China, Says Report (00:38:39) The New York Times and Amazon ink AI licensing deal Projects & Open Source (00:41:11) DeepSeek's distilled new R1 AI model can run on a single GPU (00:45:19) Google Unveils SignGemma, an AI Model That Can Translate Sign Language Into Spoken Text (00:47:08) Open-sourcing circuit tracing tools (00:49:42) Hugging Face unveils two new humanoid robots Research & Advancements (00:52:33) PANGU PRO MOE: MIXTURE OF GROUPED EXPERTS FOR EFFICIENT SPARSITY (00:58:55) DataRater: Meta-Learned Dataset Curation (01:05:05) Incorrect Baseline Evaluations Call into Question Recent LLM-RL Claims (01:10:17) Maximizing Confidence Alone Improves Reasoning (01:11:00) Guided by Gut: Efficient Test-Time Scaling with Reinforced Intrinsic Confidence (01:11:44) One RL to See Them All (01:15:05) Efficient Reinforcement Finetuning via Adaptive Curriculum Learning Policy & Safety (01:17:58) Trump's 'Big Beautiful Bill' could ban states from regulating AI for a decade (01:24:31) Researchers claim ChatGPT o3 bypassed shutdown in controlled test (01:30:10) Anthropic's new AI model turns to blackmail when engineers try to take it offline (01:31:09) Anthropic Faces Backlash As Claude 4 Opus Can Autonomously Alert Authorities (01:35:37) Claude helps users make bioweapons (01:35:49) The Claude 4 System Card is a Wild Read
Our 210th episode with a summary and discussion of last week's big AI news! Recorded on 05/23/2025 Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. Join our Discord here! https://discord.gg/nTyezGSKwP In this episode: Google's Gemini diffusion technology showcases significant improvements in speed and efficiency for generating text, potentially revolutionizing the auto-regressive generation paradigm. Anthropic activates AI Safety Level 3 protections for Claude Opus 4, implementing robust measures such as bug bounties, synthetic jailbreak data, and preliminary egress bandwidth controls to mitigate bio-risk threats. OpenAI responds to the California Attorney General, refuting claims by the not-for-private-gain coalition and defending their controversial restructuring plans amidst ongoing criticism. Mistral delays the release of its Llama 4 Behemoth model due to training challenges, while Meta faces similar obstacles in rolling out its large-scale AI models, signaling difficulties in reaching frontier level performance. Timestamps + Links: (00:00:00) Intro / Banter (00:01:43) News Preview Tools & Apps (00:02:58) Anthropic's new Claude 4 AI models can reason over many steps (00:09:58) Google Unveils A.I. Chatbot, Signaling a New Era for Search (00:14:04) Google rolls out Project Mariner, its web-browsing AI agent (00:16:40) Veo 3 can generate videos — and soundtracks to go along with them (00:21:26) Imagen 4 is Google's newest AI image generator (00:23:15) Google Meet is getting real-time speech translation (00:25:36) Google's new Jules AI agent will help developers fix buggy code (00:26:43) GitHub's new AI coding agent can fix bugs for you (00:28:50) Mistral's new Devstral model was designed for coding Applications & Business (00:29:53) OpenAI Unites With Jony Ive in $6.5 Billion Deal to Create A.I. Devices (00:36:10) OpenAI's planned data center in Abu Dhabi would be bigger than Monaco (00:41:18) LM Arena, the organization behind popular AI leaderboards, lands $100M (00:45:21) Nvidia CEO says next chip after H20 for China won't be from Hopper series (00:46:39) Google's Gemini AI app has 400M monthly active users (00:51:15) AI Servers: End demand intact, but rising gap between upstream build and system production (2025.5.18) Projects & Open Source (00:53:46) Meta Is Delaying the Rollout of Its Flagship AI Model Research & Advancements (00:57:53) Gemini Diffusion (01:03:07) Chain-of-Model Learning for Language Model (01:09:16) Seek in the Dark: Reasoning via Test-Time Instance-Level Policy Gradient in Latent Space (01:15:38) Two Experts Are All You Need for Steering Thinking: Reinforcing Cognitive Effort in MoE Reasoning Models Without Additional Training (01:20:16) Lessons from Defending Gemini Against Indirect Prompt Injections (01:23:35) How Fast Can Algorithms Advance Capabilities? (01:30:20) Reinforcement Learning Finetunes Small Subnetworks in Large Language Models Policy & Safety (01:31:12) Exclusive: What OpenAI Told California's Attorney General (01:38:25) Activating AI Safety Level 3 Protections
Our 209th episode with a summary and discussion of last week's big AI news! Recorded on 05/16/2025 Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. Join our Discord here! https://discord.gg/nTyezGSKwP In this episode: OpenAI has decided not to transition from a nonprofit to a for-profit entity, instead opting to become a public benefit corporation influenced by legal and civic discussions. Trump administration meetings with Saudi Arabia and the UAE have opened floodgates for AI deals, leading to partnerships with companies like Nvidia and aiming to bolster AI infrastructure in the Middle East. DeepMind introduced Alpha Evolve, a new coding agent designed for scientific and algorithmic discovery, showing improvements in automated code generation and efficiency. OpenAI pledges greater transparency in AI safety by launching the Safety Evaluations Hub, a platform showcasing various safety test results for their models. Timestamps + Links: (00:00:00) Intro / Banter (00:01:41) News Preview (00:02:26) Response to listener comments Applications & Business (00:03:00) OpenAI says non-profit will remain in control after backlash (00:13:23) Microsoft Moves to Protect Its Turf as OpenAI Turns Into Rival (00:18:07) TSMC's 2nm Process Said to Witness ‘Unprecedented' Demand, Exceeding 3nm Due to Interest from Apple, NVIDIA, AMD, & Many Others (00:21:42) NVIDIA's Global Headquarters Will Be In Taiwan, With CEO Huang Set To Announce Site Next Week, Says Report (00:23:58) CoreWeave in Talks for $1.5 Billion Debt Deal 6 Weeks After IPO Tools & Apps (00:26:39) The Day Grok Told Everyone About ‘White Genocide' (00:32:58) Figma releases new AI-powered tools for creating sites, app prototypes, and marketing assets (00:36:12) Google's bringing Gemini to your car with Android Auto (00:38:49) Google debuts an updated Gemini 2.5 Pro AI model ahead of I/O (00:45:09) Hugging Face releases a free Operator-like agentic AI tool Projects & Open Source (00:47:42) Stability AI releases an audio-generating model that can run on smartphones (00:50:47) Freepik releases an ‘open' AI image generator trained on licensed data (00:54:22) AM-Thinking-v1: Advancing the Frontier of Reasoning at 32B Scale (01:01:29) BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Dataset Research & Advancements (01:05:40) DeepMind claims its newest AI tool is a whiz at math and science problems (01:12:31) Absolute Zero: Reinforced Self-play Reasoning with Zero Data (01:19:44) How far can reasoning models scale? (01:26:47) HealthBench: Evaluating Large Language Models Towards Improved Human Health Policy & Safety (01:34:10) Trump administration officially rescinds Biden's AI diffusion rules (01:37:08) Trump's Mideast Visit Opens Floodgate of AI Deals Led by Nvidia (01:44:04) Scaling Laws For Scalable Oversight (01:49:43) OpenAI pledges to publish AI safety test results more often
Our 208th episode with a summary and discussion of last week's big AI news! Recorded on 05/02/2025 Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. Join our Discord here! https://discord.gg/nTyezGSKwP In this episode: OpenAI showcases new integration capabilities in their API, enhancing the performance of LLMs and image generators with updated functionalities and improved user interfaces. Analysis of OpenAI's preparedness framework reveals updates focusing on biological and chemical risks, cybersecurity, and AI self-improvement, while tone down the emphasis on persuasion capabilities. Anthropic's research highlights potential security vulnerabilities in AI models, demonstrating various malicious use cases such as influence operations and hacking tool creation. A detailed examination of AI competition between the US and China reveals China's impending capability to match the US in AI advancement this year, emphasizing the impact of export controls and the importance of geopolitical strategy. Timestamps + Links: Tools & Apps (00:02:57) Anthropic lets users connect more apps to Claude (00:08:20) OpenAI undoes its glaze-heavy ChatGPT update (00:15:16) Baidu ERNIE X1 and 4.5 Turbo boast high performance at low cost (00:19:44) Adobe adds more image generators to its growing AI family (00:24:35) OpenAI makes its upgraded image generator available to developers (00:27:01) xAI's Grok chatbot can now ‘see' the world around it Applications & Business: (00:28:41) Thinking Machines Lab CEO Has Unusual Control in Andreessen-Led Deal (00:33:36) Chip war heats up: Huawei 910C emerges as China's answer to US export bans (00:34:21) Huawei to Test New AI Chip (00:40:17) ByteDance, Alibaba and Tencent stockpile billions worth of Nvidia chips (00:43:59) Speculation mounts that Musk will raise tens of billions for AI supercomputer with 1 million GPUs: Report Projects & Open Source: (00:47:14) Alibaba unveils Qwen 3, a family of ‘hybrid' AI reasoning models (00:54:14) Intellect-2 (01:02:07) BitNet b1.58 2B4T Technical Report (01:05:33) Meta AI Introduces Perception Encoder: A Large-Scale Vision Encoder that Excels Across Several Vision Tasks for Images and Video Research & Advancements: (01:06:42) The Leaderboard Illusion (01:12:08) Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model? (01:18:38) Reinforcement Learning for Reasoning in Large Language Models with One Training Example (01:24:40) Sleep-time Compute: Beyond Inference Scaling at Test-time Policy & Safety: (01:28:23) Every AI Datacenter Is Vulnerable to Chinese Espionage, Report Says (01:32:27) OpenAI preparedness framework update (01:38:31) Detecting and Countering Malicious Uses of Claude: March 2025 (01:46:33) Chinese AI Will Match America's
Our 207th episode with a summary and discussion of last week's big AI news! Recorded on 04/14/2025 Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. Join our Discord here! https://discord.gg/nTyezGSKwP In this episode: OpenAI introduces GPT-4.1 with optimized coding and instruction-following capabilities, featuring variants like GPT-4.1 Mini and Nano, and a million-token context window. Concerns arise as OpenAI reduces resources for safety testing, sparking internal and external criticisms. XAI's newly launched API for Grok 3 showcases significant capabilities comparable to other leading models. Meta faces allegations of aiding China in AI development for business advantages, with potential compliances and public scrutiny looming. Timestamps + Links: Tools & Apps (00:03:13) OpenAI's new GPT-4.1 AI models focus on coding (00:08:12) ChatGPT will now remember your old conversations (00:11:16) Google's newest Gemini AI model focuses on efficiency (00:14:27) Elon Musk's AI company, xAI, launches an API for Grok 3 (00:18:35) Canva is now in the coding and spreadsheet business (00:20:31) Meta's vanilla Maverick AI model ranks below rivals on a popular chat benchmark Applications & Business (00:25:46) Ironwood: The first Google TPU for the age of inference (00:34:15) Anthropic rolls out a $200-per-month Claude subscription (00:37:17) OpenAI co-founder Ilya Sutskever's Safe Superintelligence reportedly valued at $32B (00:40:20) Mira Murati's AI startup gains prominent ex-OpenAI advisers (00:42:52) Hugging Face buys a humanoid robotics startup (00:44:58) Stargate developer Crusoe could spend $3.5 billion on a Texas data center. Most of it will be tax-free. Projects & Open Source (00:48:14) OpenAI Open Sources BrowseComp: A New Benchmark for Measuring the Ability for AI Agents to Browse the Web Research & Advancements (00:56:09) Sample, Don't Search: Rethinking Test-Time Alignment for Language Models (01:03:32) Concise Reasoning via Reinforcement Learning (01:09:37) Going beyond open data – increasing transparency and trust in language models with OLMoTrace (01:15:34) Independent evaluations of Grok-3 and Grok-3 mini on our suite of benchmarks Policy & Safety (01:17:58) OpenAI countersues Elon Musk, calls for enjoinment from ‘further unlawful and unfair action' (01:24:33) OpenAI slashes AI model safety testing time (01:27:55) Ex-OpenAI staffers file amicus brief opposing the company's for-profit transition (01:32:25) Access to future AI models in OpenAI's API may require a verified ID (01:34:53) Meta whistleblower claims tech giant built $18 billion business by aiding China in AI race and undermining U.S. national security
Our 206th episode with a summary and discussion of last week's big AI news! Recorded on 04/07/2025 Try out the Astrocade demo here! https://www.astrocade.com/ Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. Join our Discord here! https://discord.gg/nTyezGSKwP In this episode: Meta releases LlAMA-4, a series of advanced large language models, sparking debate on performance and release timing, with models featuring up to 2 trillion parameters for different configurations and applications. Amazon's AGI Lab debuts NOVA Act, an AI agent for web browser control, boasting competitive benchmarking against OpenAI's and Anthropic's best agents. OpenAI's image generation capabilities and ongoing financing developments, notably a $40 billion funding round led by SoftBank, highlight significant advancements and strategic shifts in the tech giant's operations. Timestamps + Links: (00:00:00) Intro / Banter Tools & Apps (00:01:46) Meta releases Llama 4, a new crop of flagship AI models (00:13:55) Amazon unveils Nova Act, an AI agent that can control a web browser (00:17:06) Alibaba Preparing for Flagship AI Model Release as Soon as April (00:17:59) Runway releases an impressive new video-generating AI model (00:19:10) Adobe launches Premiere Pro's generative AI video extender (00:20:54) OpenAI prepares reasoning slider and memory update for ChatGPT users Applications & Business (00:21:28) Nvidia H20 Chips: $16 Billion Orders from ByteDance, Alibaba, and Tencent (00:24:45) Elon Musk sells X for $33 billion to his own AI startup company xAI (00:28:00) SoftBank dethroned Microsoft as OpenAI's largest investor, pushing the ChatGPT maker's market cap to $300 billion — but reportedly buried itself in debt (00:30:48) DeepMind is holding back release of AI research to give Google an edge (00:34:06) SMIC Is Rumored To Complete 5nm Chip Development By 2025; Costs Could Be Up To 50 Percent Higher Than TSMC's Version Due To The Use Of Older-Generation Equipment (00:36:04) Google-backed Isomorphic Labs raises $600m to advance AI drug discovery Research & Advancements (00:38:03) PaperBench: Evaluating AI's Ability to Replicate AI Research (00:43:50) Crossing the Reward Bridge: Expanding RL with Verifiable Rewards Across Diverse Domains (00:48:39) Inference-Time Scaling for Complex Tasks: Where We Stand and What Lies Ahead (00:54:34) Overtrained Language Models Are Harder to Fine-Tune Policy & Safety (00:58:28) Taking a responsible path to AGI (01:02:32) This A.I. Forecast Predicts Storms Ahead (01:06:24) The Secrets and Misdirection Behind Sam Altman's Firing From OpenAI OpenAI's new image generation capabilities represent significant advancements in AI tools, showcasing impressive benchmarks and multimodal functionalities. OpenAI is finalizing a historic $40 billion funding round led by SoftBank, and Sam Altman shifts focus to technical direction while COO Brad Lightcap takes on more operational responsibilities., Anthropic unveils groundbreaking interpretability research, introducing cross-layer tracers and showcasing deep insights into model reasoning through applications on Claude 3.5. New challenging benchmarks such as ARC AGI 2 and complex Sudoku variations aim to push the boundaries of reasoning and problem-solving capabilities in AI models.
Our 205th episode with a summary and discussion of last week's big AI news! Recorded on 03/28/2025 Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. Join our Discord here! https://discord.gg/nTyezGSKwP In this episode: OpenAI's new image generation capabilities represent significant advancements in AI tools, showcasing impressive benchmarks and multimodal functionalities. OpenAI is finalizing a historic $40 billion funding round led by SoftBank, and Sam Altman shifts focus to technical direction while COO Brad Lightcap takes on more operational responsibilities., Anthropic unveils groundbreaking interpretability research, introducing cross-layer tracers and showcasing deep insights into model reasoning through applications on Claude 3.5. New challenging benchmarks such as ARC AGI 2 and complex Sudoku variations aim to push the boundaries of reasoning and problem-solving capabilities in AI models. Timestamps + Links: (00:00:00) Intro / Banter (00:01:01) News Preview Tools & Apps (00:02:46) Gemini 2.5: Our most intelligent AI model (00:08:41) OpenAI rolls out image generation powered by GPT-4o to ChatGPT (00:16:14) Ideogram presents version 3.0 of its AI image generation system (00:19:20) New Reve Image Generator Beats AI Art Heavyweights MidJourney and Flux at a Penny Per Image (00:21:56) Alibaba Releases Qwen2.5 Omni, Adds Voice and Video Modes to Qwen Chat (00:23:58) The official version of Tencent's Hunyuan Deep Thinking Model T1 is here, with fast articulation, instant responses, and a decoding speed increase of 2 times Applications & Business (00:25:45) OpenAI Close to Finalizing $40 Billion SoftBank-Led Funding (00:29:26) OpenAI reshuffles leadership as Sam Altman pivots to technical focus (00:33:23) Nvidia shows off Rubin Ultra with 600,000-Watt Kyber racks and infrastructure, coming in 2027 (00:35:23) China's SiCarrier emerges as challenger to ASML, other chip tool titans (00:38:24) Pony.ai wins first permit for fully driverless taxi operation in the center of China's Silicon Valley Projects & Open Source (00:40:27) A new, challenging AGI test stumps most AI models (00:45:16) Challenging the Boundaries of Reasoning: An Olympiad-Level Math Benchmark for Large Language Models (00:48:13) Wan: Open and Advanced Large-Scale Video Generative Models (00:50:38) DeepSeek V3-0324 tops non-reasoning AI models in open-source first (00:54:46) OpenAI adopts rival Anthropic's standard for connecting AI models to data Research & Advancements (00:55:56) Anthropic can now track the bizarre inner workings of a large language model (01:06:00) Chain-of-Tools: Utilizing Massive Unseen Tools in the CoT Reasoning of Frozen Language Models (01:11:50) Inside-Out: Hidden Factual Knowledge in LLMs (01:15:14) Sakana AI super-powers AI reasoning using Japan's own Sudoku Puzzles Policy & Safety (01:18:38) Senator Wiener Introduces Legislation to Protect AI Whistleblowers & Boost Responsible AI Development (01:21:50) NVIDIA & Other Tech Giants Demand Trump Administration To Reconsider “AI Diffusion” Policy Which Is Set To Be Effective By May 15 (01:23:17) U.S. blacklists over 50 Chinese companies in bid to curb Beijing's AI, chip capabilities (01:26:44) Netflix's Reed Hastings Gives $50 Million to Bowdoin for A.I. Program (01:27:55) Judge allows 'New York Times' copyright case against OpenAI to go forward (01:29:48) Judge rules that AI can continue training on copyrighted lyrics, for now
Our 204th episode with a summary and discussion of last week's big AI news! Recorded on 03/21/2025 Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. Join our Discord here! https://discord.gg/nTyezGSKwP In this episode: Baidu launched two new multimodal models, Ernie 4.5 and Ernie X1, boasting competitive pricing and capabilities compared to Western counterparts like GPT-4.5 and DeepSeek R1. OpenAI introduced new audio models, including impressive speech-to-text and text-to-speech systems, and added O1 Pro to their developer API at high costs, reflecting efforts for more profitability. Nvidia and Apple announced significant hardware advancements, including Nvidia's future GPU plans and Apple's new Mac Studio offering that can run DeepSeek R1. DeepSeek employees are facing travel restrictions, suggesting China is treating its AI development with increased secrecy and urgency, emphasizing a wartime footing in AI competition. Timestamps + Links: (00:00:00) Intro / Banter (00:01:36) News Preview Tools & Apps (00:02:50) Baidu launches two new versions of its AI model Ernie (00:10:46) OpenAI Unveils New Audio Models to Make AI Agents Sound More Human Than Ever (00:16:41) OpenAI's o1-pro is the company's most expensive AI model yet (00:20:53) Google brings a ‘canvas' feature to Gemini, plus Audio Overview (00:22:18) Anthropic adds web search to its Claude chatbot (00:23:55) xAI launches an API for generating images Applications & Business (00:26:28) Nvidia announces Rubin GPUs in 2026, Rubin Ultra in 2027, Feynman also added to roadmap (00:36:25) M3 Ultra Runs DeepSeek R1 With 671 Billion Parameters Using 448GB Of Unified Memory, Delivering High Bandwidth Performance At Under 200W Power Consumption, With No Need For A Multi-GPU Setup (00:40:07) Intel reaches 'exciting milestone' for 18A 1.8nm-class wafers with first run at Arizona fab (00:42:45) Elon Musk's AI company, xAI, acquires a generative AI video startup (00:44:44) Tencent Reportedly Makes Massive NVIDIA H20 Chip Purchase for WeChat's DeepSeek Integration Projects & Open Source (00:46:32) Anthropic's Not-So-Secret Weapon That's Giving Agents a Boost (00:50:50) Mistral AI drops new open-source model that outperforms GPT-4o Mini with fraction of parameters (00:53:30) EXAONE Deep: Reasoning Enhanced Language Models Research & Advancements (00:55:58) Sample, Scrutinize and Scale: Effective Inference-Time Search by Scaling Verification (01:07:44) Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models (01:12:27) Communication-Efficient Language Model Training Scales Reliably and Robustly: Scaling Laws for DiLoCo (01:18:46) Transformers without Normalization (01:19:52) Measuring AI Ability to Complete Long Tasks (01:26:12) HCAST: Human-Calibrated Autonomy Software Tasks Policy & Safety (01:26:45) Announcing Zochi, an Intology Project (01:32:46) DeepSeek, a National Treasure in China, is Now Being Closely Guarded (01:37:02) Claude Sonnet 3.7 (often) knows when it's in alignment evaluations Synthetic Media & Art (01:42:27) US appeals court rejects copyrights for AI-generated art lacking 'human' creator (01:45:10) Trump urged by Ben Stiller, Paul McCartney and hundreds of stars to protect AI copyright rules
Our 203rd episode with a summary and discussion of last week's big AI news! Recorded on 03/14/2025 Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. Join our Discord here! https://discord.gg/nTyezGSKwP In this episode: OpenAI's new 'deep research' feature has raised concerns about cybersecurity and the potential misuse of AI models for bio-weapons and autonomous capabilities, prompting new safety and governance measures. Google's extensive $3 billion investment in Anthropic is revealed, aligning with their AI strategy and reinforcing the importance of multiple technology partnerships. Huawei's advancements in the AI chip industry are highlighted, with significant progress in producing chips comparable to Nvidia's H100, despite export control challenges. China's recent directive discourages AI executives from traveling to the US, reflecting heightened security concerns and potentially signaling a more adversarial stance in the AI race. Timestamps + Links: (00:00:00) Intro / Banter (00:01:30) News Preview Tools & Apps (00:02:30) OpenAI launches new tools to help businesses build AI agents (00:08:50) You can now test Gemini 2.0 Flash's native image output (00:13:32) Waymo is now offering 24/7 robotaxi rides in Silicon Valley (00:17:19) Moonvalley releases a video generator it claims was trained on licensed content (00:21:11) Snap introduces AI Video Lenses powered by its in-house generative model (00:23:37) Sudowrite Launches Muse AI Model That Can Generate Narrative-Driven Fiction Applications & Business (00:27:48) In another chess move with Microsoft, OpenAI is pouring $12B into CoreWeave (00:30:54) Huawei's Ascend 910C Takes on NVIDIA as China's AI Race Heats Up: More Alleged Details (00:36:26) Huawei reportedly acquired two million Ascend 910 AI chips from TSMC last year through shell companies (00:40:27) Inside Google's Investment in the A.I. Start-Up Anthropic (00:43:26) Meta is reportedly testing in-house chips for AI training (00:46:48) Elon Musk's xAI buys 1 million sq ft site for second Memphis data center (00:50:02) Superintelligence startup Reflection AI launches with $130M in funding Projects & Open Source (00:53:11) Google calls Gemma 3 the most powerful AI model you can run on one GPU (00:58:18) Sesame, the startup behind the viral virtual assistant Maya, releases its base AI model (01:01:13) Reka AI Open Sourced Reka Flash 3: A 21B General-Purpose Reasoning Model that was Trained from Scratch (01:04:19) Open-Sora 2.0: Training a Commercial-Level Video Generation Model in $200k Research & Advancements (01:06:25) Google's Gemini Robotics AI Model Reaches Into the Physical World (01:14:33) Optimizing Test-Time Compute via Meta Reinforcement Fine-Tuning (01:23:29) Deep Research System Card (01:29:50) Claude 3.7 Sonnet System Card Policy & Safety (01:33:24) Detecting misbehavior in frontier reasoning models (01:39:30) China tells its AI leaders to avoid US travel over security concerns, WSJ reports (01:43:48) Outro
Our 202nd episode with a summary and discussion of last week's big AI news! Recorded on 03/07/2025 Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. Join our Discord here! https://discord.gg/nTyezGSKwP In this episode: Alibaba released Qwen-32B, their latest reasoning model, on par with leading models like DeepMind's R1. Anthropic raised $3.5 billion in a funding round, valuing the company at $61.5 billion, solidifying its position as a key competitor to OpenAI. DeepMind introduced BigBench Extra Hard, a more challenging benchmark to evaluate the reasoning capabilities of large language models. Reinforcement Learning pioneers Andrew Bartow and Rich Sutton were awarded the prestigious Turing Award for their contributions to the field. Timestamps + Links: cle picks: (00:00:00) Intro / Banter (00:01:41) Episode Preview (00:02:50) GPT-4.5 Discussion (00:14:13) Alibaba's New QwQ 32B Model is as Good as DeepSeek-R1 ; Outperforms OpenAI's o1-mini (00:21:29) With Alexa Plus, Amazon finally reinvents its best product (00:26:08) Another DeepSeek moment? General AI agent Manus shows ability to handle complex tasks (00:29:14) Microsoft's new Dragon Copilot is an AI assistant for healthcare (00:32:24) Mistral's new OCR API turns any PDF document into an AI-ready Markdown file (00:33:19) A.I. Start-Up Anthropic Closes Deal That Values It at $61.5 Billion (00:35:49) Nvidia-Backed CoreWeave Files for IPO, Shows Growing Revenue (00:38:05) Waymo and Uber's Austin robotaxi expansion begins today (00:38:54) UK competition watchdog drops Microsoft-OpenAI probe (00:41:17) Scale AI announces multimillion-dollar defense deal, a major step in U.S. military automation (00:44:43) DeepSeek Open Source Week: A Complete Summary (00:45:25) DeepSeek AI Releases DualPipe: A Bidirectional Pipeline Parallelism Algorithm for Computation-Communication Overlap in V3/R1 Training (00:53:00) Physical Intelligence open-sources Pi0 robotics foundation model (00:54:23) BIG-Bench Extra Hard (00:56:10) Cognitive Behaviors that Enable Self-Improving Reasoners (01:01:49) The MASK Benchmark: Disentangling Honesty From Accuracy in AI Systems (01:05:32) Pioneers of Reinforcement Learning Win the Turing Award (01:06:56) OpenAI launches $50M grant program to help fund academic research (01:07:25) The Nuclear-Level Risk of Superintelligent AI (01:13:34) METR's GPT-4.5 pre-deployment evaluations (01:17:16) Chinese buyers are getting Nvidia Blackwell chips despite US export controls
Our 201st episode with a summary and discussion of last week's big AI news! Recorded on 03/02/2025 Join our brand new Discord here! https://discord.gg/nTyezGSKwP Hosted by Andrey Kurenkov and guest host Sharon Zhou Feel free to email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. In this episode: - The release of GPT-4.5 from OpenAI, Anthropic's Claude 3.7, and Grok 3 from XAI, comparing their features, costs, and capabilities. - Discussion on new tools and applications including Sesame's new voice assistant and Google's AI coding assistant, Gemini Code Assist, highlighting their unique benefits. - OpenAI's continued user growth despite competition, pricing models for Google's text-to-video platform, and HP acquiring and shutting down Humane's AI pin. - Insights into new research on alignment and specification gaming in LLMs, including papers on fine-tuning causing broad misalignment and Google's multi-agent system for scientific collaboration. Timestamps + Links: (00:00:00) Intro / Banter (00:01:36) News Preview Tools & Apps (00:02:33) OpenAI announces GPT-4.5, warns it's not a frontier AI model (00:07:22) Anthropic launches a new AI model that ‘thinks' as long as you want (00:11:14) New Grok 3 release tops LLM leaderboards (00:16:43) Sesame is the first voice assistant I've ever wanted to talk to more than once (00:18:30) Google launches a free AI coding assistant with very high usage caps (00:20:45) Rabbit shows off the AI agent it should have launched with (00:22:23) Mistral's Le Chat tops 1M downloads in just 14 days Applications & Business (00:24:06) OpenAI Tops 400 Million Users Despite DeepSeek's Emergence (00:27:37) Google's new AI video model Veo 2 will cost 50 cents per second (00:29:52) HP is buying Humane and shutting down the AI Pin Projects & Open Source (00:31:44) Microsoft launches next-gen Phi AI models. (00:33:47) OpenAI introduces SWE-Lancer: A Benchmark for Evaluating Model Performance on Real-World Freelance Software Engineering Work (00:37:12) SWE-Bench+: Enhanced Coding Benchmark for LLMs Research & Advancements (00:40:00) Towards an AI co-scientist (00:42:52) Magma: A Foundation Model for Multimodal AI Agents Policy & Safety (00:47:32) Demonstrating specification gaming in reasoning models (00:51:03) Emergent Misalignment: Narrow finetuning can produce broadly misaligned LLMs
Our 200th episode with a summary and discussion of last week's big AI news! Recorded on 02/14/2025 Join our brand new Discord here! https://discord.gg/nTyezGSKwP Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. In this episode: OpenAI announces plans to unify their model offerings, moving away from multiple separate models (GPT-4, Claude, etc.) toward a single unified intelligence system, with free users getting "standard intelligence" and Plus subscribers accessing "higher intelligence" levels. Adobe launches their Sora-rivaling AI video generator with 1080p output and 5-second clips, emphasizing production-ready content for films and introducing new pricing tiers through Firefly subscriptions at $10-30 per month. Elon Musk and a consortium offer $97.4 billion to acquire OpenAI's nonprofit entity, potentially complicating the company's transition to a for-profit structure, though Sam Altman quickly dismissed the offer's viability. TSMC implements stricter chip sales restrictions to China, requiring government-approved third-party packaging houses for chips using 16nm and below processes, aligning with US export control measures and affecting major tech companies like Nvidia and AMD. Timestamps + Links: (00:00:00) Intro / Banter (00:01:25) Response to listener comments (00:02:41) News Preview Tools & Apps (00:03:58) Adobe's Sora rivalling AI video generator is now available for everyone (00:09:45) OpenAI lays out plans for GPT-5 (00:16:42) OpenAI is rethinking how AI models handle controversial topics (00:21:28) Perplexity AI launches new ultra-fast AI search model Sonar (00:23:45) YouTube AI updates include auto dubbing expansion, age ID tech, and more Applications & Business (00:24:37) Musk-led group makes $97.4 billion bid for control of OpenAI (00:34:32) Anthropic's next major AI model could arrive within weeks (00:39:09) AI chip startup Groq secures $1.5 billion commitment from Saudi Arabia (00:42:15) OpenAI reportedly planning to build its first AI chip in 2026 Projects & Open Source (00:45:01) Zyphra Introduces the Beta Release of Zonos: A Highly Expressive TTS Model with High Fidelity Voice Cloning (00:51:11) Gemstones: A Model Suite for Multi-Faceted Scaling Laws (00:57:15) Hephaestus: Improving Fundamental Agent Capabilities of Large Language Models through Continual Pre-Training Research & Advancements (00:58:24) Model Tampering Attacks Enable More Rigorous Evaluations of LLM Capabilities (01:04:24) Distillation Scaling Laws (01:10:06) Matryoshka Quantization (01:17:47) How much AI compute exists globally? How rapidly is it growing? Policy & Safety (01:21:29) US and UK refuse to sign summit declaration on AI safety (01:25:43) Utility Engineering: Analyzing and Controlling Emergent Value Systems in AIs (01:34:40) xAI Risk Management Framework (Draft) (01:39:59) TSMC bans more chip sales to China due to stricter U.S. export sanctions (01:42:38) Listener requested topic Synthetic Media & Art (01:43:48) Thomson Reuters Wins First Major AI Copyright Case in the US (01:44:46) Scarlett Johansson calls for deepfake ban after AI video goes viral (01:45:55) Outro
Our 199th episode with a summary and discussion of last week's big AI news! Recorded on 02/09/2025 Join our brand new Discord here! https://discord.gg/nTyezGSKwP Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. In this episode: - OpenAI's deep research feature capability launched, allowing models to generate detailed reports after prolonged inference periods, competing directly with Google's Gemini 2.0 reasoning models. - France and UAE jointly announce plans to build a massive AI data center in France, aiming to become a competitive player within the AI infrastructure landscape. - Mistral introduces a mobile app, broadening its consumer AI lineup amidst market skepticism about its ability to compete against larger firms like OpenAI and Google. - Anthropic unveils 'Constitutional Classifiers,' a method showing strong defenses against universal jailbreaks; they also launched a $20K challenge to find weaknesses. Timestamps + Links: (00:00:00) Intro / Banter (00:02:27) News Preview (00:03:28) Response to listener comments Tools & Apps (00:08:01) OpenAI now reveals more of its o3-mini model's thought process (00:16:03) Google's Gemini app adds access to ‘thinking' AI models (00:21:04) OpenAI Unveils A.I. Tool That Can Do Research Online (00:31:09) Mistral releases its AI assistant on iOS and Android (00:36:17) AI music startup Riffusion launches its service in public beta (00:39:11) Pikadditions by Pika Labs lets users seamlessly insert objects into videos Applications & Business (00:41:19) Softbank set to invest $40 billion in OpenAI at $260 billion valuation, sources say (00:47:36) UAE to invest billions in France AI data centre (00:50:34) Report: Ilya Sutskever's startup in talks to fundraise at roughly $20B valuation (00:52:03) ASML to Ship First Second-Gen High-NA EUV Machine in the Coming Months, Aiming for 2026 Production (00:54:38) NVIDIA's GB200 NVL 72 Shipments Not Under Threat From DeepSeek As Hyperscalers Maintain CapEx; Meanwhile, Trump Tariffs Play Havoc With TSMC's Pricing Strategy Projects & Open Source (00:56:49) The Allen Institute for AI (AI2) Releases Tülu 3 405B: Scaling Open-Weight... (01:00:06) SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model (01:03:56) PhD Knowledge Not Required: A Reasoning Challenge for Large Language Models (01:08:26) OpenEuroLLM: Europe's New Initiative for Open-Source AI Development Research & Advancements (01:10:34) LIMO: Less is More for Reasoning (01:16:39) s1: Simple test-time scaling (01:19:17) ZebraLogic: On the Scaling Limits of LLMs for Logical Reasoning (01:23:55) Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Policy & Safety (01:26:50) US sets AI safety aside in favor of 'AI dominance' (01:29:39) Almost Surely Safe Alignment of Large Language Models at Inference-Time (01:32:02) Constitutional Classifiers: Defending against Universal Jailbreaks across Thousands of Hours of Red Teaming (01:33:16) Anthropic offers $20,000 to whoever can jailbreak its new AI safety system
Our 197th episode with a summary and discussion of last week's big AI news! Recorded on 01/17/2024 Join our brand new Discord here! https://discord.gg/nTyezGSKwP Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. In this episode: - DeepSeek releases R1, a competitive AI model comparable to OpenAI's O1, leading to market unrest and significant drops in tech stocks, including a 17% plunge in NVIDIA's stock. - OpenAI launches Operator to facilitate agentic computer use, while facing competition from new releases by DeepSeek and Quen, with applications seeing rapid adoption. - President Trump revokes the Biden administration's executive order on AI, signaling a shift in AI policy and deregulation efforts. - Taiwanese government clears TSMC to produce advanced 2-nanometer chip technology abroad, aiming to strengthen global semiconductor supply amidst geopolitical tensions. If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Timestamps + Links: (00:00:00) Intro / Banter (00:03:01) Response to listener comments Projects & Open Source (00:06:26) DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning (00:30:25) Viral AI company DeepSeek releases new image model family (00:34:07) Qwen2.5-1M Technical Report (00:38:32) Alibaba's Qwen team releases AI models that can control PCs and phones Tools & Apps (00:42:09) OpenAI launches Operator, an AI agent that performs tasks autonomously (00:47:37) DeepSeek reaches No. 1 on US Play Store (00:52:17) Alibaba rolled out Qwen Chat v0.2 and Qwen2.5-1M model (00:53:50) Perplexity launches US-hosted DeepSeek R1, hints at EU hosting soon (00:55:31) Apple is pulling its AI-generated notifications for news after generating fake headlines (00:59:00) French AI ‘Lucie' looks très chic, but keeps getting answers wrong Applications & Business (01:02:09) DeepSeek's New AI Model Sparks Shock, Awe, and Questions From US Competitors (01:08:16) Microsoft loses OpenAI exclusive cloud provider status to $500 billion Stargate project (01:13:34) OpenAI adds BlackRock exec Adebayo Ogunlesi to board of directors (01:15:33) ElevenLabs has raised a new round at $3B+ valuation led by ICONIQ Growth, sources say Policy & Safety (01:16:29) Donald Trump unveils $500 billion Stargate Project to build AI infrastructure in the US, promising over 100K jobs (01:21:16) Trump Revokes Biden AI Policy, Signs Executive Order to Strengthen AI Leadership (01:23:59) Anthropic CEO doesn't see DeepSeek as ‘adversaries,' but says export controls are critical (01:31:12) Taiwanese govt clears TSMC to make 2nm chips abroad — country lowers its 'Silicon Shield' (01:33:47) Outro
A special one-off episode with a deep dive into the past, present, and future of how computer hardware makes AI possible. Join our brand new Discord here! https://discord.gg/nTyezGSKwP Hosted by Andrey Kurenkov and guest-hosted by the folks from Latent Space Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. Sponsors: The Generator - An interdisciplinary AI lab empowering innovators from all fields to bring visionary ideas to life by harnessing the capabilities of artificial intelligence. In this episode: - Google and Mistral sign deals with AP and AFP, respectively, to deliver up-to-date news through their AI platforms. - ChatGPT introduces a tasks feature for reminders and to-dos, positioning itself more as a personal assistant. - Synthesia raises $180 million to enhance its AI video platform for generating videos of human avatars. - New U.S. guidelines restrict exporting AI chips to various countries, impacting Nvidia and other tech firms. If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Timestamps: 00:00:00 Introduction 00:03:08 Historical Recap: Early AI and Hardware 00:11:51 The Rise of GPUs and Deep Learning 00:15:39 Scaling Laws and the Evolution of AI Models 00:24:05 The Bitter Lesson and the Future of AI Compute 00:25:58 Moore's Law and Huang's Law 00:30:12 Memory and Logic in AI Hardware 00:34:53 Challenges in AI Hardware: The Memory Wall 00:37:08 The Role of GPUs in Modern AI 00:42:27 Fitting Neural Nets in GPUs 00:48:04 Batch Sizes and GPU Utilization 00:52:47 Parallelism in AI Models 00:55:53 Matrix Multiplications and GPUs 00:59:57 Understanding B200 and GB200 01:05:41 Data Center Hierarchy 01:13:42 High Bandwidth Memory (HBM) 01:16:45 Fabrication and Packaging 01:20:17 The Complexity of Semiconductor Fabrication 01:24:34 Understanding Process Nodes 01:28:26 The Art of Fabrication 01:33:17 The Role of Yield in Fabrication 01:35:47 The Photolithography Process 01:40:38 Deep Ultraviolet Lithography (DUV) 01:43:58 Extreme Ultraviolet Lithography (EUV) 01:51:46 Export Controls and Their Impact 01:54:22 The Rise of Custom AI Hardware 02:00:10 The Future of AI and Hardware
Our 197th episode with a summary and discussion of last week's big AI news! Recorded on 01/17/2024 Join our brand new Discord here! https://discord.gg/nTyezGSKwP Hosted by Andrey Kurenkov and guest-hosted by the folks from Latent Space Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. Sponsors: The Generator - An interdisciplinary AI lab empowering innovators from all fields to bring visionary ideas to life by harnessing the capabilities of artificial intelligence. In this episode: - Google and Mistral sign deals with AP and AFP, respectively, to deliver up-to-date news through their AI platforms. - ChatGPT introduces a tasks feature for reminders and to-dos, positioning itself more as a personal assistant. - Synthesia raises $180 million to enhance its AI video platform for generating videos of human avatars. - New U.S. guidelines restrict exporting AI chips to various countries, impacting Nvidia and other tech firms. If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Timestamps + Links: (00:00:00) Intro / Banter (00:04:29) News Preview (00:05:09) Response to listener comments (00:05:58) Sponsor Break Tools & Apps (00:07:01) Google is making AI in Gmail and Docs free — but raising the price of Workspace (00:07:52) Microsoft relaunches Copilot for business with free AI chat and pay-as-you-go agents (00:12:36) Google signs deal with AP to deliver up-to-date news through its Gemini AI chatbot (00:18:08) Mistral signs deal with AFP to offer up-to-date answers in Le Chat (00:18:45) ChatGPT can now handle reminders and to-dos Applications & Business (00:22:53) Palmer Luckey's AI Defense Company Anduril Is Building a $1 Billion Plant in Ohio (00:28:36) OpenAI is bankrolling Axios' expansion into four new markets (00:29:39) AI researcher François Chollet founds a new AI lab focused on AGI (00:32:18) Nvidia-backed AI video platform Synthesia doubles valuation to $2.1 billion (00:34:46) Anysphere Raises $105M in Series B (00:40:14) Harvey Valuation of 3 Billion Projects & Open Source (00:46:12) MiniMax-01: Scaling Foundation Models with Lightning Attention (00:51:16) MinMo: A Multimodal Large Language Model with Approximately 8B Parameters for Seamless Voice Interaction (00:53:01) HALoGEN: Fantastic LLM Hallucinations and Where to Find Them Research & Advancements (00:57:03) Titans: Learning to Memorize at Test Time (01:04:38) Transformer2: Self-adaptive LLMs (01:08:15) Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Steps Policy & Safety (01:11:23) Biden administration proposes sweeping new restrictions on exporting AI chips (01:13:56) Biden orders Energy, Defense departments to lease sites for AI data centers, clean energy generation (01:15:00) OpenAI presents its preferred version of AI regulation in a new ‘blueprint' (01:16:15) More teens report using ChatGPT for schoolwork, despite the tech's faults Synthetic Media & Art (01:17:55) In AI copyright case, Zuckerberg turns to YouTube for his defense (01:19:53) Outro
Our 196th episode with a summary and discussion of last week's* big AI news! *and sometimes last last week's Recorded on 01/10/2024 Join our brand new Discord here! https://discord.gg/wDQkratW Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. Sponsors: The Generator - An interdisciplinary AI lab empowering innovators from all fields to bring visionary ideas to life by harnessing the capabilities of artificial intelligence. In this episode: - Nvidia announced a $3,000 personal AI supercomputer called Digits, featuring the GB10 Grace Blackwell Superchip, aiming to lower the barrier for developers working on large models. - The U.S. Department of Justice finalizes a rule restricting the transmission of specific data types to countries of concern, including China and Russia, under executive order 14117. - Meta allegedly trained Llama on pirated content from LibGen, with internal concerns about the legality confirmed through court filings. - Microsoft paused construction on a section of a large data center project in Wisconsin to reassess based on new technological changes. If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Timestamps + Links: (00:00:00) Intro / Banter (00:04:52) Sponsor Break Tools & Apps (00:05:55) Nvidia announces $3,000 personal AI supercomputer called Digits (00:10:23) Meta removes AI character accounts after users criticize them as ‘creepy and unnecessary' Applications & Business (00:16:16) NVIDIA Is Reportedly Focused Towards “Custom Chip” Manufacturing, Recruiting Top Taiwanese Talent (00:21:54) AI start-up Anthropic closes in on $60bn valuation (00:25:38) Why OpenAI is Taking So Long to Launch Agents (00:30:08) TSMC Set to Expand CoWoS Capacity to Record 75,000 Wafers in 2025, Doubling 2024 Output (00:33:10) Microsoft 'pauses construction' on part of data center site in Mount Pleasant, Wisconsin (00:37:23) Google folds more AI teams into DeepMind to ‘accelerate the research to developer pipeline' Projects & Open Source (00:41:59) Cosmos World Foundation Model Platform for Physical AI (00:48:21) Microsoft releases Phi-4 language model on Hugging Face Research & Advancements (00:50:16) PRIME: Online Reinforcement Learning with Process Rewards (00:58:29) ICLR: In-Context Learning of Representations (01:07:38) Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs (01:11:44) METAGENE-1: Metagenomic Foundation Model for Pandemic Monitoring (01:15:45) TransPixar: Advancing Text-to-Video Generation with Transparency (01:18:03) The amount of compute used to train frontier models has been growing at a breakneck pace of over 4x per year since 2018, resulting in an overall scale-up of more than 10,000x! But what factors are enabling this rapid growth? Policy & Safety (01:23:45) InfAlign: Inference-aware language model alignment (01:28:44) Mark Zuckerberg gave Meta's Llama team the OK to train on copyrighted works, filing claims (01:33:19) Anthropic gives court authority to intervene if chatbot spits out song lyrics (01:35:57) US government says companies are no longer allowed to send bulk data to these nations (01:39:10) Trump announces $20B plan to build new data centers in the US
Our 195th episode with a summary and discussion of last week's* big AI news! *and sometimes last last week's Recorded on 01/04/2024 Join our brand new Discord here! https://discord.gg/wDQkratW Note: apologies for Andrey's slurred speech and the jumpy editing, will be back to normal next week! Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. Sponsors: The Generator - An interdisciplinary AI lab empowering innovators from all fields to bring visionary ideas to life by harnessing the capabilities of artificial intelligence. In this episode: - OpenAI teases new deliberative alignment techniques in its O3 model, showcasing major improvements in reasoning benchmarks, whilst surprising with autonomy in hacks against chess engines. - Microsoft and OpenAI continue to wrangle over the terms of their partnership, highlighting tensions amid OpenAI's shift towards a for-profit model. - Chinese AI companies like DeepSeek and Quen release advanced open-source models, presenting significant contributions to AI capabilities and performance optimization. - Sakana AI introduces innovative applications of AI to the search for artificial life, emphasizing the potential and curiosity-driven outcomes of open-ended learning and exploration. If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Timestamps + Links: (00:00:00) Intro / Banter (00:03:07) News Preview (00:03:54) Response to listener comments (00:05:00) Sponsor Break Tools & Apps (00:06:11) OpenAI announces new o3 model (00:21:17) Alibaba slashes prices on large language models by up to 85% as China AI rivalry heats up (00:23:04) ElevenLabs launches Flash, its fastest text-to-speech AI yet Applications & Business (00:24:24) OpenAI announces plan to transform into a for-profit company (00:33:17) Microsoft and OpenAI Wrangle Over Terms of Their Blockbuster Partnership (00:37:36) Elon Musk's xAI gets investment from Nvidia in recent funding round: report (00:39:43) Sam Altman's nuclear energy startup signs one of the largest nuclear power deals to date (00:41:13) OpenAI Search Leader Departs After Less Than a Year (00:42:43) Senior OpenAI Researcher Radford Departs Projects & Open Source (00:45:21) DeepSeek-AI Just Released DeepSeek-V3: A Strong Mixture-of-Experts (MoE) Language Model with 671B Total Parameters with 37B Activated for Each Token (00:54:14) Qwen Team Releases QvQ: An Open-Weight Model for Multimodal Reasoning (00:58:09) LightOn and Answer.ai Releases ModernBERT: A New Model Series that is a Pareto Improvement over BERT with both Speed and Accuracy Research & Advancements (01:00:31) Deliberation in Latent Space via Differentiable Cache Augmentation (01:05:14) Automating the Search for Artificial Life with Foundation Models Policy & Safety (01:10:27) Nonprofit group joins Elon Musk's effort to block OpenAI's for-profit transition (01:14:35) OpenAI Researchers Propose 'Deliberative Alignment' : A Training Approach that Teaches LLMs to Explicitly Reason through Safety Specifications before Producing an Answer (01:22:06) o1-preview autonomously hacked its environment rather than lose to Stockfish in our chess challenge. No adversarial prompting needed. (01:27:22) Elon Musk's xAI supercomputer gets 150MW power boost despite concerns over grid impact and local power stability (01:29:06) DOE: Data centers consumed 4.4% of US power in 2023, could hit 12% by 2028 Synthetic Media & Art (01:32:20) OpenAI failed to deliver the opt-out tool it promised by 2025 (01:36:15) Outro
Our 194th episode with a summary and discussion of last week's* big AI news! *and sometimes last last week's Recorded on 12/19/2024 Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. Sponsors: The Generator - An interdisciplinary AI lab empowering innovators from all fields to bring visionary ideas to life by harnessing the capabilities of artificial intelligence. If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Timestamps + Links: (00:00:00) Intro / Banter (00:02:14) Response to listener comments (00:08:52) News Preview (00:10:01) Sponsor Break Tools & Apps (00:10:55) Google releases its own ‘reasoning' AI model (00:16:52) Google Gemini can now do more in-depth research (00:21:58) Google DeepMind unveils a new video model to rival Sora (00:27:50) Pika Labs releases AI video generator 2.0 with new features (00:29:51) Google unveils Project Mariner: AI agents to use the web for you (00:34:33) X gains a faster Grok model and a new ‘Grok button' Applications & Business (00:36:11) AI GPU clusters with one million GPUs are planned for 2027 — Broadcom says three AI supercomputers are in the works (00:43:02) Meta asks the government to block OpenAI's switch to a for-profit (00:49:36) OpenAI says Elon Musk wanted it to be for-profit in 2017 (00:56:04) EQTY Lab, Intel, and NVIDIA Unveil 'Verifiable Compute,' A Solution to Secure Trusted AI (00:59:53) Liquid AI just raised $250M to develop a more efficient type of AI model (01:03:19) Hundreds of OpenAI's current and ex-employees are about to get a huge payday by cashing out up to $10 million each in a private stock sale Projects & Open Source (01:07:45) Phi-4 Technical Report (01:13:04) DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understanding (01:15:23) Meta AI Releases Apollo: A New Family of Video-LMMs Large Multimodal Models for Video Understanding Research & Advancements (01:16:34) Alignment faking in large language models (01:28:39) Meta AI Introduces Byte Latent Transformer (BLT): A Tokenizer-Free Model That Scales Efficiently (01:36:49) Frontier language models have become much smaller (01:42:28) The Complexity Dynamics of Grokking Policy & Safety (01:46:49) Homeland Security gets its very own generative AI chatbot (01:49:16) Pre-Deployment Evaluation of OpenAI's o1 Model (01:51:35) Pricing for key chipmaking material hits 13-year high following (01:53:46) Chinese export restrictions — China's restrictions on Gallium exports hit hard Synthetic Media & Art Meta debuts a tool for watermarking AI-generated videos (01:55:27) Outro
Our 193rd episode with a summary and discussion of last week's* big AI news! *and sometimes last last week's Note: this one was recorded on 12/13, so the news is a bit outdated... will get things back on track soon! Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. Sponsors: The Generator - An interdisciplinary AI lab empowering innovators from all fields to bring visionary ideas to life by harnessing the capabilities of artificial intelligence. If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Timestamps + Links: (00:00:00) Intro / Banter (00:02:44) News Preview (00:03:43) Response to listener comments (00:09:50) Sponsor Break Tools & Apps (00:11:12) OpenAI has finally released Sora (00:21:16) Google Reveals Gemini 2, AI Agents, and a Prototype Personal Assistant (00:28:23) ChatGPT Advanced Voice Mode adding video and screen sharing input (plus a Santa mode) (00:30:43) Microsoft's Copilot can browse the web with you using AI ‘Vision' (00:32:31) Musk's xAI has launched Grok image generation model (00:35:22) Cognition Labs' AI Software Engineer Devin Launched for Subscribers (00:40:43) Apple launches its ChatGPT integration with Siri (00:43:23) Reddit's New AI Search Tool Helps You Find Reddit Answers Without Google Applications & Business (00:46:35) OpenAI Aiming to Eliminate Microsoft AGI Rule to Boost Future Investment (00:53:34) GM halts funding of robotaxi development by Cruise (00:57:08) Largest AI data centre in the world to be built in northwest Alberta (01:02:36) Meta announces 4 million sq ft, 2GW Louisiana data center campus (01:05:22) Google's future data centers will be built next to solar and wind farms Projects & Open Source (01:08:37) Google DeepMind Just Released PaliGemma 2: A New Family of Open-Weight Vision Language Models (3B, 10B and 28B) Research & Advancements (01:13:51) Training Large Language Models to Reason in a Continuous Latent Space (01:25:37) An Evolved Universal Transformer Memory (01:31:48) APOLLO: SGD-like Memory, AdamW-level Performance (01:37:59) Clio: A system for privacy-preserving insights into real-world AI use Policy & Safety (01:39:47) Character.AI steps up teen safety after bots allegedly caused suicide, self-harm (01:45:22) What Trump's New AI and Crypto Czar David Sacks Means For the Tech Industry (01:49:03) Frontier AI systems have surpassed the self-replicating red line (01:53:52) Chip war: China launches antitrust probe into US semiconductor giant Nvidia in sign of escalation (01:56:53) White House Creating Task Force on AI Datacenter Infrastructure (02:00:00) US clears export of advanced AI chips to UAE under Microsoft deal, Axios says (02:02:19) Outro
Our 192nd episode with a summary and discussion of last week's* big AI news! *and sometimes last last week's Note: this one was recorded on 12/04 , so the news is a bit outdated... Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. Sponsors: The Generator - An interdisciplinary AI lab empowering innovators from all fields to bring visionary ideas to life by harnessing the capabilities of artificial intelligence. The AI safety book “Uncontrollable" which is not a doomer book, but instead lays out the reasonable case for AI safety and what we can do about it. Max TEGMARK said that “Uncontrollable” is a captivating, balanced, and remarkably up-to-date book on the most important issue of our time" - find it on Amazon today! In this episode: OpenAI launches a $200 ChatGPT Pro subscription with advanced capabilities, while Amazon unveils cost-effective Nova multimodal models at the re:Invent conference. Meta releases LLAMA 3.3 70B model, showing significant gains through post-training techniques, and Alibaba introduces QWQ, a reasoning model rivaling OpenAI's O1. Amazon collaborates with Anthropic on a massive AI supercomputer project, and Black Forest Labs eyes a $200 million funding round for growth in AI tools. New research from DeepMind's Genie 2 generates interactive 3D worlds from text and images, progressing AI's understanding of world models and interactive environments. If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Timestamps + Links: (00:00:00) Intro / Banter (00:02:34) Sponsor Break Tools & Apps (00:04:19) OpenAI confirms new $200 monthly subscription, which includes its o1 reasoning model (00:10:40) Amazon announces Nova, a new family of multimodal AI models (00:17:13) ElevenLabs launches GenFM to turn user content into AI-powered podcasts (00:20:21) Google's new generative AI video model is now available Applications & Business (00:23:56) Elon Musk files for injunction to halt OpenAI's transition to a for-profit (00:29:40) Amazon Is Building a Mega AI Supercomputer With Anthropic (00:34:15) It Sounds an Awful Lot Like OpenAI Is Adding Ads to ChatGPT (00:38:23) A16z in Talks to Lead $200 Million Round in Black Forest Labs, Startup Behind AI Images on Grok (00:41:10) Bezos Backs AI Chipmaker Vying With Nvidia at $2.6 Billion Value Projects & Open Source (00:45:25) Meta unveils a new, more efficient Llama model (00:50:00) Alibaba releases an ‘open' challenger to OpenAI's o1 reasoning model (00:55:21) DeMo: Decoupled Momentum Optimization (00:57:01) PRIME Intellect Releases INTELLECT-1 (Instruct + Base): The First 10B Parameter Language Model Collaboratively Trained Across the Globe (01:03:03) Tencent Launches HunyuanVideo, an Open-Source AI Video Model Research & Advancements (01:09:23) DeepMind's Genie 2 can generate interactive worlds that look like video games (01:16:43) Language Models are Hidden Reasoners: Unlocking Latent Reasoning Capabilities via Self-Rewarding (01:20:40) Densing Law of LLMs (01:25:59) Monet: Mixture of Monosemantic Experts for Transformers Policy & Safety (01:30:56) Commerce Strengthens Export Controls to Restrict China's Capability to Produce Advanced Semiconductors for Military Applications (01:37:33) China retaliates against latest US chip restrictions (01:40:52) OpenAI Is Working With Anduril to Supply the US Military With AI (01:43:24) On Targeted Manipulation and Deception when Optimizing LLMs for User Feedback (01:47:52) AI Safety Researcher Quits OpenAI, Saying Its Trajectory Alarms Her (01:51:52) Meta Claims AI Content Was Less than 1% of Election Misinformation (01:55:05) Outro
Our 191st episode with a summary and discussion of last week's big AI news! Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. Sponsors: The Generator - An interdisciplinary AI lab empowering innovators from all fields to bring visionary ideas to life by harnessing the capabilities of artificial intelligence If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Timestamps + Links: (00:00:00) Intro / Banter (00:02:55) Response to listener comments (00:09:30) Sponsor Break Tools & Apps (00:10:52) OpenAI's Sora video generator appears to have leaked (00:21:11) Mistral unleashes Pixtral Large and upgrades Le Chat into full-on ChatGPT competitor (00:26:39) Ignite 2024 introduces new AI agents and more for Microsoft 365 Copilot (00:28:50) H, the AI startup that raised $220M, launches its first product: Runner H for ‘agentic' applications (00:31:20) Anthropic bets on personalization in the AI arms race with new ‘styles' feature (00:33:42) ElevenLabs now offers ability to build conversational AI agents (00:37:08) Perplexity introduces a shopping feature for Pro users in the U.S. (00:38:49) Google's Gemini chatbot now has memory (00:43:03) Suno V4 Ai Music Generator Is Out Now And It's Very Impressive (00:46:28) Introducing FLUX.1 Tools (00:49:51) OpenAI just gave ChatGPT a major 'creativity' upgrade (00:51:26) Runway launches Frames — a new AI image generator that creates custom worlds Applications & Business (00:54:56) OpenAI Email Archives (from Musk v. Altman) (01:02:01) Amazon to invest another $4 billion in Anthropic, OpenAI's biggest rival (01:05:41) Amazon Robots Struggling to Keep Up With Human Workers Projects & Open Source (01:11:27) DeepSeek's first reasoning model R1-Lite-Preview turns heads, beating OpenAI o1 performance (01:15:30) OpenScholar: The open-source A.I. that's outperforming GPT-4o in scientific research Research & Advancements (01:18:02) A statistical approach to model evaluations (01:22:08) Scaling Laws for Precision (01:25:10) Cerebras Delivers Record-Breaking Performance with Meta's Llama 3.1 405B Model Policy & Safety (01:28:01) Sam Altman will co-chair San Francisco mayor-elect Daniel Lurie's transition team (01:32:21) Biden's final meeting with Xi Jinping reaps agreement on AI and nukes Synthetic Media & Art (01:33:07) How Did You Do On The AI Art Turing Test? (01:38:27) Outro
Our 190th episode with a summary and discussion of last week's big AI news! Hosted by Andrey Kurenkov and Jeremie Harris. Note from Andrey: this one is coming out a bit later than planned, apologies! Next one will be coming out sooner. Feel free to email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. Sponsors: The Generator - An interdisciplinary AI lab empowering innovators from all fields to bring visionary ideas to life by harnessing the capabilities of artificial intelligence In this episode: * OpenAI's pitch for a $100 billion data center and AI strategy plan outlines infrastructure and regulatory needs, emphasizing AI's foundational role akin to electricity. * Google's Gemini model challenges OpenAI's dominance, showing strong performance in chatbot arenas alongside generative AI advancements. * DeepMind's AlphaFold3 gets open-sourced for academic use, while new chips from NVIDIA and Google show significant performance boosts. * Anthropic and TSMC updates highlight strategic funding, regulation influences, and the complex dynamics of AI hardware and international policy. If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Timestamps + Links: (00:00:00) Intro / Banter (00:02:44) News Preview (00:03:34) Sponsor Break Tools & Apps (00:04:36) OpenAI, Google and Anthropic Are Struggling to Build More Advanced AI (00:16:22) OpenAI Nears Launch of AI Agent Tool to Automate Tasks for Users (00:19:14) Google drops new Gemini model and it goes straight to the top of the LLM leaderboard (00:19:14) Chinese AI startup takes aim at OpenAI's Sora with image-to-video tool launch (00:20:04) Introducing the Forge Reasoning API Beta and Nous Chat: An Evolution in LLM Inference Applications & Business (00:23:47) OpenAI Discusses AI Data Center That Could Cost $100 Billion (00:26:48) Elon Musk's massive AI data center gets unlocked — xAI gets approved for 150MW of power, enabling all 100,000 GPUs to run concurrently (00:29:34) Newest Google and Nvidia Chips Speed AI Training (00:34:45) Ex-OpenAI CTO Murati's New Team Takes Shape (00:34:45) Amazon Discussing New Multibillion-Dollar Investment in Anthropic Projects & Open Source (00:37:52) Google DeepMind open-sources AlphaFold 3, ushering in a new era for drug discovery and molecular biology (00:41:29) Near plans to build world's largest 1.4T parameter open-source AI model Research & Advancements (00:45:38) The Super Weight in Large Language Models (00:55:42) Compositional Abilities Emerge Multiplicatively: Exploring Diffusion Models on a Synthetic Task (01:03:47) Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models (01:08:14) Contextualized Evaluations: Taking the Guesswork Out of Language Model Evaluations Policy & Safety (01:11:14) The Code of Practice for general-purpose AI offers a unique opportunity for the EU (01:15:38) Three Sketches of ASL-4 Safety Case Components (01:23:05) U.S Department of Commerce finalizes $6.6 billion CHIPS Act funding for TSMC Fab 21 Arizona site , TSMC cannot make 2nm chips abroad now: MOEA (01:26:21) OpenAI to present plans for U.S. AI strategy and an alliance to compete with China (01:30:42) OpenAI loses another lead safety researcher, Lilian Weng (01:33:00) Outro
Our 189th episode with a summary and discussion of last week's big AI news! Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. In this episode: * OpenAI's acquisition of chat.com and internal shifts, including hardware lead hire and hardware model leaks, signal significant strategy pivots and challenges with model scaling and security. * Saudi Arabia plans a $100 billion AI initiative aiming to rival UAE's tech hub, highlighting the region's escalating AI investments. * U.S. penalties on GlobalFoundries for violating sanctions against SMIC underline ongoing challenges in enforcing AI-chip export controls. * Anthropic collaborates with Palantir and AWS to integrate CLAWD into defense environments, marking a significant policy shift for the company. Sponsors: The Generator - An interdisciplinary AI lab empowering innovators from all fields to bring visionary ideas to life by harnessing the capabilities of artificial intelligence. The AI safety book “Uncontrollable" which is not a doomer book, but instead lays out the reasonable case for AI safety and what we can do about it. Max TEGMARK said that “Uncontrollable” is a captivating, balanced, and remarkably up-to-date book on the most important issue of our time" - find it on Amazon today! If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Timestamps + Links: (00:00:00) Intro / Banter (00:01:28) News Preview (00:02:10) Response to listener comments (00:05:02) Sponsor Break Tools & Apps (00:07:31) OpenAI Introduces ‘Predicted Outputs' Feature: Speeding Up GPT-4o by ~5x for Tasks like Editing Docs or Refactoring Code (00:11:55) Anthropic's Haiku 3.5 surprises experts with an “intelligence” price increase (00:17:10) Introducing FLUX1.1 [pro] Ultra and Raw Modes (00:19:11) X is testing a free version of Grok AI chatbot in select regions Applications & Business (00:21:39) OpenAI acquired Chat.com (00:23:40) Saudis Plan $100 Billion AI Powerhouse to Rival UAE Tech Hub (00:28:28) Meta's former hardware lead for Orion is joining OpenAI (00:31:38) OpenAI Accidentally Leaked Its Upcoming o1 Model to Anyone With a Certain Web Address (00:35:50) Nvidia Rides AI Wave to Pass Apple as World's Largest Company Projects & Open Source (00:37:53) ‘Unrestricted' AI group Nous Research launches first chatbot — with guardrails (00:41:48) FrontierMath: The Benchmark that Highlights AI's Limits in Mathematics (00:46:29) Hunyuan-Large: An Open-Source MoE Model with 52 Billion Activated Parameters by Tencent Research & Advancements (00:49:55) Applying “Golden Gate Claude” mechanistic interpretability techniques to protein language models. (00:58:3) Relaxed Recursive Transformers: Effective Parameter Sharing with Layer-wise LoRA (01:05:55) From Naptime to Big Sleep: Using Large Language Models To Catch Vulnerabilities In Real-World Code (01:10:22) OpenAI reportedly developing new strategies to deal with AI improvement slowdown Policy & Safety (01:19:52) What Donald Trump's Win Means For AI (01:28:44) Fab Whack-A-Mole: Chinese Companies are Evading U.S. Sanctions (01:33:57) US fines GlobalFoundries for shipping chips to sanctioned Chinese firm (01:36:55) Anthropic teams up with Palantir and AWS to sell its AI to defense customers (01:39:23) Outro
Our 188th episode with a summary and discussion of last week's big AI news, now with Jeremie co-hosting once again! Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. This episode was sponsored by The Generator. If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Timestamps + Links: (00:00:00) Intro / Banter (00:02:16) News Preview (00:03:05) Response to listener comments / corrections (00:05:00) Sponsor Break Tools & Apps (00:06:28) OpenAI's search engine is now live in ChatGPT (00:12:18) Image Playground, ChatGPT, and more Apple Intelligence features roll out in beta (00:14:34) GitHub Copilot will support models from Anthropic, Google, and OpenAI (00:19:00) Introducing the analysis tool in Claude.ai (00:21:34) ElevenLabs Introduces Voice Design: A New AI Feature that Generates a Unique Voice from a Text Prompt Alone (00:24:18) Midjourney's new web editor lets you tweak images uploaded from your PC (00:26:02) Watch out, Midjourney — Recraft just announced new AI image generator model Applications & Business (00:29:57) Meta strikes multi-year AI deal with Reuters (00:33:15) OpenAI will start using AMD chips and could make its own AI hardware in 2026 (00:40:47) Elon Musk's xAI in talks to raise funding valuing it at $40 billion, WSJ reports (00:46:07) Physical Intelligence, a Robot A.I. Specialist, Raises Millions From Bezos (00:48:32) Waymo ramps up robotaxi push with $5.6 bn in funding (00:49:11) Alphabet's Waymo Serving Over 150,000 Paid Robotaxi Rides Every Week Now, Surging 50% In 2 Months Projects & Open Source (00:51:23) Meta AI Silently Releases NotebookLlama: An Open Version of Google's NotebookLM (00:54:59) Meta Releases Quantized Llama 3.2 with 4x Inference Speed on Android Phones (00:59:16) OpenAI Releases SimpleQA: A New AI Benchmark that Measures the Factuality of Language Models Research & Advancements (01:08:19) This Is a Glimpse of the Future of AI Robot (01:15:06) Can Language Models Replace Programmers? REPOCOD Says 'Not Yet' (01:19:01) Brain-like Functional Organization within Large Language Models (01:21:20) Decart's AI simulates a real-time, playable version of Minecraft (01:25:39) Raising the bar on SWE-bench Verified with Claude 3.5 Sonnet Policy & Safety (01:29:06) Commerce just proposed the most significant federal AI regulation to date – and no one noticed (01:35:04)Anthropic warns of AI catastrophe if governments don't regulate in 18 months (01:39:32) Open Source Bites Back as China's Military Makes Full Use of Meta AI (01:46:35) Meta says it's making its Llama models available for US national security applications (01:48:16) Outro
Our 187th episode with a summary and discussion of last week's big AI news, now with Jeremie co-hosting once again! With hosts Andrey Kurenkov (https://twitter.com/andrey_kurenkov) and Jeremie Harris (https://twitter.com/jeremiecharris) Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai Timestamps + Links: (00:00:00) Intro / Banter (00:03:07) Response to listener comments / corrections (00:05:13) Sponsor Read) Tools & Apps(00:06:22) Anthropic's latest AI update can use a computer on its own (00:18:09) AI video startup Genmo launches Mochi 1, an open source rival to Runway, Kling, and others (00:20:37) Canva has a shiny new text-to-image generator (00:23:35) Canvas Beta brings Remix, Extend, and Magic Fill to Ideogram users (00:26:16) StabilityAI releases Stable Diffusion 3.5 (00:28:27) Bringing Agentic Workflows into Inflection for Enterprise Applications & Business(00:32:35) Crusoe's $3.4B joint venture to build AI data center campus with up to 100,000 GPUs (00:39:08) Anthropic reportedly in early talks to raise new funding on up to $40B valuation (00:45:47) Longtime policy researcher Miles Brundage leaves OpenAI (00:49:53) NVIDIA's Blackwell GB200 AI Servers Ready For Mass Deployment In December (00:52:41) Foxconn building Nvidia superchip facility in Mexico, executives say (00:55:27) xAI, Elon Musk's AI startup, launches an API Projects & Open Source(00:58:32) INTELLECT-1: The First Decentralized 10-Billion-Parameter AI Model Training (01:06:34) Meta FAIR Releases Eight New AI Research Artifacts—Models, Datasets, and Tools to Inspire the AI Community (01:10:02) Google DeepMind is making its AI text watermark open source Research & Advancements(01:13:21) OpenAI researchers develop new model that speeds up media generation by 50X (01:17:54) How much AI compute is out there, and who owns it? (01:25:28) Rewarding Progress: Scaling Automated Process Verifiers for LLM Reasoning (01:33:30) Inference Scaling for Long-Context Retrieval Augmented Generation Policy & Safety(01:41:50) Announcing our updated Responsible Scaling Policy (01:48:52) Anthropic is testing AI's capacity for sabotage (01:56:30) OpenAI asked US to approve energy-guzzling 5GW data centers, report says (02:00:05) US Probes TSMC's Dealings with Huawei (02:03:03) TikTok owner ByteDance taps TSMC to make its own AI GPUs to stop relying on Nvidia — the company has reportedly spent over $2 billion on Nvidia AI GPUs (02:06:37) Outro
Our 186th episode with a summary and discussion of last week's big AI news! With hosts Andrey Kurenkov and guest host Jon Krohn from the SuperDataScience Podcast. Check out Jon's upcoming agent-focused event here - AI Catalyst: Agentic Artificial Intelligence Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai Timestamps + Links: (00:00:00) Intro / Banter (00:04:14) News Preview (00:05:28) Response to listener comments / corrections Tools & Apps (00:07:10) Adobe's AI video model is here, and it's already inside Premiere Pro (00:11:52) Adobe teases AI tools that build 3D scenes, animate text, and make distractions disappear (00:15:43) Adobe's Project Super Sonic uses AI to generate sound effects for your videos (00:17:05) YouTube expands AI audio generation tool to all U.S. creators (00:20:29) All Gemini users can now generate images with Imagen 3 (00:22:27) Meta AI will launch in six more countries today, including the UK (00:24:27) OpenAI Unveils Secret Meta Prompt—And It's Very Different From Anthropic's Approach Applications & Business (00:27:46) Tesla's big ‘We, Robot' event criticized for ‘parlor tricks' and vague timelines for robots, Cybercab, Robovan (00:37:25) OpenAI announces content deal with Hearst, including content from Cosmopolitan, Esquire and the San Francisco Chronicle Projects & Open Source (00:47:59) OpenR: An Open-Source AI Framework Enhancing Reasoning in Large Language Models (00:49:54) MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering (00:56:29) OpenAI Releases Swarm: An Experimental AI Framework for Building, Orchestrating, and Deploying Multi-Agent Systems Research & Advancements (00:59:23) Nobel Physics Prize Awarded for Pioneering A.I. Research by 2 Scientists (01:05:22) Nobel Prize in Chemistry Goes to 3 Scientists for Predicting and Creating Proteins (01:09:09) LLMs can't perform “genuine logical reasoning,” Apple researchers suggest (01:13:05) GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Models Policy & Safety (01:14:34) Anthropic CEO goes full techno-optimist in 15,000-word paean to AI (01:23:04) Google will help build seven nuclear reactors to power its AI systems (01:24:11) LLMs Know More Than They Show: On the Intrinsic Representation of LLM Hallucinations Synthetic Media & Art (01:26:26) Adobe Pushes Content Authenticity Forward With a Free Web App Designed for Creators (01:29:13) Outro
Our 185th episode with a summary and discussion of last week's big AI news! With hosts Andrey Kurenkov and guest host Gavin Purcell from the AI for Humans podcast. Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai In this episode: Meta's MovieGen introduces innovative features in AI video generation, alongside OpenAI's real-time speech API and expanded ChatGPT capabilities. Mio's foundation model and Apple's Depth Pro enhance multimodal AI inputs and precise 3D imaging for AR, VR, and robotics. Microsoft and OpenAI's strategic advancements highlight significant financial moves and AI enhancements, including Microsoft's enhanced Copilot. AI policy discussions intensify as California's vetoed bill sparks debates on regulation, alongside Google's $1 billion investment to expand AI infrastructure in Thailand. Timestamps + Links: (00:00:00) Intro / Banter (00:02:51) Response to listener comments / corrections Tools & Apps(00:03:48) Meta announces Movie Gen, an AI-powered video generator (00:14:28) OpenAI launches new ‘Canvas' ChatGPT interface tailored to writing and coding projects (00:19:31) OpenAI's DevDay brings Realtime API and other treats for AI app developers (00:24:43) Black Forest Labs releases Flux 1.1 Pro and an API (00:28:30) Microsoft gives Copilot a voice and vision in its biggest redesign yet (00:32:36) Pika 1.5 is now live — AI video generator just got major upgrades Applications & Business(00:37:49) OpenAI closes the largest VC round of all time (00:45:23) Google brings ads to AI Overviews as it expands AI's role in search (00:51:05) Anthropic hires OpenAI co-founder Durk Kingma (00:51:49) OpenAI's newest creation is raising shock, alarm, and horror among staffers: a new logo (00:53:45) Waymo to add Hyundai EVs to robotaxi fleet under new multiyear deal (00:57:28) Cerebras, an A.I. Chipmaker Trying to Take On Nvidia, Files for an I.P.O. (00:59:18) Y Combinator is being criticized after it backed an AI startup that admits it basically cloned another AI startup Research & Advancements(01:03:30) Were RNNs All We Needed? (01:06:52) MIO: A Foundation Model on Multimodal Tokens (01:09:20) Apple releases Depth Pro, an AI model that rewrites the rules of 3D vision Policy & Safety(01:13:08) California Governor Vetoes Sweeping A.I. Legislation (01:18:02) Judge blocks California's new AI law in case over Kamala Harris deepfake Musk reposted (01:20:41) Google to invest $1 billion in Thailand to build a data center and accelerate AI growth Synthetic Media & Art(01:21:58) AI reading coach startup Ello now lets kids create their own stories (01:25:13) Outro
Our 184th episode with a summary and discussion of last week's big AI news! With hosts Andrey Kurenkov and guest host Jon Krohn. Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai In this episode: OpenAI, Meta, and Google are enhancing their AI assistants with advanced voice modes, while Meta released Llama 3.2, an open-source model capable of processing both images and text. Significant AI infrastructure developments include Grok's partnership with Aramco for a massive data center in Saudi Arabia, and Microsoft's plan to power data centers using a reopened Three Mile Island nuclear plant. Recent research shows chain-of-thought prompting is most effective for math and symbolic reasoning, while OpenAI's GPT-4 with vision capabilities is being integrated into Perplexity AI's search platform. AI is being rapidly integrated into various sectors, with examples including ChartWatch reducing unexpected hospital deaths, Snapchat and YouTube introducing AI video generation tools, and Lionsgate partnering with Runway for AI-assisted film production. Timestamps + Links: (00:00:00) Intro / Banter (00:04:45) Response to listener comments / corrections Tools & Apps(00:07:46) OpenAI rolls out Advanced Voice Mode with more voices and a new look (00:13:32) Meta's AI can now talk to you in the voices of Awkwafina, John Cena, and Judi Dench (00:17:11) Gemini's chatty voice mode is out now for free on Android (00:21:30) AI video rivalry intensifies as Luma announces Dream Machine API hours after Runway (00:23:35) Copilot Wave 2 supercharges productivity with AI across all your Microsoft 365 apps (00:25:56) Perplexity introduces new 'Reasoning' focus powered by OpenAI's o1 Applications & Business(00:33:47) OpenAI Execs Mass Quit as Company Removes Control From Non-Profit Board and Hands It to Sam Altman (00:41:46) Sam Altman departs OpenAI's safety committee (00:43:04) Chip Startup Groq Backs Saudi AI Ambitions With Aramco Deal (00:46:29) Grok's image generator, Black Forest Labs, is raising $100M at a $1B valuation, say sources (00:48:05) Pudu unveils super semi-humanoid robot with 8-hour battery, 10kg lift power (00:50:56) Amazon introduces Amelia, an AI assistant for third-party sellers Projects & Open Source(00:52:58) Meta Releases Llama 3.2—and Gives Its AI a Voice (00:56:52) Alibaba Unveils Ovis 1.6 – A New Multimodal Language Model Research & Advancements(01:00:35) To CoT or not to CoT? Chain-of-thought helps mainly on math and symbolic reasoning (01:06:14) LLMs Still Can't Plan; Can LRMs? A Preliminary Evaluation of OpenAI's o1 on PlanBench (01:10:15) Norwegian Startup 1X Unveils AI World Model for Robot Training (01:12:44) AI tool cuts unexpected deaths in hospital by 26%, Canadian study finds Policy & Safety(01:15:47) Three Mile Island nuclear plant will reopen to power Microsoft data centers (01:18:23) Governor Newsom signs bills to combat deepfake election content (01:20:12) Governor Newsom signs bills to protect digital likeness of performers (01:22:20) Startup behind “world's first robot lawyer” to pay $193K for false ads, FTC says Synthetic Media & Art(01:24:49) Snap is introducing an AI video generation tool for creators (01:25:57) YouTube Shorts to integrate Veo, Google's AI video model (01:26:56) Lionsgate Signs Deal With AI Company Runway, Hopes That AI Can Eliminate Storyboard Artists and VFX Crews (01:28:01) Outro
Our 183rd episode with a summary and discussion of last week's big AI news! With hosts Andrey Kurenkov and Jeremie Harris. Note: once again, apologies from Andrey on this one coming out late. Starting with the next one we should be back to a regular(ish) release schedule. Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai In this episode: - OpenAI's O1 and O1 mini models boast advanced reasoning and longer responses. - Adobe adds video generation to Firefly, Anthropic launches AI safety-focused Claude enterprise. - LLAMA3 8B excels with synthetic tokens, AI-generated ideas deemed more novel. - New AI forecasting bot competes with veteran human forecasters. Timestamps + Links: (00:00:00) Intro / Banter (00:02:38) Response to listener comments / corrections Tools & Apps(00:04:00) OpenAI releases o1, its first model with ‘reasoning' abilities (00:22:06) Adobe says video generation is coming to Firefly this year (00:25:27) Anthropic launches Claude Enterprise with more security, admin controls (00:27:55) Tell Replit's AI Agent Your App Idea, and It'll Code and Deploy It for You Applications & Business(00:31:42) OpenAI Fundraising Set to Vault Startup's Valuation to $150 Billion (00:37:03) OpenAI Hits 1 Million Paid Users For Business Versions of ChatGPT (00:39:59) TSMC Arizona achieves production yields similar to those at its fabs in Taiwan, says report (00:45:14) Japan's Sakana AI partners Nvidia for research, raises $100M Projects & Open Source(00:47:31) The fable of Reflection 70B (00:53:08) DataGemma: Using real-world data to address AI hallucinations (00:56:31) DeepSeek-V2.5 wins praise as the new, true open source AI model leader Research & Advancements(01:01:35) Google DeepMind Launches AlphaProteo , an AI Model for Generating Proteins (01:08:27) Synthetic continued pretraining (01:16:55) A Large-Scale Human Study with 100+ NLP Researchers (01:23:55) Superhuman Automated Forecasting Policy & Safety(01:28:05) OpenAI o1 System Card (01:36:58) US roll outs new export controls aimed at restricting China's chip industry (01:39:50) Employee Call for Governor Newsom to Sign SB 1047 (01:42:34) Taylor Swift says AI version of herself falsely endorsing Trump 'conjured up my fears' Synthetic Media & Art(01:44:42) YouTube is developing AI detection tools for music and faces, plus creator controls for AI training (01:45:08) Outro
Our 182nd episode with a summary and discussion of last week's big AI news! With hosts Andrey Kurenkov and Jeremie Harris. Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai Sponsors: - Agent.ai is the global marketplace and network for AI builders and fans. Hire AI agents to run routine tasks, discover new insights, and drive better results. Don't just keep up with the competition—outsmart them. And leave the boring stuff to the robots
Our 181st episode with a summary and discussion of last week's big AI news! With hosts Andrey Kurenkov and Jeremie Harris Read out our text newsletter and comment on the podcast at https://lastweekin.ai/ If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai In this episode: - Google's AI advancements with Gemini 1.5 models and AI-generated avatars, along with Samsung's lithography progress. - Microsoft's Inflection usage caps for Pi, new AI inference services by Cerebrus Systems competing with Nvidia. - Biases in AI, prompt leak attacks, and transparency in models and distributed training optimizations, including the 'distro' optimizer. - AI regulation discussions including California's SB1047, China's AI safety stance, and new export restrictions impacting Nvidia's AI chips. Timestamps + Links: (00:00:00) Intro / Banter (00:03:08)Response to listener comments / corrections Tools & Apps(00:09:19) Google's custom AI chatbots have arrived (00:12:52) Google releases three new experimental AI models (00:17:14) Google Gemini will let you create AI-generated people again (00:22:32) Five months after Microsoft hired its founders, Inflection adds usage caps to Pi (00:26:42:) Plaud takes a crack at a simpler AI pin Applications & Business(00:30:31) Cerebras Systems throws down gauntlet to Nvidia with launch of ‘world's fastest' AI inference service (00:41:06) Nvidia announces $50 billion stock buyback (00:46:24) OpenAI in talks to raise funding that would value it at more than $100 billion (00:50:44) OpenAI Aims to Release New AI Model, ‘Strawberry,' in Fall (00:52:53) 3 Co-Founders Leave French AI Startup H Amid ‘Operational Differences' (00:57:29) Samsung to Adopt High-NA Lithography Alongside Intel, Ahead of TSMC (01:02:11) Unitree's $16,000 G1 could become the first mainstream humanoid robot Projects & Open Source(01:04:59) Meta leads open-source AI boom, Llama downloads surge 10x year-over-year (01:09:08) A_Preliminary_Report_on_DisTrO. Research & Advancements(01:13:56) Diffusion Models Are Real-Time Game Engines (01:23:18) LLM Defenses Are Not Robust to Multi-Turn Human Jailbreaks Yet (01:32:21) Interviewing AI researchers on automation of AI R&D (01:40:33) Anthropic releases AI model system prompts, winning praise for transparency Policy & Safety(01:47:12) U.S. AI Safety Institute Signs Agreements Regarding AI Safety Research, Testing and Evaluation With Anthropic and OpenAI (01:50:46) China's Views on AI Safety Are Changing—Quickly (01:56:27) Poll: 7 in 10 Californians Support SB1047, Will Blame Governor Newsom for AI-Enabled Catastrophe if He Vetoes (02:01:31) Elon Musk voices support for California bill requiring safety tests on AI models (02:03:55) Chinese Engineers Reportedly Accessing NVIDIA's High-End AI Chips Through Decentralized “GPU Rental Services” (02:08:25) U.S. gov't tightens China restrictions on supercomputer component sales Synthetic Media & Art(02:11:13) Actors Say AI Voice-Over Generator ElevenLabs Cloned Likenesses (02:14:06) Outro
Our 180th episode with a summary and discussion of last week's big AI news! With hosts Andrey Kurenkov (https://twitter.com/andrey_kurenkov) and Jeremie Harris (https://twitter.com/jeremiecharris) If you would like to get a sneak peek and help test Andrey's generative AI application, go to Astrocade.com to join the waitlist and the discord. Read out our text newsletter and comment on the podcast at https://lastweekin.ai/ If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai Episode Highlights: Ideogram AI's new features, Google's Imagine 3, Dream Machine 1.5, and Runway's Gen3 Alpha Turbo model advancements. Perplexity's integration of Flux image generation models and code interpreter updates for enhanced search results. Exploration of the feasibility and investment needed for scaling advanced AI models like GPT-4 and Agent Q architecture enhancements. Analysis of California's AI regulation bill SB1047 and legal issues related to synthetic media, copyright, and online personhood credentials. Timestamps + Links: (00:00:00) Intro / Banter (00:01:08) Response to Listener Comments / Corrections Tools & Apps (00:03:58) Ideogram AI expands its features with v2 model and color palette options (00:07:48) Google Releases Powerful AI Image Generator You Can Use for Free (00:11:41) Perplexity adds Flux.1 model for Pro users alongside Playground v3 update (00:13:58) Luma drops Dream Machine 1.5 — here's what's new (00:17:49) Runway's Gen-3 Alpha Turbo is here and can make AI videos faster than you can type (00:20:21) Perplexity's latest update improves code interpreter, charts included Applications & Business (00:24:14) AMD buying server maker ZT Systems for $4.9 billion as chipmakers strengthen AI capabilities (00:28:55) Ars Technica content is now available in OpenAI services (00:34:08) Anysphere, a GitHub Copilot rival, has raised $60M Series A at $400M valuation from a16z, Thrive, sources say 00:38:32 Stability AI appoints new Chief Technology Officer (00:41:45) Cruise's robotaxis are coming to the Uber app in 2025 Projects & Open Source (00:44:16) AI21 Introduces the Jamba Model Family: The most powerful and efficient long-context models for the enterprise (00:53:47) Microsoft reveals Phi-3.5 — this new small AI model outperforms Gemini and GPT-4o (00:57:33) Nvidia's Llama-3.1-Minitron 4B is a small language model that punches above its weight (01:00:58) Open source Dracarys models ignite generative AI fired coding Research & Advancements (01:12:35) Can AI Scaling Continue Through 2030? (01:15:35) Agent Q: Advanced Reasoning and Learning for Autonomous AI Agents (01:23:58) Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Models (01:31:18) Loss of plasticity in deep continual learning Policy & Safety (01:38:20) California weakens bill to prevent AI disasters before final vote, taking advice from Anthropic (01:48:14) Personhood credentials: Artificial intelligence and the value of privacy-preserving tools to distinguish who is real online (01:52:44) Showing SAE Latents Are Not Atomic Using Meta-SAEs Synthetic Media & Art (01:58:33) Authors sue Claude AI chatbot creator Anthropic for copyright infringement (01:59:32) Artists' lawsuit against Stability AI and Midjourney gets more punch (02:01:43) Outro
Our 179th episode with a summary and discussion of last week's big AI news! With hosts Andrey Kurenkov (https://twitter.com/andrey_kurenkov) and Jeremie Harris (https://twitter.com/jeremiecharris) If you would like to get a sneak peek and help test Andrey's generative AI application, go to Astrocade.com to join the waitlist and the discord. Read out our text newsletter and comment on the podcast at https://lastweekin.ai/ If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai Episode Highlights: - Grok 2's beta release features new image generation using Black Forest Labs' tech. - Google introduces Gemini Voice Chat Mode available to subscribers and integrates it into Pixel Buds Pro 2. - Huawei's Ascend 910C AI chip aims to rival NVIDIA's H100 amidst US export controls. - Overview of potential risks of unaligned AI models and skepticism around SingularityNet's AGI supercomputer claims. Timestamps + Links: (00:00:00) Intro / Banter (00:02:15) Response to listener comments / corrections Tools & Apps (00:04:24) Grok-2 is out in beta, now with added AI image generation (00:11:28) OpenAI reveals an updated GPT-4o model - but can't quite explain how it's better (00:13:48) Google Gemini's voice chat mode is here (00:16:18) Google's Pixel Buds Pro 2 bring Gemini to your ears (00:19:55) Google's AI-generated search summaries change how they show their sources (00:23:13) Prompt Caching is Now Available on the Anthropic API for Specific Claude Models Applications & Business (00:26:56) Meet Black Forest Labs, the startup powering Elon Musk's unhinged AI image generator (00:26:56) Huawei readies new AI chip to challenge Nvidia in China, WSJ reports (00:37:53) ASML and Imec Announce High-NA Lithography Breakthrough (00:43:07) Chinese startup WeRide gets nod to test robotaxis with passengers in California (00:45:49) Perplexity's popularity surges as AI search start-up takes on Google (00:51:55) Lisa Su formally welcomes Silo AI team to AMD after completing $665 million acquisition Projects & Open Source (00:54:31) FalconMamba 7B Released: The World's First Attention-Free AI Model with 5500GT Training Data and 7 Billion Parameters (00:59:25) OpenAI has introduced SWE-bench Verified to evaluate AI performance (01:04:21) Nous Research presents Hermes 3 (01:11:07) New supercomputing network could lead to AGI, scientists hope, with 1st node coming online within weeks Research & Advancements (01:14:40) The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery (01:30:24) Imagen 3 (01:32:48) The Data Addition Dilemma (01:37:35) LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs Policy & Safety (01:40:55) MIT researchers release a repository of AI risks (01:44:14) Elon Musk addresses power issues at xAI supercomputer facility in Memphis (01:46:52) FCC Proposes New Rules on AI-Powered Robocalls Governments Adjust Policies Amid Flood of AI Record Requests Synthetic Media & Art (01:48:21) SAG-AFTRA Strikes Groundbreaking AI Digital Voice Replica Pact With Startup Firm Narrativ (01:51:52) How ‘Deepfake Elon Musk' Became the Internet's Biggest Scammer (01:56:21) AI Song Outro
Our 178th episode with a summary and discussion of last week's big AI news! NOTE: this is a re-upload with fixed audio, my bad on the last one! - Andrey With hosts Andrey Kurenkov (https://twitter.com/andrey_kurenkov) and Jeremie Harris (https://twitter.com/jeremiecharris) If you would like to get a sneak peek and help test Andrey's generative AI application, go to Astrocade.com to join the waitlist and the discord. Read out our text newsletter and comment on the podcast at https://lastweekin.ai/ If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai In this episode: - Notable personnel movements and product updates, such as Character.ai leaders joining Google and new AI features in Reddit and Audible. - OpenAI's dramatic changes with co-founder exits, extended leaves, and new lawsuits from Elon Musk. - Rapid advancements in humanoid robotics exemplified by new models from companies like Figure in partnership with OpenAI, achieving amateur-level human performance in tasks like table tennis. - Research advancements such as Google's compute-efficient inference models and self-compressing neural networks, showcasing significant reductions in compute requirements while maintaining performance. Timestamps + Links: (00:00:00) Intro / Banter (00:03:14) Response to listener comments / corrections Applications & Business(00:06:56) Google's hiring of Character.AI's founders is the latest sign that part of the AI startup world is starting to implode (00:15:12) Investors in Adept AI will be paid back after Amazon hires startup's top talent (00:22:36) AI chip start-up Groq's value rises to $2.8bn as it takes on Nvidia (00:29:22) OpenAI co-founder Schulman leaves for Anthropic, Brockman takes extended leave (00:36:18) Elon Musk files new lawsuit against OpenAI and Sam Altman (00:41:40) Figure's new humanoid robot leverages OpenAI for natural speech conversations (00:47:01) ASML, Tokyo Electron dodge new US chip export rules, for now (00:53:10) OpenAI reportedly leads $60M round for webcam startup Opal Tools & Apps(00:55:40) OpenAI cuts GPT-4o prices, launches Structured Outputs amidst price war with Google (01:02:08) Apple Intelligence could get a $20 Plus version (01:04:05) Audible is testing an AI-powered search feature (01:05:53) Reddit to test AI-powered search result pages Research & Advancements(01:06:35) Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters (01:16:27) Achieving Human Level Competitive Robot Table Tennis (01:20:19) Self-Compressing Neural Networks (01:28:30) Let Me Speak Freely? A Study on the Impact of Format Restrictions on Performance of Large Language Models (01:32:43) Berkeley Humanoid: A Research Platform for Learning-based Control Policy & Safety(01:33:35) METR announces results of study on comparative capabilities of humans and agents (01:39:35) ‘The Godmother of AI' says California's well-intended AI bill will harm the U.S. ecosystem (01:49:13) Google Monopolized Search Through Illegal Deals, Judge Rules (01:54:56) Amazon faces UK merger probe over $4B Anthropic AI investment (01:55:44) GPT-4o System Card (02:03:09) Outro
Our 175th episode with a summary and discussion of last week's big AI news! With hosts Andrey Kurenkov (https://twitter.com/andrey_kurenkov) and Jeremie Harris (https://twitter.com/jeremiecharris) If you would like to get a sneak peek and help test Andrey's generative AI application, go to Astrocade.com to join the waitlist and the discord. In this episode: - Notable personnel movements and product updates, such as Character.ai leaders joining Google and new AI features in Reddit and Audible. - OpenAI's dramatic changes with co-founder exits, extended leaves, and new lawsuits from Elon Musk. - Rapid advancements in humanoid robotics exemplified by new models from companies like Figure in partnership with OpenAI, achieving amateur-level human performance in tasks like table tennis. - Research advancements such as Google's compute-efficient inference models and self-compressing neural networks, showcasing significant reductions in compute requirements while maintaining performance. Read out our text newsletter and comment on the podcast at https://lastweekin.ai/ If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai Timestamps + Links: (00:00:00) Intro / Banter (00:03:14) Response to listener comments / corrections Applications & Business(00:06:56) Google's hiring of Character.AI's founders is the latest sign that part of the AI startup world is starting to implode (00:15:12) Investors in Adept AI will be paid back after Amazon hires startup's top talent (00:22:36) AI chip start-up Groq's value rises to $2.8bn as it takes on Nvidia (00:29:22) OpenAI co-founder Schulman leaves for Anthropic, Brockman takes extended leave (00:36:18) Elon Musk files new lawsuit against OpenAI and Sam Altman (00:41:40) Figure's new humanoid robot leverages OpenAI for natural speech conversations (00:47:01) ASML, Tokyo Electron dodge new US chip export rules, for now (00:53:10) OpenAI reportedly leads $60M round for webcam startup Opal Tools & Apps(00:55:40) OpenAI cuts GPT-4o prices, launches Structured Outputs amidst price war with Google (01:02:08) Apple Intelligence could get a $20 Plus version (01:04:05) Audible is testing an AI-powered search feature (01:05:53) Reddit to test AI-powered search result pages Research & Advancements(01:06:35) Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters (01:16:27) Achieving Human Level Competitive Robot Table Tennis (01:20:19) Self-Compressing Neural Networks (01:28:30) Let Me Speak Freely? A Study on the Impact of Format Restrictions on Performance of Large Language Models (01:32:43) Berkeley Humanoid: A Research Platform for Learning-based Control Policy & Safety(01:33:35) METR announces results of study on comparative capabilities of humans and agents (01:39:35) ‘The Godmother of AI' says California's well-intended AI bill will harm the U.S. ecosystem (01:49:13) Google Monopolized Search Through Illegal Deals, Judge Rules (01:54:56) Amazon faces UK merger probe over $4B Anthropic AI investment (01:55:44) GPT-4o System Card (02:03:09) Outro
Our 177th episode with a summary and discussion of last week's big AI news! NOTE: apologies for this episode again coming out about a week late, next one will be coming out soon... With hosts Andrey Kurenkov (https://twitter.com/andrey_kurenkov) and Jeremie Harris (https://twitter.com/jeremiecharris) If you would like to get a sneak peek and help test Andrey's generative AI application, go to Astrocade.com to join the waitlist and the discord. Read out our text newsletter and comment on the podcast at https://lastweekin.ai/ If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai (00:00:00) AI Song / Intro Banter (00:05:32) Response to listener comments / corrections Tools & Apps(00:10:16) Apple Intelligence to Miss Initial Launch of Upcoming iOS 18 Overhaul (00:16:35) Instagram starts letting people create AI versions of themselves Lighting round(00:22:49) Runway just dropped image-to-video in Gen3 (00:25:41) Midjourney drops surprise v6.1 update — now humans look more real than ever (00:28:07) AI-Powered Necklace Will Be Your Friend for $99 (00:30:06) Microsoft is adding AI-powered summaries to Bing search results Applications & Business(00:31:44) Character.AI CEO Noam Shazeer returns to Google (00:39:41) Perplexity is cutting checks to publishers following plagiarism accusations Lighting round(00:43:30) Nvidia reportedly delays its next AI chip due to a design flaw (00:41:08) Neura shows off humanoid robot 4NE-1 (00:46:0) Yes, there are more driverless Waymos in S.F. Here's how busy they are (00:57:27) Canva acquires Leonardo.ai to boost its generative AI efforts Projects & Open Source(00:59:19) Black Forest Labs Open-Source FLUX.1: A 12 Billion Parameter Rectified Flow Transformer Capable of Generating Images from Text Descriptions (01:01:59) Google releases new ‘open' AI models with a focus on safety Lighting round(01:05:09) Stability AI releases super-fast model for 3D asset image generation (01:09:29) OpenDevin: An Open Platform for AI Software Developers as Generalist Agents Research & Advancements(01:12:10) Meta AI Introduces Meta Segment Anything Model 2 (SAM 2): The First Unified Model for Segmenting Objects Across Images and Videos (01:19:20) MoMa: Efficient Early-Fusion Pre-training with Mixture of Modality-Aware Experts Lighting round(01:25:00) AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks? (01:26:19) Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement (01:31:15) Stretching Each Dollar: Diffusion Training from Scratch on a Micro-Budget Policy & Safety(01:33:03) World's First-Ever AI Law Now Enforced in Europe, Targeting US Tech Giants (01:39:12) White House says no need to restrict ‘open-source' artificial intelligence — at least for now Lighting round(01:41:12) With Smugglers and Front Companies, China Is Skirting American A.I. Bans (01:44:03) UK antitrust body probes Google's ties with AI rival Anthropic (01:45:20) Elon Musk posts deepfake of Kamala Harris that violates X policy (01:50:10) AI Outro
Our 176th episode with a summary and discussion of last week's big AI news! NOTE: apologies for this episode coming out about a week late, things got in the way of editing it... With hosts Andrey Kurenkov (https://twitter.com/andrey_kurenkov) and Jeremie Harris (https://twitter.com/jeremiecharris) Read out our text newsletter and comment on the podcast at https://lastweekin.ai/ If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai (00:00:00) Intro Song (00:00:34) Intro Banter Tools & Apps(00:03:39) OpenAI announces SearchGPT, its AI-powered search engine (00:08:03) Google gives free Gemini users access to its faster, lighter 1.5 Flash AI model (00:09:10) X launches underwhelming Grok-powered ‘More About This Account' feature (00:11:36) Kuaishou Launches Full Beta Testing for 'Kling AI' to Global Users, Elevates Model Capabilities (00:13:39) Adobe rolls out more generative AI features to Illustrator and Photoshop (00:14:25) Meta AI gets new ‘Imagine me' selfie feature Projects & Open Source(00:15:19) Meta releases open-source AI model it says rivals OpenAI, Google tech (00:28:23) Mistral AI Unveils Mistral Large 2, Beats Llama 3.1 on Code and Math (00:34:00) Groq's open-source Llama AI model tops leaderboard, outperforming GPT-4o and Claude in function calling (00:36:35) Apple shows off open AI prowess: new models outperform Mistral and Hugging Face offerings Applications & Business(00:40:25) Elon Musk wants Tesla to invest $5 billion into his newest startup, xAI — if shareholders approve (00:43:01) Nvidia said to be prepping Blackwell GPUs for Chinese market (00:46:28) Toronto AI company Cohere to indemnify customers who are sued for any copyright violations (00:49:09) AI startup Cohere raises US$500-million, valuing company at US$5.5-billion Research & Advancements(00:52:01) AI achieves silver-medal standard solving International Mathematical Olympiad problems (00:56:47) A Multimodal Automated Interpretability Agent (01:00:56) MINT-1T: Scaling Open-Source Multimodal Data by 10x: A Multimodal Dataset with One Trillion Tokens Policy & Safety(01:02:56) Improving Model Safety Behavior with Rule-Based Rewards (01:06:39) Senators demand OpenAI detail efforts to make its AI safe (01:10:59) OpenAI reassigns top AI safety executive Aleksandr Madry to role focused on AI reasoning (01:13:08) As new tech threatens jobs, Silicon Valley promotes no-strings cash aid (01:17:33) Democratic senators seek to reverse Supreme Court ruling that restricts federal agency power Synthetic Media & Art(01:20:58) Video game performers will go on strike over artificial intelligence concerns (01:23:03) Outro (01:23:58) AI Song
Our 175th episode with a summary and discussion of last week's big AI news! With hosts Andrey Kurenkov (https://twitter.com/andrey_kurenkov) and Jeremie Harris (https://twitter.com/jeremiecharris) In this episode of Last Week in AI, hosts Andrey Kurenkov and Jeremy Harris explore recent AI advancements including OpenAI's release of GPT 4.0 Mini and Mistral's open-source models, covering their impacts on affordability and performance. They delve into enterprise tools for compliance, text-to-video models like Hyper 1.5, and YouTube Music enhancements. The conversation further addresses AI research topics such as the benefits of numerous small expert models, novel benchmarking techniques, and advanced AI reasoning. Policy issues including U.S. export controls on AI technology to China and internal controversies at OpenAI are also discussed, alongside Elon Musk's supercomputer ambitions and OpenAI's Prover-Verify Games initiative. Read out our text newsletter and comment on the podcast at https://lastweekin.ai/ If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai Timestamps + links: (00:00:00) AI Song Intro (00:00:40) Intro / Banter Tools & Apps(00:03:57) OpenAI unveils GPT-4o mini, a small AI model powering ChatGPT (00:11:38) Meet Haiper 1.5, the new AI video generation model challenging Sora, Runway (00:16:32) Anthropic releases Claude app for Android (00:18:59) Google Vids is available to test out Gemini AI-created video presentations (00:20:27) YouTube Music sound search rolling out, AI ‘conversational radio' in testing Applications & Business(00:23:30) OpenAI working on new reasoning technology under code name ‘Strawberry' (00:30:45) Inside Elon Musk's Mad Dash To Build A Giant xAI Supercomputer In Memphis (00:37:15) Apple, NVIDIA and Anthropic reportedly used YouTube transcripts without permission to train AI models (00:41:05) After Tesla and OpenAI, Andrej Karpathy's startup aims to apply AI assistants to education (00:43:40) Menlo Ventures and Anthropic team up on a $100M AI fund Projects & Open Source(00:46:27) Mistral releases Codestral Mamba for faster, longer code generation (00:50:36) Mistral AI and NVIDIA Unveil Mistral NeMo 12B, a Cutting-Edge Enterprise AI Model (00:52:51) Hugging Face Releases SmoLLM, a Series of Small Language Models, Beats Qwen2 and Phi 1.5 (00:56:11) Stable Diffusion 3 License Revamped Amid Blowback, Promising Better Model Research & Advancements(01:01:49) FlashAttention-3 unleashes the power of H100 GPUs for LLMs (01:06:38) Mixture of A Million Experts (01:12:51) AutoBencher: Creating Salient, Novel, Difficult Datasets for Language Models (01:18:23) SpreadsheetLLM: Encoding Spreadsheets for Large Language >Models Policy & Safety(01:20:50) Prover-Verifier Games improve legibility of language model outputs (01:28:05) Trump allies draft AI order to launch ‘Manhattan Projects' for defense (01:34:40) On scalable oversight with weak LLMs judging strong LLMs (01:36:24) Google, Microsoft offer Nvidia chips to Chinese companies, the Information reports (01:38:26) U.S. planning 'draconian' sanctions against China's semiconductor industry: Report (01:48:47) OpenAI illegally barred staff from airing safety risks, whistleblowers say (01:44:59) Outro + AI Song
Our 174rd episode with a summary and discussion of last week's big AI news! With hosts Andrey Kurenkov (https://twitter.com/andrey_kurenkov) and Jeremie Harris (https://twitter.com/jeremiecharris) In this episode of Last Week in AI, we delve into the latest advancements and challenges in the AI industry, highlighting new features from Figma and Quora, regulatory pressures on OpenAI, and significant investments in AI infrastructure. Key topics include AMD's acquisition of Silo AI, Elon Musk's GPU cluster plans for XAI, unique AI model training methods, and the nuances of AI copying and memory constraints. We discuss developments in AI's visual perception, real-time knowledge updates, and the need for transparency and regulation in AI content labeling and licensing. See full episode notes here. Read out our text newsletter and comment on the podcast at https://lastweekin.ai/ If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai Timestamps + links: (00:00:00) Intro AI Song (00:00:41) Pre News Banter Tools & Apps(00:07:09) Odyssey Building 'Hollywood-Grade' AI Text-to-Video Model to Compete With Sora, Gen-3 Alpha (00:10:28) Anthropic's Claude adds a prompt playground to quickly improve your AI apps (00:15:06) Figma pauses its new AI feature after Apple controversy (00:18:30) Quora's Poe now lets users create and share web apps (00:20:54) Suno launches iPhone app — now you can make AI music on the go Applications & Business(00:21:42) Groq unveils lightning-fast LLM engine; developer base rockets past 280K in 4 months (00:27:03) Microsoft and Apple ditch OpenAI board seats amid regulatory scrutiny (00:29:39) OpenAI and Arianna Huffington are working together on an ‘AI health coach' (00:33:38) AI coding startup Magic seeks $1.5-billion valuation in new funding round, sources say (00:37:01) Sequoia and Andreessen Horowitz Clash Over AI Chip Supplies Amid Gen AI Boom (00:43:30) Elon Musk Reveals Plans To Make World's “Most Powerful” 100,000 NVIDIA GPU AI Cluster (00:46:25) AMD plans to acquire Silo AI in $665 million deal (00:48:00) AI robotics startup raises US$300 million, including from Jeff Bezos (00:52:11) Intel begins groundwork on Magdeburg chip fab despite 13 remaining regulatory and environmental objections Research & Advancements(00:55:21) Learning to (Learn at Test Time): RNNs with Expressive Hidden States (01:03:12) Data curation via joint example selection further accelerates multimodal learning (01:09:11) CopyBench: Measuring Literal and Non-Literal Reproduction of Copyright-Protected Text in Language Model Generation (01:13:25) Just read twice: closing the recall gap for recurrent language models (01:15:25) CodeUpdateArena: Benchmarking Knowledge Editing on API Updates (01:18:31) Composable Interventions for Language Models (01:24:09) Mind-reading AI recreates what you're looking at with amazing accuracy Policy & Safety(01:26:49) Covert Malicious Finetuning (01:31:23) OpenAI's week of security issues (01:36:39) Here's how OpenAI will determine how powerful its AI systems are (01:39:56) Me, Myself and AI: The Situational Awareness Dataset for LLMs (01:44:34) Exclusive: OpenAI partners with Los Alamos to study AI in the lab (01:47:36) Judge dismisses coders' DMCA claims against Microsoft, OpenAI and GitHub (01:49:55) A former OpenAI safety employee said he quit because the company's leaders were 'building the Titanic' and wanted 'newer, shinier' things to sell Synthetic Media & Art(01:52:46) Vimeo joins YouTube and TikTok in launching new AI content labels (01:54:50) Tech Startup Aims to Help Media License Content for AI Training (01:57:23) Etsy adds AI-generated item guidelines in new seller policy (01:59:44) Bumble users can now report profiles that use AI-generated photos (02:02:05) Outro + AI Song
Our 173rd episode with a summary and discussion of last week's big AI news! With hosts Andrey Kurenkov (https://twitter.com/andrey_kurenkov) and Jeremie Harris (https://twitter.com/jeremiecharris) See full episode notes here. Read out our text newsletter and comment on the podcast at https://lastweekin.ai/ If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai In this episode of Last Week in AI, we explore the latest advancements and debates in the AI field, including Google's release of Gemini 1.5, Meta's upcoming LLaMA 3, and Runway's Gen 3 Alpha video model. We discuss emerging AI features, legal disputes over data usage, and China's competition in AI. The conversation spans innovative research developments, cost considerations of AI architectures, and policy changes like the U.S. Supreme Court striking down Chevron deference. We also cover U.S. export controls on AI chips to China, workforce development in the semiconductor industry, and Bridgewater's new AI-driven financial fund, evaluating the broader financial and regulatory impacts of AI technologies. Timestamps + links: (00:00:00) Intro / Banter Tools & Apps(00:03:24) Google opens up Gemini 1.5 Flash, Pro with 2M tokens to the public (00:08:47) Meta is about to launch its biggest Llama model yet — here's why it's a big deal (00:12:38) Runway's Gen-3 Alpha AI video model now available – but there's a catch (00:16:28) This is Google AI, and it's coming to the Pixel 9 (00:17:30) AI Firm ElevenLabs Sets Audio Reader Pact With Judy Garland, James Dean, Burt Reynolds and Laurence Olivier Estates (00:20:06) Perplexity's ‘Pro Search' AI upgrade makes it better at math and research (00:23:12) Gemini's data-analyzing abilities aren't as good as Google claims Applications & Business(00:26:38) Quora's Chatbot Platform Poe Allows Users to Download Paywalled Articles on Demand (00:32:04) Huawei and Wuhan Xinxin to develop high-bandwidth memory chips amid US restrictions (00:34:57) Alibaba's large language model tops global ranking of AI developer platform Hugging Face (00:39:01) Here comes a Meta Ray-Bans challenger with ChatGPT-4o and a camera (00:43:35) Apple's Phil Schiller is reportedly joining OpenAI's board (00:47:26) AI Video Startup Runway Looking to Raise $450 Million Projects & Open Source(00:48:10) Kyutai Open Sources Moshi: A Real-Time Native Multimodal Foundation AI Model that can Listen and Speak (00:50:44) MMEvalPro: Calibrating Multimodal Benchmarks Towards Trustworthy and Efficient Evaluation (00:53:47) Anthropic Pushes for Third-Party AI Model Evaluations (00:57:29) Mozilla Llamafile, Builders Projects Shine at AI Engineers World's Fair Research & Advancements(00:59:26) Researchers upend AI status quo by eliminating matrix multiplication in LLMs (01:05:55) AI Agents That Matter (01:12:09) WARP: On the Benefits of Weight Averaged Rewarded Policies (01:17:20) Scaling Synthetic Data Creation with 1,000,000,000 Personas (01:24:16) Found in the Middle: Calibrating Positional Attention Bias Improves Long Context Utilization Policy & Safety(01:26:32) With Chevron's demise, AI regulation seems dead in the water (01:33:40) Nvidia to make $12bn from AI chips in China this year despite US controls (01:37:52) Uncle Sam relies on manual processes to oversee restrictions on Huawei, other Chinese tech players (01:40:57) U.S. government addresses critical workforce shortages for the semiconductor industry with new program (01:42:42) Bridgewater starts $2 billion fund that uses machine learning for decision-making and will include models from OpenAI, Anthropic and Perplexity (01:47:57) Outro
Our 172nd episode with a summary and discussion of last week's big AI news! With hosts Andrey Kurenkov (https://twitter.com/andrey_kurenkov) and Jeremie Harris (https://twitter.com/jeremiecharris) Read out our text newsletter and comment on the podcast at https://lastweekin.ai/ If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai (00:00:00) Intro / Banter Tools & Apps (00:03:02) Anthropic Debuts Collaboration Tools for Claude AI Assistant (00:08:32) Google rolls out Gemini side panels for Gmail and other Workspace apps (00:12:30) OpenAI delays rolling out its 'Voice Mode' to July (00:15:40) OpenAI's ChatGPT for Mac is now available to all users (00:17:27) Waymo ditches the waitlist and opens up its robotaxis to everyone in San Francisco (00:18:53) Figma announces big redesign with AI Applications & Business (00:21:37) Meet Sohu: The World's First Transformer Specialized Chip ASIC (00:29:42) Huawei Has Reportedly Invested Billions In An R&D Facility That Will Allow It To Develop Advanced Chipmaking Machinery Similar To ASML & Others (00:32:17) China's ByteDance working with Broadcom to develop advanced AI chip, sources say (00:35:35) Chinese AI firms woo OpenAI users as US company plans API restrictions (00:39:45) OpenAI walks back controversial stock sale policies, will treat current and former employees the same Projects & Open Source (00:43:42) Meta Large Language Model Compiler: Foundation Models of Compiler Optimization (00:47:54) Google's Gemma 2 series launches with not one, but two lightweight model options—a 9B and 27B (00:48:50) ESM3: Simulating 500 million years of evolution with a language model Research & Advancements (00:56:57) Finding GPT-4's mistakes with GPT-4 (01:03:30) Chinese-built ChatGLM exceeds GPT-4 Across Several Benchmarks (01:07:15) Performances are plateauing, let's make the leaderboard steep again (01:11:18) Structural mechanism of bridge RNA-guided recombination (01:15:01) Reconciling Kaplan and Chinchilla Scaling Laws Policy & Safety (01:17:42) Safety Alignment Should Be Made More Than Just a Few Tokens Deep (01:23:02) Y Combinator rallies start-ups against California's AI safety bill (01:28:20) Pro-Kigali propagandists caught using Artificial Intelligence tools (01:21:40) Coordinated Disclosure of Dual-Use Capabilities: An Early Warning System for Advanced AI (01:35:08) Adversaries Can Misuse Combinations of Safe Models Mitigating Skeleton Key, a new type of generative AI jailbreak technique Synthetic Media & Art (01:39:35) Music labels sue AI music generators for copyright infringement (01:42:43) YouTube is trying to make AI music deals with major record labels (01:45:07) Toys ‘R' Us Debuts First Video Ad Using Sora, OpenAI's Text-to-Video Tool (01:49:12) Outro + AI Song
Our 171st episode with a summary and discussion of last week's big AI news! With hosts Andrey Kurenkov (https://twitter.com/andrey_kurenkov) and Jeremie Harris (https://twitter.com/jeremiecharris) Feel free to leave us feedback here. Read out our text newsletter and comment on the podcast at https://lastweekin.ai/ Email us your questions and feedback at contact@lastweekin.ai and/or hello@gladstone.ai Timestamps + Links: (00:00:00) Intro / Banter Tools & Apps(00:03:13) Apple Intelligence: every new AI feature coming to the iPhone and Mac (00:10:03) ‘We don't need Sora anymore': Luma's new AI video generator Dream Machine slammed with traffic after debut (00:14:48) Runway unveils new hyper realistic AI video model Gen-3 Alpha, capable of 10-second-long clips (00:18:21) Leonardo AI image generator adds new video mode — here's how it works (00:22:31) Anthropic just dropped Claude 3.5 Sonnet with better vision and a sense of humor Applications & Business(00:28:23 ) Sam Altman might reportedly turn OpenAI into a regular for-profit company (00:31:19) Ilya Sutskever, Daniel Gross, Daniel Levy launch Safe Superintelligence Inc. (00:38:53) OpenAI welcomes Sarah Friar (CFO) and Kevin Weil (CPO) (00:41:44) Report: OpenAI Doubled Annualized Revenue in 6 Months (00:44:30) AI startup Adept is in deal talks with Microsoft (00:48:55) Mistral closes €600m at €5.8bn valuation with new lead investor (00:53:12) Huawei Claims Ascend 910B AI Chip Manages To Surpass NVIDIA's A100, A Crucial Alternative For China (00:56:58) Astrocade raises $12M for AI-based social gaming platform Projects & Open Source(01:01:03) Announcing the Open Release of Stable Diffusion 3 Medium, Our Most Sophisticated Image Generation Model to Date (01:05:53) Meta releases flurry of new AI models for audio, text and watermarking (01:09:39) ElevenLabs unveils open-source creator tool for adding sound effects to videos Research & Advancements(01:12:02) Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling (01:22:07) Improve Mathematical Reasoning in Language Models by Automated Process Supervision (01:28:01) Introducing Lamini Memory Tuning: 95% LLM Accuracy, 10x Fewer Hallucinations (01:30:32) An Empirical Study of Mamba-based Language Models (01:31:57) BERTs are Generative In-Context Learners (01:33:33) SELFGOAL: Your Language Agents Already Know How to Achieve High-level Goals Policy & Safety(01:35:16) Sycophancy to subterfuge: Investigating reward tampering in language models (01:42:26) Waymo issues software and mapping recall after robotaxi crashes into a telephone pole (01:45:53) Meta pauses AI models launch in Europe (01:46:44) Refusal in Language Models Is Mediated by a Single Direction Sycophancy to subterfuge: Investigating reward tampering in language models (01:51:38) Huawei exec concerned over China's inability to obtain 3.5nm chips, bemoans lack of advanced chipmaking tools Synthetic Media & Art(01:55:07) It Looked Like a Reliable News Site. It Was an A.I. Chop Shop. (01:57:39) Adobe overhauls terms of service to say it won't train AI on customers' work (01:59:31) Buzzy AI Search Engine Perplexity Is Directly Ripping Off Content From News Outlets (02:02:23) Outro + AI Song
Our 170th episode with a summary and discussion of last week's big AI news! With hosts Andrey Kurenkov (https://twitter.com/andrey_kurenkov) and Jeremie Harris (https://twitter.com/jeremiecharris) Feel free to leave us feedback here. Read out our text newsletter and comment on the podcast at https://lastweekin.ai/ Email us your questions and feedback at contact@lastweekin.ai and/or hello@gladstone.ai Timestamps + Links: Tools & Apps(00:03:33) KLING is the latest AI video generator that could rival OpenAI's Sora (00:09:16) ‘Apple Intelligence' will automatically choose between on-device and cloud-powered AI (00:12:21) Udio introduces new udio-130 music generation model and more advanced features (00:14:38) Perplexity AI's new feature will turn your searches into shareable pages (00:16:35) ElevenLabs' AI generator makes explosions or other sound effects with just a prompt (00:18:37) Google's updated AI-powered NotebookLM expands to India, UK and over 200 other countries Applications & Business(00:19:40) OpenAI is restarting its robotics research group (00:25:01) Saudi fund invests in China effort to create rival to OpenAI (00:29:34) UAE seeks ‘marriage' with US over artificial intelligence deals (00:33:01) Zoox to test self-driving cars in Austin and Miami (00:35:49) Microsoft Lays Off 1,500 Workers, Blames "AI Wave" (00:38:28) Avengers, assemble—Google, Intel, Microsoft, AMD and more team up to develop an interconnect standard to rival Nvidia's NVLink Projects & Open Source(00:40:39) GLM-4-9B-Chat-1M (00:46:37) Hugging Face and Pollen Robotics show off first project: an open source robot that does chores (00:49:40) Zyphra debuts Zyda, a 1.3T language modeling dataset it claims outperforms Pile, C4, arxiv (00:51:59) Stability AI debuts new Stable Audio Open for sound design Research & Advancements(00:54:05) Scaling and evaluating sparse autoencoders (01:04:54) Improving Alignment and Robustness with Short Circuiting (01:12:11) Automatic Data Curation for Self-Supervised Learning: A Clustering-Based Approach (01:16:20) GPT-4 didn't ace the bar exam after all, MIT research suggests — it didn't even break the 70th percentile Policy & Safety(01:20:11) Former OpenAI researcher foresees AGI reality in 2027 (01:28:03) OpenAI Insiders Warn of a ‘Reckless' Race for Dominance (01:33:52) Testing and mitigating elections-related risks (01:36:26) Teams of LLM Agents can Exploit Zero-Day Vulnerabilities Synthetic Media & Art(01:43:23) The Uncanny Rise of the World's First AI Beauty Pageant (01:46:25) Outro + AI Song
Our 168th episode with a summary and discussion of last week's big AI news! Feel free to leave us feedback here: https://forms.gle/ngXvXZpNJxaAprDv6 Read out our text newsletter and comment on the podcast at https://lastweekin.ai/ Email us your questions and feedback at contact@lastweekin.ai and/or hello@gladstone.ai Timestamps + Links: (00:00:00) Intro / Banter (00:02:55) Response to listener comments / corrections Tools & Apps (00:04:33) Google's A.I. Search Errors Cause a Furor Online (00:10:56) Telegram gets an in-app Copilot bot (00:13:13) Opera is adding Google's Gemini AI to its browser (0016:13) Amazon plans to give Alexa an AI overhaul — and a monthly subscription price (00:19:15) Microsoft Edge will translate and dub YouTube videos as you're watching them (00:21:12) Iyo thinks its gen AI earbuds can succeed where Humane and Rabbit stumbled Applications & Business (00:24:57) PwC agrees deal to become OpenAI's first reseller and largest enterprise user (00:30:07) Vox Media and The Atlantic sign content deals with OpenAI (00:36:27) OpenAI launches programs making ChatGPT cheaper for schools and nonprofits (00:40:03) Huawei patent reveals 3nm-class process technology plans — China continues to move forward despite US sanctions (00:44:32) Nvidia, Powered by A.I. Boom, Reports Soaring Revenue and Profits (00:48:16) Elon Musk's xAI raises $6 billion in latest funding round Projects & Open Source (00:51:13) Scale AI publishes its first LLM Leaderboards, ranking AI model performance in specific domains (00:56:04) Cohere For AI Launches Aya 23, 8 and 35 Billion Parameter Open Weights Release (01:00:45) Who will make AlphaFold3 open source? Scientists race to crack AI model (01:04:07) Mistral releases Codestral, its first generative AI model for code Research & Advancements (01:09:23) The Road Less Scheduled (01:14:10) Training Compute of Frontier AI Models Grows by 4-5x per Year (01:21:33) gzip Predicts Data-dependent Scaling Laws (01:25:51) Neural Scaling Laws for Embodied AI (01:28:47) Contextual Position Encoding: Learning to Count What's Important (01:33:09) New AI products much hyped but not much used, study says Policy & Safety (01:37:00) Ex-OpenAI board member reveals what led to Sam Altman's brief ousting (01:46:36) OpenAI researcher who resigned over safety concerns joins Anthropic (01:49:16) Leaked OpenAI Documents Show Sam Altman Was Clearly Aware of Silencing Former Employees (01:54:33) OpenAI Board Forms Safety and Security Committee (01:58:07) Robocaller Who Used AI to Clone Biden's Voice Fined $6 Million (01:59:08) Hacker Releases Jailbroken "Godmode" Version of ChatGPT (02:00:46) China Creates $47.5 Billion Chip Fund to Back Nation's Firms Synthetic Media & Art (02:02:23) Alphabet, Meta Offer Millions to Partner With Hollywood on AI (02:04:21) Outro + AI Song
Our 168th episode with a summary and discussion of last week's big AI news! With guest host Gavin Purcell from AI for Humans podcast! Read out our text newsletter and comment on the podcast at https://lastweekin.ai/ Email us your questions and feedback at contact@lastweekin.ai and/or hello@gladstone.ai Timestamps + Links: (00:00:00) Intro / Banter + Response to listener comments / corrections Tools & Apps (00:08:00) OpenAI says Sky voice in ChatGPT will be paused after concerns it sounds too much like Scarlett Johansson (00:16:14) Microsoft's Copilot assistant is getting a GPT-4o upgrade + Recall is Microsoft's key to unlocking the future of PCs (00:21:36) ElevenLabs Launches AI-Voiced Screen Reader App (00:22:40) Adobe Lightroom gets a magic eraser, and it's impressive (00:25:07) Microsoft, Khan Academy provide free AI assistant for all educators in US (00:27:40) Microsoft Paint is getting an AI-powered image generator that responds to your text prompts and doodles Applications & Business (00:29:16) OpenAI founders Sam Altman and Greg Brockman go on the defensive after top safety researchers quit (00:36:58) OpenAI, WSJ Owner News Corp Strike Content Deal Valued at Over $250 Million (00:41:27) CoreWeave Raises $7.5 Billion in Debt for AI Computing Push (00:44:13) Google announced Trillium, its sixth generation of Tensor processors. (00:45:09) Inflection AI reveals new team and plan to embed emotional AI in business bots (00:47:01) Data-labeling startup Scale AI raises $1B as valuation doubles to $13.8B Projects & Open Source (00:48:35) Abacus AI Releases Smaug-Llama-3-70B-Instruct: The New Benchmark in Open-Source Conversational AI Rivaling GPT-4 Turbo (00:52:24) Introducing New Chatbot Arena Category: Hard Prompts (00:54:56) Microsoft brings out a small language model that can look at pictures Research & Advancements (00:56:05) New Anthropic Research Sheds Light on AI's 'Black Box' (01:04:03) Chameleon: Mixed-Modal Early-Fusion Foundation Models (01:08:14) SpeechVerse: A Large-scale Generalizable Audio Language Model (01:09:05) CAT3D: Create Anything in 3D with Multi-View Diffusion Models (01:11:17) Coin3D: Controllable and Interactive 3D Assets Generation with Proxy-Guided Conditioning (01:12:10) SpeechGuard: Exploring the Adversarial Robustness of Multimodal Large Language Models Policy & Safety (01:15:01) World's first major law for artificial intelligence gets final EU green light (01:17:18) Colorado governor signs sweeping AI regulation bill (01:22:10) Senators Propose $32 Billion in Annual A.I. Spending but Defer Regulation (01:23:25) Google DeepMind launches new framework to assess the dangers of AI models (01:25:05) Tech giants pledge AI safety commitments — including a ‘kill switch' if they can't mitigate risks Synthetic Media & Art (01:28:32) Sony Music warns tech companies over ‘unauthorized' use of its content to train AI (01:32:34) Hollywood agency CAA aims to help stars manage their own AI likenesses (01:38:28) What Do You Do When A.I. Takes Your Voice? (01:42:01) Outro + AI Song
Our 167th episode with a summary and discussion of last week's big AI news! With guest host Daliana Liu from The Data Scientist Show! And a special one-time interview with Andrey in the latter part of the podcast. Read out our text newsletter and comment on the podcast at https://lastweekin.ai/ Email us your questions and feedback at contact@lastweekin.ai and/or hello@gladstone.ai Timestamps + links: Intro / Banter Tools & Apps(00:03:42) OpenAI releases GPT-4o, a faster model that's free for all ChatGPT users (00:12:06) Project Astra is the future of AI at Google (00:18:06) Google is redesigning its search engine — and it's AI all the way down (00:19:39) Google unveils Veo and Imagen 3, its latest AI media creation models (00:23:36) Google Unveils Music AI Sandbox Making Loops From Prompts (00:26:27) Anthropic AI Launches a Prompt Engineering Tool that Generates Production-Ready Prompts in the Anthropic Console Applications & Business(00:31:02) OpenAI's Chief Scientist and Co-Founder Is Leaving the Company (00:35:15) Mike Krieger joins Anthropic as Chief Product Officer (00:36:28) $16k G1 humanoid rises up to smash nuts, twist and twirl (00:41:02) GM's Cruise to start testing robotaxis in Phoenix area with human safety drivers on board (00:42:52) US agency probes Amazon-owned Zoox self-driving vehicles after two crashes (00:43:58) Waymo's robotaxis under investigation after crashes and traffic mishaps Projects & Open Source(00:44:48) Introducing PaliGemma, Gemma 2, and an Upgraded Responsible AI Toolkit (00:46:24) Falcon 2: UAE's Technology Innovation Institute Releases New AI Model Series, Outperforming Meta's New Llama 3 (00:48:00) License to Call: Introducing Transformers Agents 2.0 Research & Advancements(00:49:22) The Platonic Representation Hypothesis (00:53:08) SUTRA: Scalable Multilingual Language Model Architecture Policy & Safety(00:54:46) Bipartisan Senate bill on AI security would bolster voluntary cyber reporting processes (00:56:17) U.K. agency releases tools to test AI model safety (00:57:25) Protesters Are Fighting to Stop AI, but They're Split on How to Do It Synthetic Media & Art(00:58:54) Google's invisible AI watermark will help identify generative text and video (01:00:50) How One Author Pushed the Limits of AI Copyright (01:03:27) Stellaris gets an DLC about AI that features AI-created voices, director insists it's 'ethical' and 'we're pretty good at exploring dystopian sci-fi and don't want to end up there ourselves' (01:04:46) At the AI Film Festival, humanity triumphed over tech (01:06:37) Daliana Interviews Andrey (01:42:00) AI Outro Song
Our 166th episode with a summary and discussion of last week's big AI news! Read out our text newsletter and comment on the podcast at https://lastweekin.ai/ Email us your questions and feedback at contact@lastweekin.ai and/or hello@gladstone.ai Timestamps + links: (00:00:00) Intro / Banter Tools & Apps(00:04:23) ElevenLabs previews music-generating AI model (00:09:31) Mysterious “gpt2-chatbot” AI model appears suddenly, confuses experts (00:13:00) SoundHound AI and Perplexity Partner to Bring Online LLMs to Next Gen Voice Assistants Across Cars and IoT Devices (00:14:50) Stability AI sows gen AI discord with Stable Artisan (00:16:35) Apple Will Revamp Siri to Catch Up to Its Chatbot Competitors (00:18:54) Alibaba rolls out latest version of its large language model to meet robust AI demand Applications & Business(00:19:34) OpenAI and Stack Overflow partner to bring more technical knowledge into ChatGPT (00:17:31) New Microsoft AI model may challenge GPT-4 and Google Gemini (00:31:08) Wayve, an A.I. Start-Up for Autonomous Driving, Raises $1 Billion (00:32:00) Motional delays commercial robotaxi plans amid restructuring (00:33:54) The rise of the Chinese AI unicorns doing battle with OpenAI Projects & Open Source(00:35:25) Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models (00:40:12) DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model (00:44:31) OpenVoice V2: Evolving Multilingual Voice Cloning with Enhanced Style Control and Cross-Lingual Capabilities (00:45:20) Granite Code Models: A Family of Open Foundation Models for Code Intelligence (00:46:00) Hugging Face launches LeRobot open source robotics code library (00:48:50) Vibe-Eval: A new open and hard evaluation suite for measuring progress of multimodal language models Research & Advancements(00:50:02) Google DeepMind's Groundbreaking AI for Protein Structure Can Now Model DNA (00:57:20) xLSTM: Extended Long Short-Term Memory (01:06:35) StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generation (01:07:55) Chain of Thought Empowers Transformers to Solve Inherently Serial Problems (01:11:48) KAN: Kolmogorov-Arnold Networks Policy & Safety(01:13:20) US lawmakers unveil bill to make it easier to restrict exports of AI models (01:17:30) OpenAI's Model Spec outlines some basic rules for AI (01:20:18) Robot dogs armed with AI-targeting rifles undergo US Marines Special Ops evaluation (01:25:15) OpenAI Releases ‘Deepfake' Detector to Disinformation Researchers Synthetic Media & Art(01:28:15) Audible's Test of AI-Voiced Audiobooks Tops 40,000 Titles (01:32:30) TikTok will automatically label AI-generated content created on platforms like DALL·E 3 (01:33:23) Katy Perry's Fan-Made AI Image Is So Real It Fooled the World Into Thinking She Was at the Met Gala (01:35:32) South Korean woman falls for deepfake Elon Musk, loses $50K in romance scam (01:37:18) Why young Russian women appear so eager to marry Chinese men (01:40:18) AI Outro Song
Our 165th episode with a summary and discussion of last week's big AI news! Read out our text newsletter and comment on the podcast at https://lastweekin.ai/ Email us your questions and feedback at contact@lastweekin.ai and/or hello@gladstone.ai Timestamps + links: Tools & Apps(00:01:27) GitHub releases an AI-powered tool aiming for a 'radically new way of building software' (00:07:05) China unveils Sora challenger able to produce videos from text similar to OpenAI tool, though much shorter (00:12:23) ChatGPT's AI ‘memory' can remember the preferences of paying customers (00:14:21) Rabbit R1 review: Avoid this AI gadget (00:18:30) Amazon Q, a generative AI-powered assistant for businesses and developers, is now generally available (00:19:54) Yelp's Assistant AI bot will do all the talking to help users find service providers Applications & Business(00:21:31) Video of super-fast, super-smooth humanoid robot will drop your jaw (00:25:22) Tesla's 2 million car Autopilot recall is now under federal scrutiny (00:29:32) Tesla shares soar as Elon Musk returns from China with FSD 'Game Changer' (00:32:11) OpenAI inks strategic tie-up with UK's Financial Times, including content use (00:35:21) OpenAI Startup Fund quietly raises $15M (00:37:00) Huawei backs HBM memory manufacturing in China to sidestep crippling US sanctions that restrict AI development Research & Advancements(00:39:20) Capabilities of Gemini Models in Medicine (00:45:34) Let's Think Dot by Dot: Hidden Computation in Transformer Language Models (00:52:20) NExT: Teaching Large Language Models to Reason about Code Execution (00:55:08) SenseNova 5.0: China's latest AI model surpasses OpenAI's GPT-4 (00:57:20) Octopus v4: Graph of language models (01:00:28) Better & Faster Large Language Models via Multi-token Prediction Policy & Safety(01:03:15) Refusal in LLMs is mediated by a single direction (01:09:19) Rishi Sunak promised to make AI safe. Big Tech's not playing ball. (01:15:09) DOE Announces New Actions to Enhance America's Global Leadership in Artificial Intelligence (01:18:21) The Chips Act is rebuilding US semiconductor manufacturing, so far resulting in $327 billion in announced projects (01:20:50) Analysis-Second global AI safety summit faces tough questions, lower turnout (01:24:03) Sam Altman, Jensen Huang, and more join the federal AI safety board Synthetic Media & Art(01:26:30) Air Head creators say OpenAI's Sora finicky to work with, needs hundreds of prompts, serious VFX work for under 2 minutes of cohesive story ↺ (01:29:50) Eight newspaper publishers sue OpenAI over copyright infringement
Our 164th episode with a summary and discussion of last week's big AI news! Read out our text newsletter and comment on the podcast at https://lastweekin.ai/ Email us your questions and feedback at contact@lastweekin.ai and/or hello@gladstone.ai Timestamps + links: Tools & Apps (00:04:02) Meta, in Its Biggest A.I. Push, Places Smart Assistants Across Its Apps (00:07:26) Microsoft launches Phi-3, its smallest AI model yet (00:15:35) The Ray-Ban Meta Smart Glasses have multimodal AI now (00:17:32) OpenAI winds down AI image generator that blew minds and forged friendships in 2022 (00:18:44) Baidu claims 200 million users for Ernie chatbot after only 13 months (00:21:13) The new Adobe Photoshop gets an in-app image generator, major Generative Fill upgrades Applications & Business (00:22:22) Intel & The Pentagon Deepen Ties To Develop World's Most Advanced Chips (00:27:58) Meta Says It Plans to Spend Billions More on A.I. (00:31:36) OpenAI CEO Sam Altman invests in solar power firm Exowatt to fuel AI datacenters (00:33:58) Google consolidates AI-focused DeepMind, Research teams (00:36:22) Microsoft and OpenAI bet $100 billion to free themselves from the shackles and overreliance on the world's most profitable semiconductor chip brand for AI chips Projects & Open Source (00:39:03) Apple releases OpenELM: small, open source AI models designed to run on-device (00:44:12) Snowflake launches Arctic, an open ‘mixture-of-experts' LLM to take on DBRX, Llama 3 Research & Advancements (00:48:08) The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructions (00:55:11) Groq's breakthrough AI chip achieves blistering 800 tokens per second on Meta's LLaMA 3 (00:59:52) Microsoft shows off VASA-1, an AI framework that makes human headshots talk, sing (01:01:59) Intel Builds World's Largest Neuromorphic System to Enable More Sustainable AI Policy & Safety (01:05:11) Deepfakes of Bollywood stars spark worries of AI meddling in India election (01:08:51) LLM Agents can Autonomously Exploit One-day Vulnerabilities (01:15:27) The Necessity of AI Audit Standards Boards (01:19:45) A Mechanism-Based Approach to Mitigating Harms from Persuasive Generative AI (01:22:45) COERCING LLMS TO DO AND REVEAL (ALMOST) ANYTHING (01:26:40) China acquired recently banned Nvidia chips in Super Micro, Dell servers, tenders show Synthetic Media & Art (01:29:08) Drake threatened with lawsuit over diss track featuring AI Tupac
Our 163rd episode with a summary and discussion of last week's big AI news! Note: apology for this one coming out a few days late, got delayed in editing it -Andrey Read out our text newsletter and comment on the podcast at https://lastweekin.ai/ Email us your questions and feedback at contact@lastweekin.ai and/or hello@gladstone.ai Timestamps + links: Intro / Banter Tools & Apps (00:02:16) Meta releases Llama 3, claims it's among the best open models available (00:14:01) Elon Musk's xAI Unveils Grok-1.5 Vision, Beats OpenAI's GPT-4V (00:17:55) Reka releases Reka Core, its multimodal language model to rival GPT-4 and Claude 3 Opus (00:21:50) Cohere Compass Private Beta: A New Multi-Aspect Embedding Model (00:23:48) Amazon Music's Maestro lets listeners make AI playlists (00:24:36) Snap plans to add watermarks to images created with its AI-powered tools Applications & Business (00:25:52) Boston Dynamics unveils new Atlas robot for commercial use (00:30:32) TSMC's $65 billion bet still leaves US missing piece of chip puzzle (00:36:30) U.S. blacklists Intel's and Nvidia's key partner in China — three other Chinese firms also included in the blacklist for helping the military (00:38:37) Elon Musk says the next-generation Grok 3 model will require 100,000 Nvidia H100 GPUs to train (00:40:22) Dr. Andrew Ng appointed to Amazon's Board of Directors (00:41:55) Collaborative Robotics Locks Up $100M, Latest Robot Startup To Raise Big Projects & Open Source (00:44:08) OpenEQA: Embodied Question Answering in the Era of Foundation Models (00:50:03) Introducing Idefics2: A Powerful 8B Vision-Language Model for the community Research & Advancements (00:51:21) RHO-1: Not All Tokens Are What You Need (00:57:21) Scaling Laws for Fine-Grained Mixture of Experts (01:03:20) Chinchilla Scaling: A replication attempt (01:07:18) China develops new light-based chiplet that could power artificial general intelligence — where AI is smarter than humans (01:10:45) OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments Policy & Safety (01:13:44) U.S. Commerce Secretary Gina Raimondo Announces Expansion of U.S. AI Safety Institute Leadership Team (01:17:18) NSA Publishes Guidance for Strengthening AI System Security (01:19:19) Foundational Challenges in Assuring Alignment and Safety of Large Language Models (01:24:11) Former OpenAI Board Member Calls for Audits of Top AI Companies (01:27:35) SoA survey reveals a third of translators and quarter of illustrators losing work to AI Synthetic Media & Art (01:30:25) Medium bans AI-generated content from its paid Partner Program