The Data Stack Show

This week on The Data Stack Show, John Wessel and Matt Kelliher-Gibson dive into the recent Duck Lake announcement, exploring the evolving landscape of data analytics technologies. They discuss DuckDB's role as a lightweight, local analytics database and its potential as a caching layer for open table formats like Iceberg. The conversation also highlights the current state of data storage standards, focusing on agreements around Parquet and Iceberg, while noting the ongoing complexity in catalog management. Key takeaways include the importance of local compute solutions, the early stage of open table formats, and the potential for simplified data infrastructure that can provide faster, more cost-effective analytics workflows. The episode underscores the ongoing innovation in data technologies and the need for more streamlined, flexible data management solutions. Don't miss it!Highlights from this week's conversation include:Discussion on Duck Lake Announcement (1:41)Compatibility with Apache Iceberg (4:05)Use Cases for DuckDB (6:23)Concerns About Data Management (10:01)Introduction to Data Formats (11:40)Catalog Space Challenges (13:13)Metadata Orchestration (14:54)Simplicity in Data Management (15:25)SQL Demo Discussion (17:26)Wrap-Up and Final Thoughts (18:44)The Data Stack Show is a weekly podcast powered by RudderStack, customer data infrastructure that enables you to deliver real-time customer event data everywhere it's needed to power smarter decisions and better customer experiences. Each week, we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

This week on The Data Stack Show, Eric and John welcome Michael Driscoll, Co-Founder and CEO of Rill Data. Mike discusses the transformative impact of AI on business intelligence (BI) and data analytics. He also explores the shift from traditional dashboard-based tools to more dynamic, code-driven, and AI-powered interfaces that provide deeper insights. During the conversation, the group emphasizes the importance of a metrics-first approach, the potential of leapfrog architectures using technologies like data lakes and real-time analytical databases, and how AI agents are increasingly becoming the primary users of data tools. The conversation highlights the evolving landscape of data infrastructure, where open standards, flexibility, and intelligent interfaces are reshaping how businesses interact with and understand their data, and more. Highlights from this week's conversation include:Welcome Back Mike Driscoll (1:11)Philosophy Behind BI Tools (2:04)Building a Natural Language Processing Server (4:33)Deployment of MCP Servers (6:07)The Role of Visualizations in BI (10:09)Measuring Product Success (12:43)Navigating Changes as Data Professionals (16:13)Efficiency Gains with Code (19:00)The Future of Data Teams (22:29)Long-term Use of Rutter Stack (25:16)Analytics Landscape Overview (30:59)Future of BI Architecture (33:04)AI's Role in Analytics (35:07)Interoperability and Talent Pool (39:41)The Crowded BI Market (42:03)Final Thoughts and Takeaways (46:07)The Data Stack Show is a weekly podcast powered by RudderStack, customer data infrastructure that enables you to deliver real-time customer event data everywhere it's needed to power smarter decisions and better customer experiences. Each week, we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

The Data Stack Show is a weekly podcast powered by RudderStack, customer data infrastructure that enables you to deliver real-time customer event data everywhere it's needed to power smarter decisions and better customer experiences. Each week, we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Highlights from this week's conversation include:The Cynical Data Guy Returns (1:11)Klarna's AI Shift (2:08)Sensational Headlines in Tech (4:31)Impact of AI on Jobs (8:19)Cost of AI Strategy (10:21)Consulting Strategies and Company Differentiation (12:26)Brand Recognition in Consulting (14:48)Critique of Outsourcing Thought (17:10)Future of Consulting with AI (19:37)The Fragility of Data Systems (21:32)Primitive Data Stacks (24:05)Cynical Data Scientist Epitaph (00:26:06)Rebranding Data Science (27:40)Parting Thoughts and Takeaways (30:14)The Data Stack Show is a weekly podcast powered by RudderStack, customer data infrastructure that enables you to deliver real-time customer event data everywhere it's needed to power smarter decisions and better customer experiences. Each week, we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

The Data Stack Show is a weekly podcast powered by RudderStack, customer data infrastructure that enables you to deliver real-time customer event data everywhere it's needed to power smarter decisions and better customer experiences. Each week, we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Highlights from this week's conversation include:Pete's Background and Journey in Data (1:36)Evolution of Data Practices (3:02)Integration Challenges with Acquired Companies (5:13)Trust and Safety as a Service (8:12)Transition to Dagster (11:26)Value Creation in Networking (14:42)Observability in Data Pipelines (18:44)The Era of Big Complexity (21:38)Abstraction as a Tool for Complexity (24:41)Composability and Workflow Engines (28:08)The Need for Guardrails (33:13)AI in Development Tools (36:24)Internal Components Marketplace (40:14)Reimagining Data Integration (43:03)Importance of Abstraction in Data Tools (46:17)Parting Advice for Listeners and Closing Thoughts (48:01)The Data Stack Show is a weekly podcast powered by RudderStack, customer data infrastructure that enables you to deliver real-time customer event data everywhere it's needed to power smarter decisions and better customer experiences. Each week, we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

The Data Stack Show is a weekly podcast powered by RudderStack, customer data infrastructure that enables you to deliver real-time customer event data everywhere it's needed to power smarter decisions and better customer experiences. Each week, we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Highlights from this week's conversation include:Pranav's Background and Journey in Data (1:10)Backstory of Mooncake Labs (2:05)PostgreSQL as a Force (4:47)Curiosity in Product Management (7:33)Challenges with Iceberg (11:12)Go-to-Market Strategy (13:52)Building Community Engagement (15:56)Importance of Feedback (18:26)AI Integration in Mooncake Labs (21:29)Innovation in data interaction (23:49)PostgreSQL and startup growth (28:41)Core component of business strategy (31:20)The Origin of the name Mooncake Labs (34:12)Upcoming Product Release (38:40)Connecting with Mooncake Labs and Parting Thoughts (42:49)The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Highlights from this week's conversation include:Background of ClickHouse (1:14)PostgreSQL Data Replication Tool (3:19)Emerging Technologies Observations (7:25)Observability and Market Dynamics (11:26)Product Development Challenges (12:39)Challenges with PostgreSQL Performance (15:30)Philosophy of Open Source (18:01)Open Source Advantages (22:56)Simplified Stack Vision (24:48)End-to-End Use Cases (28:13)Migration Strategies (30:21)Final Thoughts and Takeaways (33:29)The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Highlights from this week's conversation include:Viktor's Background and Journey in Data (1:20)Evolution of Data Architecture (4:41)The Lakehouse Concept (7:12)Open Source Innovation (11:05)Data Production and Decentralization (15:06)Governance in Decentralized Systems (18:53)Data Economy and Monetization (21:15)Security Concerns in Data Processing (24:21)Impact on Data Consumers (27:37)Compaction Issues in Data Tables (29:39)Open Source Lake Keeper Tool and Parting Thoughts (33:02)The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Highlights from this week's conversation include:Ruben's Background (1:14)Defining Operational Data (5:20)The Convergence of Operational and Analytical Data (10:53)Evolution from Data Warehousing to Fulfillment Centers (13:19)Challenges of API Integration (18:25)Understanding Data Complexity (22:18)Database vs. API Calls (25:32)Real-Time Database Views (28:15)The Evolution of Data Technology (32:37)Future Topics on PostgreSQL Scaling and Parting Thoughts (34:02)The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Highlights from this week's conversation include:Pedram's Background and Journey in Data (1:13)Marketing vs. Data Engineering (2:30)Understanding Marketing Pressures (4:16)Attribution Models and Accountability (8:13)Balancing Marketing and Team Management (12:25)Introduction to Dagster Components (15:00)AI Integration with Data Engineering (19:05)Challenges in Data Support (22:05)Self-Service Data Access (26:07)AI in Data Management (28:25)Organizing Data in Technical Teams (31:25)Challenges in Real-Time Data (33:28)Final Thoughts and Takeaways (37:01)The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Highlights from this week's conversation include:Recording from a Waymo (0:54)Future of Data Technology (2:45)AI Integration in Data Work (4:20)Speeding Up Data Experiences (5:29)Snapshot Conversations with Founders (9:52)Diversity of Perspectives on Postgres (12:37)Cultural Significance of Database Mascots (14:09)Incubation and Success of Open Source Projects (16:43)Final Thoughts and Takeaways (17:34)The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Highlights from this week's conversation include:Introduction of Panelists (2:15)Understanding Product Development (4:42)Three Stages of Product Development (7:53)Collaboration Across Teams (11:20)Understanding Customer Pain Points (12:31)Designers, Explainers, and Sustainers Framework (15:17)AI in Product Development (18:09)Using AI Responsibly (22:53)AI in Sustaining Product Development (24:57)Brand Storytelling with AI (27:40)Tooling and AI Implementation (29:29)Pressure for AI Integration (34:05)The Importance of AI in Product Development (38:28)Contextual Advantage of AI (42:52)Evolution of Prototyping (46:11)The Balance of Speed and Critical Thinking (48:16)Understanding AI in Product Development (51:08)Navigating the Messy Process of Product Development (53:14)Final thoughts and Advice (56:32)The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Highlights from this week's conversation include:Mark's Background and Journey in Data (1:08)Mark's Time at Microsoft (5:33)Internal Adoption of Azure (9:20)Understanding Pain Points (11:06)Complexity in Software Development (13:15)Microservices Architecture Overview (17:15)Microservices vs. Monolith (22:08)Modernizing Legacy Applications (24:39)Dependency Management with Dapr (29:43)Infrastructure as Code (33:04)AI's Rapid Evolution and Vendor Changes (37:27)Language Models in Application Development (39:05)AI in Creative Applications (42:59)The Future of Backend Development (47:22)Streamlining Development Processes (49:29)Dapr as an Open Source Solution (51:11)Getting Started with Dapr and Parting Thoughts (51:39)The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Highlights from this week's conversation include:Willz's Background and Journey (1:25)Discussing Real Estate Data Challenges (2:58)Inspiration for Software Creation (4:05)From Spreadsheet to Software (9:04)Challenges in Ownership Identification (12:24)Company Acquisition (16:00)Pitching Investors with Data Tools (18:46)Lessons Learned from Selling the Company (21:45)The Journey to Ready (26:55)Sales Development Representatives Explained (29:22)Role of Data in Sales (33:30)Real-Time Dashboards (36:54)Human-AI Collaboration (39:53)Human Touch in Data Compilation (44:02)Paradigm Shift in Data Access (46:19)Frustrations with Sales Cycles (48:22)Value of Genuine Conversations (55:23)Optimizing Internal Tools (56:23)Future of Data Interfaces and Parting Thoughts (57:21)The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Highlights from this week's conversation include:The Impact of AI (1:25)Historical Context of Technology (2:31)Pre-existing Infrastructure for Change (4:42)AI as a Personal Assistant (7:10)Future of Company Roles (9:13)Managing Teams in a Dystopian AI Future (12:31)Business Architecture Choices (15:52)Integration Tool Usage (18:07)AI's Impact on Data Roles (21:53)AI as an Interface (24:04)Trust in AI vs. SQL (27:12)Snowflake's Acquisition of Dataflow (29:54)Regression to the Mean Concept (33:49)AI's Role in Data Platforms (37:04)User Experience in Data Tools (44:41)Future of Data Tools (46:57)Environment Variable Setup (51:10)Future of Software Implementation and Parting Thoughts (52:10)The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Highlights from this week's conversation include:Pete's Career Overview (1:00)AI and Data Engineering Discussion (2:05)Themes of Data Council (4:19)High-Frequency Trading Insights (8:04)San Francisco's Unique Advantages (10:27)Data Council Conference Preview (13:23)The Magic of In-Person Events (15:45)Collapsing Batch and Streaming Systems (19:47)Leveraging Local Hardware for Data Processing (22:07)Future of Blockchain in Computing (23:57)Intersection of AI and Data Management (26:47)Advice for AI Startup Founders (28:44)Blurring Lines Between Data Roles (32:46)The Evolving Role of Engineers (36:56)Discount Code for Data Council and Parting Thoughts (38:23)The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Highlights from this week's conversation include:AI in Transcription Services (1:11)The Future of AI Companies (5:09)Potential Risks of AI Tools (8:57)Learning vs. Dependency in Programming (10:17)The Journey of a Data Analyst (12:07)AI and Coding Skills (14:06)Abstraction in Data Tools (16:59)Data Design and AI (19:07)User Experience vs. AI Automation (22:10)AGI and Data Mesh (24:36)Blank Screen Interaction Challenges (27:10)Understanding User Value in Data Platforms (32:22)AI's Role in Simplifying Data Interaction (34:04)Final Thought and Takeaways (35:05)The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Highlights from this week's conversation include:Solomon's Background and Journey in Data (0:38)The Importance of a Triple Threat Data Person (5:14)Sports Sponsorship Analysis at Nielsen (7:31)Challenges of Implementing AI in Business (11:09)Understanding Data Delivery Models (14:18)Innovating Data Delivery (17:38)Modern Data Sharing Framework (19:09)Account Management in Data Sharing (23:43)Data Delivery Systems and Skill Sets (26:08)Practical Steps for Monetizing Data (29:02)Building Trust Through Branding (36:51)LinkedIn Personal Branding Tips (40:54)Mastering the Basics (44:16)Professional Development in Data (48:18)Deep Technical Skills (53:18)Active and Outcome-Focused Approach (55:25)Finding Top Data People and Parting Thoughts (56:44)The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Highlights from this week's conversation include:Michael's Background and Journey in Data (0:24)Synthetic Data Challenges (1:49)Open Source Project Development (4:20)Founding Distributed Masonry (5:56)Acquisition by Confluent (7:27)Introduction to Shadow Traffic (10:57)Observations on Streaming Data (12:33)Importance of Timestamps in Testing (16:22)Customer Workflows with Shadow Traffic (19:09)Artificial Intelligence in Data Generation (22:13)Advantages of Domain-Specific Language (DSL) (25:14)Solopreneurship Insights (26:53)Exit Criteria for Startup Focus (30:12)The Feedback Loop (33:51)Balancing Customer Needs and Vision (35:02)Navigating Administrative Tasks (38:15)Expected Value Mindset (41:00)Solopreneur Efficiency (43:01)Maximizing Velocity (46:06)Final Thoughts and Takeaways (47:34)The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Highlights from this week's conversation include:Early Aspirations: Becoming a Doctor (1:09)The Shift to Business Studies (3:54)Father's Influence on Career Path (4:39)Interest in Statistics and Psychology (6:47)Networking and Early Career (10:24)Developing a Passion for Data (12:09)Joining a Startup Accelerator (17:30)Data and Engagement Metrics (21:39)Lessons on Data Fidelity (23:40)Entrepreneurial Journey in a VC-Backed Incubator (26:15)Software Engineering School Initiative (30:21)Growth and Market Timing (35:08)Post-Exit Consultancy Experience (36:36)Finding RudderStack (38:53)  Behavioral Data Revolution (40:44)Advice for Aspiring Product Managers (44:20)Understanding Customer Pain Points (46:29)Final Thoughts and Takeaways (47:03)The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Highlights from this week's conversation include:The Return of the Cynical Data Guy (0:14)Risks of SQL Complexity (2:16)Technical Debt in Data (4:34)Data Mesh Critique (6:38)Governance vs. Decentralization (9:55)Never Let a Stakeholder Tell You They Need a Dashboard (12:05)Dashboard vs. Table (13:34)Organizational Dynamics in Data Requests (16:35)AI and Prompt Writing (19:43)Search Techniques and User Behavior (21:20)Discussion on Code Optimization Tools (23:19)Final Thoughts and Takeaways (24:47)The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Highlights from this week's conversation include:Misha's Background and Journey in AI (1:13)Childhood Interest in Physics (4:43)Future of AI and Human Interaction (7:09)AI's Transformative Nature (10:12)Superhuman Intelligence in AI (12:44)Clarifying AGI and Superhuman Intelligence (15:48)Understanding AGI (18:12)Counterintuitive Intelligence (22:06)Reflection's Mission (25:00)Focus on Autonomous Coding (29:18)Future of Automation (34:00)Geofencing in Coding (38:01)Challenges of Autonomous Coding (40:46)Evaluations in AI Projects (43:27)Example of Evaluation Metrics (46:52)Starting with AI Tools and Final Takeaways (50:35)The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Highlights from this week's conversation include:Previewing Today's Topic (0:14Machine Learning Discussion (1:44)Conditions for Machine Learning Worthiness (6:59)Simplicity in Modeling (8:43)Predictive Analytics vs. Machine Learning (10:42)Optimization and Investment Problems (13:03)Practical vs. Theoretical Saturation (15:16)Building Relationships with Marketing Teams (19:52)Reporting Metrics and Attribution Models (22:49)Tracking Common Metrics (25:40)Understanding Profit Generation (27:46)ROI Calculation Challenges (29:49)AI in Customer Data Analysis (31:23)Execution Challenges in Marketing Automation (35:23)API Limitations in Marketing Tools (36:50)Optimizing Ads with AI (37:50)Challenges of Real-Time Data Integration (40:01)Final thoughts and takeaways (41:13)The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Highlights from this week's conversation include:Welcome Back, Lew (0:14)Recap of Previous Discussion (1:03)Benefits of Hashing Information (2:33)  Using Hashes for Data Context (4:24)Hashing and Query Parameters (7:24)Static Values for Hashing (11:10)Identity Resolution in Data Attribution (14:36)Methodologies for User Tracking (16:37)Combining Data Sources for Attribution (21:13)Understanding Data Gaps (25:25)Defining Objectives and KPIs (27:50)Identity Resolution Challenges (28:46)User and Session Stitching (32:01)Trusting Ad Platforms (35:23)Defining Attribution (38:09)The Credit Dilemma (40:18)First Touch Attribution Explained (41:47)Linear Attribution Model (43:21)B2C and B2B Attribution Scenarios (45:22)Timeframes in Attribution (47:29)Understanding Lookback Windows (49:34)Google Analytics Changes (51:20)Attribution After Conversion (53:26)Online vs. Offline Attribution (55:49)Discipline in Tracking (58:52)Challenges in Coordination (1:00:12)QR Codes and Data Integration (1:01:55)The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Highlights from this week's conversation include:Lew's Background and Journey in Data (1:06)Attribution Challenges (2:16)Attribution War Stories (8:09Defining Attribution (12:32)Complexities of Attribution (16:08)Multi-Touch Attribution Challenges (21:31)Campaign Creation Difficulties (23:27)UTM Parameters Explained (26:01)Challenges in Data Extraction (31:17)Transforming and Merging Data (36:28)Behavioral Data and Identity Resolution (40:29)Hierarchical Structure of Campaigns (44:03)Challenges of Data Consistency (49:38)Mitigating Freeform Data Issues (52:21)Creating Unique Join Keys (55:30)The Importance of Defining Requirements (58:42)Final Thoughts and Takeaways (1:00:39)The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Highlights from this week's conversation include:False Hope in Data Roles (1:17)Naivety of Junior Data Analysts (4:27)The Challenge of Defining Data (6:41)Struggles with Enterprise BI Tools (9:43)Career Advice for Data Professionals (12:36)Generational Shifts in Data Roles (16:51)Self-Service Data Requests (18:17)The Importance of Analysis Skills (19:46)The Broader Context of Analysis (21:44)Boring Challenges in AI Deployment (23:29)Technology Development vs. Human Absorption (26:14)VC Resolutions for 2025 (27:00)Value Addition in Leadership (32:08)Final Thoughts and Wrap-Up (33:06)The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Highlights from this week's conversation include:Pedram's Background and Journey in Data (0:47)Joining Dagster Labs (1:41)Synergies Between Teams (2:56)Developer Marketing Preferences (6:06)Bridging Technical Gaps (9:54)Understanding Data Orchestration (11:05)Dagster's Unique Features (16:07)The Future of Orchestration (18:09)Freeing Up Team Resources (20:30)Market Readiness of the Modern Data Stack (22:20)Career Journey into DevRel and Marketing (26:09)Understanding Technical Audiences (29:33)Building Trust Through Open Source (31:36)Understanding Vendor Lock-In (34:40)AI and Data Orchestration (36:11)Modern Data Stack Evolution (39:09)The Cost of AI Services (41:58)Differentiation Through Integration (44:13)Language and Frameworks in Orchestration (49:45)Future of Orchestration and Closing Thoughts (51:54)The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Highlights from this week's conversation include:Christmas and New Year Edition of Cynical Data Guy (0:28)Discussion on AI (00:00:42)12 Days of Shipments (1:04)Attention-Grabbing Strategies (2:01)Founder Mode vs. Manager Mode (3:11)Technical Debt Remediation (5:03)LinkedIn Posts Discussion (6:05)Cultural Impact on Roles (8:03)Investment in Modernization (12:07)Reflection on Company Strategies (15:03)Gratitude for Data Trends (16:18)Future of Data Access (19:14)Looking Forward to 2025 in Data (21:45)Final Thoughts and Takeaways (22:11)The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Highlights from this week's conversation include:Joe's Recent Projects and Work (0:55)Joe's New Book and Inspiration for Writing It (4:39)Challenges in Data Education (7:00)Internal Training Programs (10:02)Creative Problem Solving (17:46)Evaluating Candidates' Skills (21:18)Market Value and Career Growth (24:03)AI's Impact on Hiring (27:47)Content Production and Quality (31:56)The Evolution of AI and Data (34:00)Challenges of Automation (36:12)Convergence of Data Fields (40:26)Shortcomings of Relational Models (42:09)Inefficiencies of Poor Data Modeling (47:10)Discussion on Resource Constraints (51:50)The Role of Language Models (53:13)AI in Migration Projects (57:00)Joe's Teaser for a New Project (59:05)  Final Thoughts and Closing Remarks (1:00:07)The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Highlights from this week's conversation include:Sokratis' Background and Journey in Data (1:19)Engineers Wearing Multiple Hats (2:17)The Era of Early Startups (3:32)Lessons from Building Software (7:15)Importance of Team Dynamics (9:12)Balancing Creativity and Stability (15:00)Version Control in Data Analysis (18:57)Opinionated Modern Data Software (21:14)Creating Dashboards for Company Stats (22:41)Hiring for Intuition in Tech (27:38)Interview Process Insights (30:15)Protecting Intuitive Thinkers in Companies (35:08)The Challenge of Trust (39:21)Loss of Control in Delegation (40:14)Founder Work-Life Balance (42:15)Advice for Early-Stage Engineers (44:03)The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.