Podcasts about data engineering

  • 372PODCASTS
  • 1,052EPISODES
  • 38mAVG DURATION
  • 5WEEKLY NEW EPISODES
  • Sep 24, 2025LATEST

POPULARITY

20172018201920202021202220232024


Best podcasts about data engineering

Show all podcasts related to data engineering

Latest podcast episodes about data engineering

The InfoQ Podcast
AI, ML, and Data Engineering InfoQ Trends Report 2025

The InfoQ Podcast

Play Episode Listen Later Sep 24, 2025 53:02


In this episode of the podcast, members of the InfoQ editorial staff and friends of InfoQ discuss the current trends in the domain of AI, ML and Data Engineering. One of the regular features of InfoQ are the trends reports, which each focus on a different aspect of software development. These reports provide the InfoQ readers and listeners with a high-level overview of the topics to pay attention to this year. InfoQ AI, ML and Data Engineering editorial team met with external guests to discuss the trends in AI and ML areas, and what to watch out for the next 12 months. In addition to the written report and trends graph, this podcast provides a recording of a discussion where expert panelists discuss how innovative AI technologies are disrupting the industry. Read a transcript of this interview: http://bit.ly/4nRpvlF Subscribe to the Software Architects' Newsletter for your monthly guide to the essential news and experience from industry peers on emerging patterns and technologies: https://www.infoq.com/software-architects-newsletter Upcoming Events: InfoQ Dev Summit Munich (October 15-16, 2025) Essential insights on critical software development priorities. https://devsummit.infoq.com/conference/munich2025 QCon San Francisco 2025 (November 17-21, 2025) Get practical inspiration and best practices on emerging software trends directly from senior software developers at early adopter companies. https://qconsf.com/ QCon AI New York 2025 (December 16-17, 2025) https://ai.qconferences.com/ QCon London 2026 (March 16-19, 2026) https://qconlondon.com/ The InfoQ Podcasts: Weekly inspiration to drive innovation and build great teams from senior software leaders. Listen to all our podcasts and read interview transcripts: - The InfoQ Podcast https://www.infoq.com/podcasts/ - Engineering Culture Podcast by InfoQ https://www.infoq.com/podcasts/#engineering_culture - Generally AI: https://www.infoq.com/generally-ai-podcast/ Follow InfoQ: - Mastodon: https://techhub.social/@infoq - X: https://x.com/InfoQ?from=@ - LinkedIn: https://www.linkedin.com/company/infoq/ - Facebook: https://www.facebook.com/InfoQdotcom# - Instagram: https://www.instagram.com/infoqdotcom/?hl=en - Youtube: https://www.youtube.com/infoq - Bluesky: https://bsky.app/profile/infoq.com Write for InfoQ: Learn and share the changes and innovations in professional software development. - Join a community of experts. - Increase your visibility. - Grow your career. https://www.infoq.com/write-for-infoq

Building Utah
Speaking on Business: Neumont College of Computer Science

Building Utah

Play Episode Listen Later Sep 23, 2025 1:30


This is Derek Miller, Speaking on Business. Neumont College of Computer Science has been a key part of downtown Salt Lake City for over two decades, offering innovative industry‑influenced degrees that focus on cutting‑edge technology. Vice President, Mo Reeder, joins us with more. Mo Reeder: At Neumont College, we focus on preparing students for careers in technology. Our accredited programs allow students to earn bachelor's degrees in Software Engineering, Game Development, Applied AI, Data Engineering, and Cybersecurity in just three years. We also offer a Master's in Artificial Intelligence and a 21-week Cybersecurity Certificate. What makes Neumont unique is how closely we work with industry. Through externships, senior students contribute part-time to real-world projects, giving employers fresh talent and innovative ideas. The results speak for themselves. A Georgetown University study ranked Neumont as the nation's best return on investment in Computer Science. Graduates launch their careers with confidence, earning an average starting salary of around 77,000 dollars. We welcome you to come visit us on campus and see how Neumont is shaping Utah's tech future. Come take a tour at 143 South Main Street in Salt Lake City or visit our website today at Neumont.edu. Derek Miller: Neumont College of Computer Science is helping shape Utah's future by preparing skilled tech professionals. Through accelerated programs and industry partnerships, graduates enter the workforce ready to meet the state's growing technology needs and strengthen its economy. I'm Derek Miller, with the Salt Lake Chamber, Speaking on Business. Originally aired: 9/23/25

MLOps.community
The DuckLake Lakehouse Format // Hannes Mühleisen // #339

MLOps.community

Play Episode Listen Later Sep 19, 2025 57:24


The DuckLake Lakehouse Format // MLOps Podcast #339 with Hannes Mühleisen, Co-founder and CEO of DuckDB Labs.Join the Community: https://go.mlops.community/YTJoinInGet the newsletter: https://go.mlops.community/YTNewsletter// AbstractManaging data on Object Stores has been a painful affair. Users had to choose between data swamp chaos or a maze of metadata files with catalog servers on top. DuckLake is a new paradigm for managing data on object stores: First, it uses classical SQL data management systems to manage metadata. Second, actual data is stored in Parquet files on pretty arbitrary storage. Third, processing queries is done client-side, or anywhere really. DuckDB is the first system to integrate with DuckLake using an extension with the same name. Conceptually, DuckLake enables central control over truth while decentralizing compute and storage entirely. DuckLake turns data warehouse architecture upside down by departing from the integrated metadata/compute layer towards a fully disconnected operation with only centralized metadata. For the first time, DuckLake allows a “multi-player” experience with DuckDB, where computation stays fully local, but transactional control is centralized.// BioHannes Mühleisen

Chuck Yates Needs A Job
The Secret Data Engineering Behind Industry AI

Chuck Yates Needs A Job

Play Episode Listen Later Sep 17, 2025 45:13


This episode is packed with big-picture energy talk and some seriously nerdy (but fun) data breakdowns. John Kalfayan from collide. and Chuck start with what's really happening in oil and gas today before shifting into the challenges of putting AI to work in the field. From there, things get deep: contract dedications, what RAG actually means, how data chunking works, and the never-ending battle with duplicate info. We also weigh the costs of storage, querying, and running models, plus the tradeoffs between RAG and foundational models. If you've ever wondered about vector databases, data strategy, or just why we have a rant about sand, it's all here. By the end, we hit on the human side too: education, privacy, and making sure the right people can access the right data.Click here to watch a video of this episode.Join the conversation shaping the future of energy.Collide is the community where oil & gas professionals connect, share insights, and solve real-world problems together. No noise. No fluff. Just the discussions that move our industry forward.Apply today at collide.ioClick here to view the episode transcript. 00:00 - Intro01:51 - Oil and Gas Industry Insights06:34 - AI Deployment Challenges09:12 - Contract Dedications Explained10:32 - Understanding RAG12:52 - What is RAG in Data Management13:43 - Data Chunking Techniques17:17 - Cost Considerations in Data18:03 - RAG vs Foundational Models19:21 - Vectorized Databases Overview23:47 - Managing Duplicate Data26:28 - Data Strategy Considerations28:24 - Sand Rant31:32 - Identifying Gaps in Data33:10 - The Cost of Storage33:56 - Effective Data Querying35:50 - AI Education and Awareness37:53 - Privacy Concerns with Language Models40:54 - Data Access and Availabilityhttps://twitter.com/collide_iohttps://www.tiktok.com/@collide.iohttps://www.facebook.com/collide.iohttps://www.instagram.com/collide.iohttps://www.youtube.com/@collide_iohttps://bsky.app/profile/digitalwildcatters.bsky.socialhttps://www.linkedin.com/company/collide-digital-wildcatters

The Data Engineering Show
Postgres vs. Elasticsearch: The Unexpected Winner in High-Stakes Search for Instacart with Ankit Mittal

The Data Engineering Show

Play Episode Listen Later Sep 17, 2025 21:38


Modernizing Search Infrastructure: How Instacart Transitioned from Elasticsearch to PostgreSQL for Enhanced Performance and Simplicity. In this episode of The Data Engineering Show, host Benjamin Wagner speaks with Ankit Mittal, former senior engineer at Instacart, about the company's innovative approach to modernizing their search infrastructure by transitioning from Elasticsearch to PostgreSQL for single-retailer search functionality.

Stories from the Hackery
The Engine Behind AI: Why Data Engineering is in Demand | Stories From The Hackery

Stories from the Hackery

Play Episode Listen Later Sep 10, 2025 67:21


In this episode of Stories from the Hackery, we talk with Nashville tech leader and hiring manager Jason Turan about one of tech's most in-demand fields: data engineering. Jason, a long-time friend of NSS, was one of the first people to tell us that Nashville needed more data engineers. He shares his perspective on what a data engineer does, describing the role as the "connective tissue between data producers and data consumers". Listen in to hear us discuss: - Why data engineers are essential for flipping the 80/20 rule, allowing data scientists and analysts to spend less time cleaning data and more time finding insights. - How the rise of generative AI has acted as an "accelerant," increasing the need for high-quality data and the professionals who can provide it. - Actionable advice for getting started in the field, including the importance of focusing on a "T-shaped skillset" with SQL at its core. - Why Jason's number one piece of advice is to be curious, experiment, and "go out and do the thing". 01:20 Meet Jason Turan: His Tech Origin Story 03:04 Jason's History with NSS and Hiring Grads 07:28 Defining Data Engineering: The "Connective Tissue" of Tech 11:15 Why Nashville is a Hub for Data Engineers 13:56 Healthcare's Impact on Nashville's Data Jobs 20:35 How GenAI Accelerates the Need for Data Engineers 31:33 Getting Started: Lower Barriers to Entry 39:03 A Top Use Case for AI: Understanding Your Codebase 52:21 Misconceptions & the "T-Shaped Skillset" 55:29 The Value of Hands-On Learning: "Go Do the Thing" 58:52 Lightning Round: Favorite Tech Tools 01:00:32 Lightning Round: Top Reads & Resources Links Metabase: https://www.metabase.com/ DuckDB: https://duckdb.org/ MotherDuck: https://motherduck.com/ Ralph Kimball: The Data Warehouse Toolkit: https://www.amazon.com/gp/product/1118530802 Bill Inmon: Building the Data Warehouse: https://www.amazon.com/Building-Data-Warehouse-W-Inmon/dp/0764599445 Edward Tufte: The Visual Display of Quantitative Information: https://www.amazon.com/Visual-Display-Quantitative-Information/dp/0961392142 Brendan Keeler: The Health API Guy: https://healthapiguy.substack.com/ TLDR Newsletter: https://tldr.tech/ Nashville Technology Council (NTC): https://technologycouncil.com/

BIFocal - Clarifying Business Intelligence
Episode 304 - Microsoft Fabric August 2025 Feature Summary

BIFocal - Clarifying Business Intelligence

Play Episode Listen Later Sep 9, 2025 41:34


This is episode 304 recorded on September 4th, 2025, where John & Jason talk the Microsoft Fabric August 2025 Feature Summary including a new Flat list view in Deployment pipelines, Bursting controls for Data Engineering workloads, new test capabilities for User Data Functions, the ability to server real-time predictions with ML model endpoints, several updates to Data Warehouse, Database tree in edit tile and AzMon data sources for RTI, the ability to use Python Notebooks to read/write to Fabric SQL Databases, Auto table creation on destination in copy job in Data Factory, and much, much more. For show notes please visit www.bifocal.show

Engenharia de Dados [Cast]
Data AI Sunset Meetup Brasília - O Futuro da Engenharia de Dados, Comunidade, IA e Carreira

Engenharia de Dados [Cast]

Play Episode Listen Later Aug 24, 2025 63:43


Prepare-se para uma imersão nos bastidores do mais recente encontro de engenharia de dados em Brasília e descubra as tendências que estão moldando o futuro da área. Neste episódio, Vitor Ramos conversa com Wesley Outeiro e outros participantes para compartilhar os principais insights e aprendizados do evento presencial, organizado pela Engenharia de Dados Academy e como palestrante Luan Moreno.Uma conversa sincera sobre a importância das interações presenciais, a evolução da comunidade de dados e o impacto da Inteligência Artificial no dia a dia dos profissionais.O que você vai aprender neste episódio:A importância do networking e da comunidade para o crescimento pessoal e profissional na área de dados.Como a interação presencial em eventos potencializa o aprendizado e a colaboração.As principais tendências em dados e IA que estão criando novas oportunidades e desafios para o mercado.Por que o domínio dos conceitos fundamentais é mais crucial do que nunca para o sucesso na engenharia de dados.A relevância de FinOps para a gestão eficiente de custos de nuvem em projetos de dados.Reflexões sobre como a dinâmica de eventos e a troca de conhecimento estão evoluindo.O poder de se conectar com líderes da indústria para se inspirar e motivar sua carreira. Luan Moreno = https://www.linkedin.com/in/luanmoreno/

Data Culture Podcast
Data Warehouse Automation: Benefits and Market Overview – with Florian Bigelmaier, BARC

Data Culture Podcast

Play Episode Listen Later Aug 18, 2025 34:10


Alter Everything
191: Data Hot Topics with DataFramed

Alter Everything

Play Episode Listen Later Aug 13, 2025 39:25


Join us in a discussion with Richie Cotton, Senior Data Evangelist at DataCamp and host of the DataFramed podcast, for a special crossover episode exploring the hottest topics in data science, analytics, and artificial intelligence! Don't miss the full video of this conversation on YouTube! Discover whether AI will reduce the need to learn coding, the real-world applications of AI agents, and what it truly means to be an "AI-first" company. Get expert insights, practical advice for building a career in data and AI, and learn how to stay ahead in a rapidly changing tech landscape.Panelists: Richie Cotton, Senior Data Evangelist @ DataCamp,LinkedIn, XMegan Bowers, Sr. Content Manager @ Alteryx - @MeganBowers, LinkedInShow notes: DataFramed podcastDataCamp Skill Track: Alteryx FundamentalsGartner Agentic AI articleWSJ Agentic AI article Interested in sharing your feedback with the Alter Everything team? Take our feedback survey here!This episode was produced by Megan Bowers, Mike Cusic, and Matt Rotundo. Special thanks to Andy Uttley for the theme music.

The Data Stack Show
257: Data Tools, Templates, and the Trouble with “Easy” Solutions with the Cynical Data Guy

The Data Stack Show

Play Episode Listen Later Aug 13, 2025 41:29


This week on The Data Stack Show, John and Matt bring you another edition of the Cynical Data Guy. John and Matt dive into the evolution of customer data infrastructure, the growing influence of low-code tools like Clay, and the blurred lines around the “engineer” title in modern data roles. They also discuss the trade-offs between SaaS adoption and building custom solutions, the pitfalls of enterprise software buying, and the realities of platform lock-in—using Palantir's unique business model as a case study. Key takeaways include the importance of simplicity and scalability in data engineering, the need for clear requirements when evaluating tools, and a healthy skepticism toward sales pitches and “art of the possible” features. Don't miss this month's Cynical Data Guy. Highlights from this week's conversation include:Reacting to the Rise of the GTM Engineer (1:11)Is "Engineer" the Right Term? (4:49)Low-Code Tools, AI, and Future Workflows (7:14)Simplicity in Data Engineering (14:38)The Pitfalls of "Simple" Solutions (15:18)Choosing SaaS vs. Building In-House (18:26)Business Process Abstraction and SaaS Adoption (21:31)Enterprise Software: Art of the Possible vs. Practicality (24:31)Sales Advice: Focus on Customer Needs (27:11)Forward Deployed Engineers and Delivery Models (29:05)Platform Lock-In: When Is It a Dirty Word? (36:41)Legacy Systems and the Reality of Lock-In (39:53)Final Thoughts and Takeaways (40:55)The Data Stack Show is a weekly podcast powered by RudderStack, customer data infrastructure that enables you to deliver real-time customer event data everywhere it's needed to power smarter decisions and better customer experiences. Each week, we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Data Gen
Redif Top 3 : La fin de la Modern Data Stack ? Avec Christophe Blefari (aka Blef)

Data Gen

Play Episode Listen Later Aug 12, 2025 39:25


Christophe Blefari est Staff Data Engineer et auteur de la célèbre newsletter data française Blef.fr. Il est l'un des plus gros experts data en France et est d'ailleurs membre du collectif de freelances DataGen. Il revient nous parler des dernières actualités data, notamment du débat qui échauffe les esprits ces dernières semaines : est-ce la fin de la Modern Data Stack ?On aborde :

The Data Stack Show
The PRQL: Simplicity, SaaS, and the Art of Data Engineering with the Cynical Data Guy

The Data Stack Show

Play Episode Listen Later Aug 11, 2025 2:19


In this bonus episode, John and Matt preview the next installment of the Cynical Data Guy. The Data Stack Show is a weekly podcast powered by RudderStack, customer data infrastructure that enables you to deliver real-time customer event data everywhere it's needed to power smarter decisions and better customer experiences. Each week, we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

The Joe Reis Show
Freestyle Friday w/ Matt Housley - AI PhDs, Clanker Content, FoDE retrospective, and more

The Joe Reis Show

Play Episode Listen Later Aug 8, 2025 41:42


Matt Housley joins me to chat about whether it matters that AI is PhD level, clanker content (the new term for AI slop), a retrospective on Fundamentals of Data Engineering, and much more.

Data Culture Podcast
Data Culture bei Henkel: Mit Community zur Data-Driven Company – mit Florian Roscheck, Henkel

Data Culture Podcast

Play Episode Listen Later Aug 4, 2025 33:51


DataTalks.Club
From Simulations to Freelance Data Engineering: Orell's Journey Out of Academia and Into Consulting - Orell Garten

DataTalks.Club

Play Episode Listen Later Aug 1, 2025 58:22


In this episode, we talk with Orell about his journey from electrical engineering to freelancing in data engineering. Exploring lessons from startup life, working with messy industrial data, the realities of freelancing, and how to stay up to date with new tools. Topics covered: Why Orel left a PhD and a simulation‑focused start‑up after Covid hitWhat he learned trying (and failing) to commercialise medical‑imaging simulationsThe first freelance project and the long, quiet months that followedHow he now finds clients, keeps projects small and delivers value quicklyTypical work he does for industrial companies: parsing messy machine logs, building simple pipelines, adding structure laterFavorite everyday tools (Python, DuckDB, a bit of C++) and the habit of blocking time for learningAdvice for anyone thinking about freelancing: cash runway, networking, and focusing on problems rather than “perfect” tech choicesA practical conversation for listeners who are curious about moving from research or permanent roles into freelance data engineering.

Stories from the Hackery
NSS Alumni Forge A Path In Data Engineering | Stories From The Hackery

Stories from the Hackery

Play Episode Listen Later Jul 30, 2025 59:54


In this episode of Stories from the Hackery, we explore the emerging field of data engineering with NSS alumni Teresa Whitesell and Joshua Rio-Ross. They share their career journeys and how their education in data analytics and data science set a solid foundation for their data engineering roles. Teresa discusses the critical role of data engineering in healthcare, while Joshua describes his experiences in both healthcare and FinTech data engineering. They also delve into the distinctions between data engineering, data analytics, data science, and software engineering, and offer advice for those considering a career in data engineering. 00:00 Introduction to Stories from the Hackery 01:27 Meet Teresa Whitesell: From A Desire to Work with Data to a Career in Data Engineering 05:52 Joshua Rio-Ross: From Academics to Data Engineer 12:20 What is Data Engineering 17:55 The Overlap of Data Engineering and Software Engineering 20:48 The Importance of Analytics in Data Engineering 28:16 Systems Building vs. Answering Questions 31:03 Understanding Industry-Agnostic Data Engineering Skills 32:18 NSS's Data Engineering Bootcamp 33:23 Choosing Between Data Engineering and Other Pathways 36:35 The Role of Data Engineers in Organizations 40:36 The Impact of Generative AI on Data Engineering 53:55 Technology Guilty Pleasures 58:20 Conclusion and Final Thoughts

AgileBI
Data Engineering Patterns for the AgileData Event Tile, AgileData Engineering Pattern #5 - Episode #71

AgileBI

Play Episode Listen Later Jul 30, 2025 16:22


Join Shane Gibson and Nigel Vining as they describe and discuss the AgileData Engineering Pattern for the AgileData Event Tile.   The Event Tile Data Modeling pattern captures business processes and transactions within AgileData's three-layered data architecture, modeling "who does what" at a specific point in time. It achieves this by storing only a small number of core business keys in insert-only event tables. These event records are then automatically hydrated into a "consume tile" by joining with all relevant detail attributes that were current at the exact moment the event occurred, ensuring an accurate, time-staged narrative. This provides data consumers with a rich, wide, and historically accurate view of events, simplifying the querying of complex historical changes and state transitions.   An AgileData Engineering Pattern is a repeatable, proven approach for solving a common data engineering challenge in a simple, consistent, and scalable way, designed to reduce rework, speed up delivery, and embed quality by default.   If you want a copy of the pattern template head over to: https://agiledata.substack.com/i/169697974/pattern-name Discover more  AgileData Engineering Patterns over at https://agiledata.substack.com/s/agiledata-engineering-patterns   If you just want to talk about making magic happen with agile and data you can connect with Shane @shagility on LinkedIn.   Subscribe: Apple Podcast | Spotify | Google Podcast  | Amazon Audible | TuneIn | iHeartRadio | PlayerFM | Listen Notes | Podchaser |  Deezer | Podcast Addict |  Buy the Green Book now!   Simply Magical Data Ways of Working

DOU Podcast
Зарплати менеджерів та аналітиків | Падіння Starlink | Нова посада Оксани Ферчук — DOU News #208

DOU Podcast

Play Episode Listen Later Jul 28, 2025 29:07


Cyber Security Weekly Podcast
Episode 458 - Cloud Destinations global footprint reaching Southeast Asia

Cyber Security Weekly Podcast

Play Episode Listen Later Jul 24, 2025 4:28


We speak with Siva Dharmaraj, CEO and Founder of Cloud Destinations, a Silicon Valley-based IT leader with partners in Malaysia. Cloud Destinations has expanded its global footprint, strengthening its presence in the Southeast Asian market and fostering international collaboration in the fields of Digital Transformation, Cloud Computing, Data Engineering, IT security & Software Services.Cloud Destinations were sponsor to Cyber Security Asia 2025, Kuala Lumpur 21 - 22 April

BIFocal - Clarifying Business Intelligence
Episode 298 - Microsoft Fabric June 2025 Feature Summary

BIFocal - Clarifying Business Intelligence

Play Episode Listen Later Jul 15, 2025 33:15


This is episode 298 recorded on July 9th, 2025, where John & Jason talk the Microsoft Fabric June 2025 Feature Summary including lots of Notebook updates in Data Engineering, lower cost for AI functions in Data Science, Copilot for RTI dashboards, and more. For show notes please visit www.bifocal.show

The Joe Reis Show
Peter Hanssens - Building Strong Data Engineering Communities

The Joe Reis Show

Play Episode Listen Later Jul 9, 2025 57:26


Peter Hanssens is an Australia-based data engineer, business owner, and community pillar. He runs Cloud Shuttle, a data engineering consultancy and organizes DataEngBytes, a series of meetups and conferences throughout Australia and New Zealand. We chat about building data engineering communities, running conferences, and much more.

Data Career Podcast
168: Stop Doing Random Data Courses - Read These Books Instead

Data Career Podcast

Play Episode Listen Later Jul 8, 2025 15:30 Transcription Available


Tired of spending money on data courses you never finish? Here are 7 essential books that will actually boost your analytical skills, with no subscription required! Plus, make sure to tune in till the end as one lucky listener will get a free book from this list! Get the books here!DISCLAIMER: Some of the links in this video are affiliate links, meaning if you click through and make a purchase, I may earn a commission at no extra cost to you.Storytelling with Data by Cole Nussbaumer Knaflic

The Data Stack Show
The PRQL: Data Engineering in 2025: Tooling, Headcount, and Survival Strategies with the Cynical Data Guy

The Data Stack Show

Play Episode Listen Later Jul 7, 2025 2:18


The Data Stack Show is a weekly podcast powered by RudderStack, customer data infrastructure that enables you to deliver real-time customer event data everywhere it's needed to power smarter decisions and better customer experiences. Each week, we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Sports Geek - A look into the world of Sports Marketing, Sports Business and Digital Marketing

In this Sports Geek Throwback episode, Sean Callanan interviews  Nick Makarov from  Austin FC. They discussed AI and Data Engineering in Sports. Show notes - https://sportsgeekhq.com/ai-and-data-engineering-in-sports-nick-makarov

Hub & Spoken: Data | Analytics | Chief Data Officer | CDO | Strategy
Embedding value into data and AI initiatives from day one

Hub & Spoken: Data | Analytics | Chief Data Officer | CDO | Strategy

Play Episode Listen Later Jun 26, 2025 20:49


In this solo episode, Cynozure CEO Jason Foster explores what it really means to create value with data and AI and why it can't be treated as a nice-to-have outcome at the end of a project. Jason breaks down a practical, repeatable approach to designing value in from the start, with clear intent, strong foundations, and input-focused delivery. He shares real-world examples and analogies to show how organisations can shift from vague goals to measurable, meaningful impact. This episode is packed with actionable insights for data and business leaders who want to move from theory to practice and ensure their data work truly makes a difference. -------------------------------- Cynozure is a leading data, analytics and AI company that helps organisations to reach their data potential. It works with clients on data and AI strategy, data management, data architecture and engineering, analytics and AI, data culture and literacy, and data leadership. The company was named one of The Sunday Times' fastest-growing private companies in both 2022 and 2023 and recognised as The Best Place to Work in Data by DataIQ in 2023 and 2024. Cynozure is a certified B Corporation. 

Engenharia de Dados [Cast]
The Data Engineering & GenAI Era: Insights with Eduardo Ordax

Engenharia de Dados [Cast]

Play Episode Listen Later Jun 23, 2025 55:38


O Impacto da IA Generativa no Presente e Futuro dos DadosPrepare-se para uma conversa de altíssimo nível sobre como a Inteligência Artificial Generativa está transformando o mundo dos dados, das empresas e das carreiras. Neste episódio, Luan Moreno recebe Eduardo Ordax, Líder de IA Generativa na AWS, e Mateus Oliveira para discutir, sem rodeios, os impactos reais da IA no mercado.O que você vai aprender neste episódio:Como a IA Generativa está mudando a forma como construímos pipelines, produtos e soluções de dados.Os principais desafios que empresas enfrentam ao implementar GenAI — e por que tecnologia não é mais o problema, mas sim pessoas e dados.O papel da Engenharia de Dados no mundo da IA e como ela se conecta com conceitos como LLMOps, Fine-Tuning, Prompt Engineering e Data-Centric AI.Por que o domínio dos fundamentos nunca foi tão importante para quem trabalha (ou quer trabalhar) com dados e IA.Reflexões sobre o futuro das carreiras em dados e IA — será que os engenheiros de dados, cientistas de dados e desenvolvedores serão substituídos ou terão um papel ainda mais relevante?As diferenças entre usar IA para brincar no ChatGPT e levar IA para resolver problemas de negócios no mundo real, em escala e em produção.Este é um papo sobre IA. É uma imersão completa sobre os desafios, as oportunidades e a visão de futuro para quem trabalha com dados, engenharia, machine learning e inteligência artificial. Luan Moreno = https://www.linkedin.com/in/luanmoreno/

AI + a16z
AI, Data Engineering, and the Modern Data Stack

AI + a16z

Play Episode Listen Later Jun 20, 2025 35:07


In this episode of AI + a16z, dbt Labs founder and CEO Tristan Handy sits down with a16z's Jennifer Li and Matt Bornstein to explore the next chapter of data engineering — from the rise (and plateau) of the modern data stack to the growing role of AI in analytics and data engineering. As they sum up the impact of AI on data workflows: The interesting question here is human-in-the-loop versus human-not-in-the-loop. AI isn't about replacing analysts — it's about enabling self-service across the company. But without a human to verify the result, that's a very scary thing.Among other specific topics, they also discuss how automation and tooling like SQL compilers are reshaping how engineers work with data; dbt's new Fusion Engine and what it means for developer workflows; and what to make of the spate of recent data-industry acquisitions and ambitious product launches.Follow everyone on X:Tristan HandyJennifer LiMatt Bornstein Check out everything a16z is doing with artificial intelligence here, including articles, projects, and more podcasts.

alphalist.CTO Podcast - For CTOs and Technical Leaders
#123 - From Nokia to AI-IoT: Engineering the Physical World with Bernd Groß // CEO @ Cumulocity

alphalist.CTO Podcast - For CTOs and Technical Leaders

Play Episode Listen Later Jun 12, 2025 63:07 Transcription Available


The physical world is becoming digital—and it requires fundamentally different technical architecture than traditional IT systems. Bernd Groß leads technical leaders through the evolution from enterprise software to industrial IoT, where real-time data from 30,000 wind turbines and millisecond-level decision-making define system requirements. As co-founder and CEO of Cumulocity, Bernd has navigated one of tech's most complex domains: connecting industrial hardware through standardized platforms. His journey from Nokia's early cloud computing initiatives to building Germany's leading IoT platform offers unique insights on technical leadership in physical-digital convergence. Technical leaders will gain valuable perspectives on: •

The Joe Reis Show
Matthew Scullion - The Agentic Data Engineering Team

The Joe Reis Show

Play Episode Listen Later Jun 10, 2025 45:13


Matthew Scullion (CEO, Co-Founder of Matillion) joins me to chat about the future of data engineering, namely agentic data engineering teams. What does this new world look like? Matthew shares some ideas of what he's building at Matillion, and the broader context of what agentic AI means for the data ecosystem, teams, and workflows.

The Data Engineering Show
From Zero to 100M Users: Inside Notion's Data Stack and AI Strategy with Sumit Gupta

The Data Engineering Show

Play Episode Listen Later Jun 10, 2025 22:13


Dive into the future of data engineering with Sumit Gupta, Lead BI Engineer at Notion, as he shares insights with the bros on navigating the AI revolution in modern data stacks. From leveraging tools like Snowflake and dbt to automating content creation with AI, discover how traditional technical skills are evolving alongside the rise of AI. Whether you're a seasoned data professional or just starting your journey, learn why embracing AI isn't optional and how to balance technical expertise with crucial soft skills in this rapidly changing landscape. Get an insider's perspective on working at tech giants like Notion, Snowflake, and Dropbox, while exploring practical applications of AI in both professional and personal contexts.

ITCS PIZZATIME TECH PODCAST
#170 - Fußball + Daten = Leidenschaft?! Über smarte IT und datengetriebene Lösungen beim DFB ⚽

ITCS PIZZATIME TECH PODCAST

Play Episode Listen Later Jun 8, 2025 28:34


Was passiert, wenn Fußball auf Data Engineering trifft? In dieser Folge sprechen wir mit Sarah Houy (Data Engineer) und Uwe Vass (Enterprise Architect) vom Deutschen Fußball-Bund (DFB) über die spannende Welt hinter dem Spielfeld – nämlich die digitale.

SQL Data Partners Podcast
Episode 285: Who Is Using Microsoft Fabric

SQL Data Partners Podcast

Play Episode Listen Later May 29, 2025 34:05


Fabric personas were originally designed to break down the various functional roles within Microsoft Fabric—such as Power BI, Data Factory, Data Activator, Data Engineering, Data Science, Data Warehouse, and Real-time Analytics—into more manageable, bite-sized sections. The goal was to prevent users from feeling overwhelmed by the platform's breadth. However, this feature has since been discontinued, as it did not effectively communicate the seamless integration between these roles. Still, the underlying concepts can be useful when thinking about how you might approach Fabric from a functional standpoint. Do you like the change on one large white canvas, or did personas have a use for you? Let us know in the comments below. We hope you enjoyed this conversation on personas in Microsoft Fabric. If you have questions or comments, please send them our way. We would love to answer your questions on a future episode. Leave us a comment and some love ❤️on LinkedIn, X, Facebook, or Instagram. The show notes for today's episode can be found at Episode 285: Who is Using Microsoft Fabric. Have fun on the SQL Trail!

The Data Stack Show
246: AI, Abstractions, and the Future of Data Engineering with Pete Hunt of Dagster

The Data Stack Show

Play Episode Listen Later May 28, 2025 48:59


Highlights from this week's conversation include:Pete's Background and Journey in Data (1:36)Evolution of Data Practices (3:02)Integration Challenges with Acquired Companies (5:13)Trust and Safety as a Service (8:12)Transition to Dagster (11:26)Value Creation in Networking (14:42)Observability in Data Pipelines (18:44)The Era of Big Complexity (21:38)Abstraction as a Tool for Complexity (24:41)Composability and Workflow Engines (28:08)The Need for Guardrails (33:13)AI in Development Tools (36:24)Internal Components Marketplace (40:14)Reimagining Data Integration (43:03)Importance of Abstraction in Data Tools (46:17)Parting Advice for Listeners and Closing Thoughts (48:01)The Data Stack Show is a weekly podcast powered by RudderStack, customer data infrastructure that enables you to deliver real-time customer event data everywhere it's needed to power smarter decisions and better customer experiences. Each week, we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

The Data Stack Show
The PRQL: Breaking Down Silos: Collaborative Data Engineering in the AI Era with Pete Hunt of Dagster

The Data Stack Show

Play Episode Listen Later May 26, 2025 3:20


The Data Stack Show is a weekly podcast powered by RudderStack, customer data infrastructure that enables you to deliver real-time customer event data everywhere it's needed to power smarter decisions and better customer experiences. Each week, we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

What's new in Cloud FinOps?
WNiCF - Interview with Udam - do FinOps like a Fortune 50

What's new in Cloud FinOps?

Play Episode Listen Later May 19, 2025 52:00


Send us a textIn this episode, Frank and Stephen talk with Udam about the changing world of FinOps. They focus on the challenges organizations face in managing cloud costs and data accuracy. Udam shares insights from his vast experience in the field. He highlights the need for data standardization, the role of data engineering, and ongoing investment in FinOps practices. The conversation also explores innovative solutions like Stitcher AI, which aim to simplify data management and improve decision-making in financial operations. The speakers dive into the complexities of FinOps, stressing the need to understand fully loaded costs. They discuss engaging teams in cost allocation and the importance of contextualized data for informed decisions. They address issues in traditional cost management and how new tools can democratize access to financial insights. These tools help organizations of all sizes optimize cloud spending and boost operational efficiency.Sound Bites"We don't keep any of the data.""We have to be really accurate with our costs.""You cost double your salary to the company""Cost allocation is hugely important for FinOps""FinOps has to be a bi-directional interaction"

The Tech Trek
Building AI Products? Start Here

The Tech Trek

Play Episode Listen Later May 16, 2025 26:11


In this episode of The Tech Trek, Amir speaks with Patrick Leung, CTO of Faro Health, about what it takes to lead an engineering organization through a transformation to become an AI-first company. From redefining the product roadmap to managing cultural and technical shifts, Patrick shares practical insights on team structure, skill development, and delivering AI-enabled features in a regulated domain like clinical trials. This is a must-listen for tech leaders navigating similar transitions.

The Data Stack Show
241: Marketing Meets Data: Measuring Impact and Driving Results with Pedram Navid of Dagster Labs

The Data Stack Show

Play Episode Listen Later May 12, 2025 38:42


Highlights from this week's conversation include:Pedram's Background and Journey in Data (1:13)Marketing vs. Data Engineering (2:30)Understanding Marketing Pressures (4:16)Attribution Models and Accountability (8:13)Balancing Marketing and Team Management (12:25)Introduction to Dagster Components (15:00)AI Integration with Data Engineering (19:05)Challenges in Data Support (22:05)Self-Service Data Access (26:07)AI in Data Management (28:25)Organizing Data in Technical Teams (31:25)Challenges in Real-Time Data (33:28)Final Thoughts and Takeaways (37:01)The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

MLOps.community
AI Data Engineers - Data Engineering After AI // Vikram Chennai // #309

MLOps.community

Play Episode Listen Later Apr 25, 2025 49:40


AI Data Engineers - Data Engineering after AI // MLOps Podcast #309 with Vikram Chennai, Founder/CEO of Ardent AI.Join the Community: https://go.mlops.community/YTJoinIn Get the newsletter: https://go.mlops.community/YTNewsletter // AbstractA discussion of Agentic approaches to Data Engineering. Exploring the benefits and pitfalls of AI solutions and how to design product-grade AI agents, especially in data.// BioSecond Time Founder. 5 years building Deep learning models. Currently, AI Data Engineers// Related LinksWebsite: tryardent.com~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExploreJoin our slack community [https://go.mlops.community/slack]Follow us on X/Twitter [@mlopscommunity](https://x.com/mlopscommunity) or [LinkedIn](https://go.mlops.community/linkedin)] Sign up for the next meetup: [https://go.mlops.community/register]MLOps Swag/Merch: [https://shop.mlops.community/]Connect with Demetrios on LinkedIn: /dpbrinkmConnect with Vikram on LinkedIn: /vikram-chennai/

BIFocal - Clarifying Business Intelligence
Episode 292 - Microsoft Fabric March 2025 Feature Summary

BIFocal - Clarifying Business Intelligence

Play Episode Listen Later Apr 24, 2025 37:59


This is episode 292 recorded on April 22nd, 2025 where John & Jason talk the Microsoft Fabric February 2025 Feature Summary including Fabric Platform, OneLake, and Data Engineering.

HR to HX: From Human Resources to the Human Experience
How Data Literacy Transforms HR Leadership (Part Two)

HR to HX: From Human Resources to the Human Experience

Play Episode Listen Later Apr 15, 2025 25:57


Hey humans! Welcome back to part two of our data literacy series! In this episode, I continue my round table discussion with Jennifer Wright, Karen Brieger, and Kelly Oliver as we dive deeper into the practical aspects of HR data. We explore the critical importance of "clean data" - what it really means and why it matters so much. Kelly breaks down the three-phase framework of data engineering, data analysis, and data insights, explaining why you can't just jump straight to insights without proper preparation. Jennifer shares a powerful example about how software conversion challenges can create data issues, while Karen emphasizes the importance of basic data accuracy - from employee addresses to departmental coding. Our conversation also addresses the unique challenges faced by fractional HR leaders who need to quickly adapt to different organizational cultures and data preferences. As Karen explains, some clients want workshops and training while others just want quick data points without the deeper understanding. We discuss how to navigate these different environments while still delivering value. We also touch on the future of HR data and analytics with cautious optimism about AI's potential to help identify anomalies and patterns. There are still so many organizations still mastering the basics of data literacy. Enjoy part two of our data conversation! Stacie More episodes at StacieBaird.com. LinkedIn Pages for each of my guests: Jennifer Wright Karen Brieger Kelly Oliver

Innovation and the Digital Enterprise
Resonant Insights On Leadership: A Compilation

Innovation and the Digital Enterprise

Play Episode Listen Later Apr 10, 2025 15:12 Transcription Available


In this episode, we look back on invaluable leadership insights shared by renowned executives across the technology industry. Featuring wisdom from Christine Sandman Stone, Arne Saupe, Jorie Sax, Thulasi Kethini, and Tony Newcome, the discussion delves into the distinct skill sets required for leadership, the importance of fostering a culture of innovation, and the critical need for supportive and open communication within teams. These leaders unpack practical advice for setting meaningful goals, building complementary partnerships, and maintaining resilience. We learn about the ways leadership requires courage, decisiveness, and the ability to connect deeply with team members. Their words provide a rich tapestry of experiences and strategies to inspire aspiring and current leaders.(00:00) Introduction to Leadership Insights(02:10) Christine Sandman Stone on Leadership vs. Development(03:18) Arne Saupe on Leadership Culture and Talent(04:54) Jorie Sax on Empowering Creativity and Innovation(06:19) Thulasi Kethini on Fostering Curiosity(08:26) Tony Newcome on Connecting and Supporting Your Team(10:43) Christine Sandman Stone on Setting Meaningful Goals(11:16) Arne Saupe on Vision(11:55) Tony Newcome on Mentorship(14:03) Christine Sandman Stone on Being a First-Time Leader(14:45) Conclusion: Reflecting on Effective LeadershipChristine Sandman Stone is the former Global Head of Product & Engineering Operations & Strategy at Groupon. Arne Saupe is the former CTO at Farmer's Fridge and newly appointed CTO at Wellfound Foods. Jorie Sax heads United Airlines' Innovation Lab. Thulasi Kethini is the Executive Director and Head of Data Engineering at JPMorgan, Tony Newcome is CTO at ActiveCampaign.If you'd like to receive new episodes as they're published, please subscribe to Innovation and the Digital Enterprise in Apple Podcasts, Spotify, or wherever you get your podcasts. If you enjoyed this episode, please consider leaving a review in Apple Podcasts. It really helps others find the show.Podcast episode production by Dante32.

Geeksblabla
#180 - Data Engineering 101

Geeksblabla

Play Episode Listen Later Apr 8, 2025 105:18


Data engineering is a critical field in data science that involves preparing the "big data" infrastructure to be analyzed by data scientists. In this episode we are discussing the differences and how important each is with our guests.

Vanishing Gradients
Episode 47: The Great Pacific Garbage Patch of Code Slop with Joe Reis

Vanishing Gradients

Play Episode Listen Later Apr 7, 2025 79:12


What if the cost of writing code dropped to zero — but the cost of understanding it skyrocketed? In this episode, Hugo sits down with Joe Reis to unpack how AI tooling is reshaping the software development lifecycle — from experimentation and prototyping to deployment, maintainability, and everything in between. Joe is the co-author of Fundamentals of Data Engineering and a longtime voice on the systems side of modern software. He's also one of the sharpest critics of “vibe coding” — the emerging pattern of writing software by feel, with heavy reliance on LLMs and little regard for structure or quality. We dive into: • Why “vibe coding” is more than a meme — and what it says about how we build today • How AI tools expand the surface area of software creation — for better and worse • What happens to technical debt, testing, and security when generation outpaces understanding • The changing definition of “production” in a world of ephemeral, internal, or just-good-enough tools • How AI is flattening the learning curve — and threatening the talent pipeline • Joe's view on what real craftsmanship means in an age of disposable code This conversation isn't about doom, and it's not about hype. It's about mapping the real, messy terrain of what it means to build software today — and how to do it with care. LINKS * Joe's Practical Data Modeling Newsletter on Substack (https://practicaldatamodeling.substack.com/) * Joe's Practical Data Modeling Server on Discord (https://discord.gg/HhSZVvWDBb) * Vanishing Gradients YouTube Channel (https://www.youtube.com/channel/UC_NafIo-Ku2loOLrzm45ABA) * Upcoming Events on Luma (https://lu.ma/calendar/cal-8ImWFDQ3IEIxNWk)

The Data Stack Show
235: Pete Soderling on the Evolution of Data Engineering

The Data Stack Show

Play Episode Listen Later Apr 2, 2025 43:23


Highlights from this week's conversation include:Pete's Career Overview (1:00)AI and Data Engineering Discussion (2:05)Themes of Data Council (4:19)High-Frequency Trading Insights (8:04)San Francisco's Unique Advantages (10:27)Data Council Conference Preview (13:23)The Magic of In-Person Events (15:45)Collapsing Batch and Streaming Systems (19:47)Leveraging Local Hardware for Data Processing (22:07)Future of Blockchain in Computing (23:57)Intersection of AI and Data Management (26:47)Advice for AI Startup Founders (28:44)Blurring Lines Between Data Roles (32:46)The Evolving Role of Engineers (36:56)Discount Code for Data Council and Parting Thoughts (38:23)The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we'll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

The Joe Reis Show
Freestyle Fridays - Shifting Left AND Right. The Data Engineering Lifecycle in 2025. What's Changed?

The Joe Reis Show

Play Episode Listen Later Mar 28, 2025 9:52


People often ask me what I'd change in Fundamentals of Data Engineering. Usually, I reply "not much", as the the Data Engineering Lifecycle still remains intact. However, I see the role of data engineers shifting both left and right. What does this mean? Have a listen.

The Joe Reis Show
Willis Nana - Navigating Data Engineering Leadership, YouTube, and more

The Joe Reis Show

Play Episode Listen Later Mar 20, 2025 43:37


Willis Nana and I chat about the challenges of data engineering leadership, foundational skills, and his journey to a content creator on YouTube.#dataengineering #data #ai #datateam #leadership

The Joe Reis Show
Simon Späti - The Art of Writing about Data Engineering

The Joe Reis Show

Play Episode Listen Later Mar 13, 2025 50:46


Simon Späti and I discuss various aspects of writing, data engineering, and the impact of AI on the writing process. Simon shares his journey from business intelligence to data engineering and his current focus on writing. We also discuss the future of writing in the age of AI. Enjoy!

DataTalks.Club
Trends in Data Engineering – Adrian Brudaru

DataTalks.Club

Play Episode Listen Later Mar 7, 2025 56:59


In this podcast episode, we talked with Adrian Brudaru about ​the past, present and future of data engineering.About the speaker:Adrian Brudaru studied economics in Romania but soon got bored with how creative the industry was, and chose to go instead for the more factual side. He ended up in Berlin at the age of 25 and started a role as a business analyst. At the age of 30, he had enough of startups and decided to join a corporation, but quickly found out that it did not provide the challenge he wanted.As going back to startups was not a desirable option either, he decided to postpone his decision by taking freelance work and has never looked back since. Five years later, he co-founded a company in the data space to try new things. This company is also looking to release open source tools to help democratize data engineering.0:00 Introduction to DataTalks.Club1:05 Discussing trends in data engineering with Adrian2:03 Adrian's background and journey into data engineering5:04 Growth and updates on Adrian's company, DLT Hub9:05 Challenges and specialization in data engineering today13:00 Opportunities for data engineers entering the field15:00 The "Modern Data Stack" and its evolution17:25 Emerging trends: AI integration and Iceberg technology27:40 DuckDB and the emergence of portable, cost-effective data stacks32:14 The rise and impact of dbt in data engineering34:08 Alternatives to dbt: SQLMesh and others35:25 Workflow orchestration tools: Airflow, Dagster, Prefect, and GitHub Actions37:20 Audience questions: Career focus in data roles and AI engineering overlaps39:00 The role of semantics in data and AI workflows41:11 Focusing on learning concepts over tools when entering the field 45:15 Transitioning from backend to data engineering: challenges and opportunities 47:48 Current state of the data engineering job market in Europe and beyond 49:05 Introduction to Apache Iceberg, Delta, and Hudi file formats 50:40 Suitability of these formats for batch and streaming workloads 52:29 Tools for streaming: Kafka, SQS, and related trends 58:07 Building AI agents and enabling intelligent data applications 59:09Closing discussion on the place of tools like DBT in the ecosystem

DOU Podcast
Найращі ІТ-компаній України | Вихід Netcracker з рф | Новий iPhone 16e — DOU News #186

DOU Podcast

Play Episode Listen Later Feb 24, 2025 37:52