Data Engineering Podcast

Scaling Airbyte: Challenges and Milestones on the Road to 1.0

Enhancing Data Accessibility and Governance with Gravitino

This episode explores Gravitino, an open-source metadata service designed to provide a unified view of diverse schemas, addressing the challenge of data silos across various data lakes and cloud platforms. Against the backdrop of the growing need for efficient data management in the age of generative AI, Junping Du, t...

The Evolution of DataOps: Insights from DataKitchen's CEO

Achieving Data Reliability: The Role of Data Contracts in Modern Data Management

How Generative AI Is Impacting Data Engineering Teams

This episode explores the impact of AI, specifically generative AI models like ChatGPT, on data engineering teams. Against the backdrop of readily available model APIs, the discussion highlights the emergence of new technologies in the data stack, including retrieval augmented generation (RAG) and vector databases. Mo...

The Role of Product Managers in Data-Centric Organizations

Neon: A Serverless And Developer Friendly Postgres

This episode explores the development and architecture of Neon, a serverless PostgreSQL database. The interview centers around Nikita Shamgunov's journey in building Neon, highlighting the challenges and insights gained from his previous experience at SingleStore. Against the backdrop of the limitations of existing c...

Improve Data Quality Through Engineering Rigor And Business Engagement With Synq

Stitching Together Enterprise Analytics With Microsoft Fabric

Being Data Driven At Stripe With Trino And Iceberg

This episode explores Stripe's utilization of Trino and Iceberg for its data lakehouse architecture. Against the backdrop of outgrowing Redshift's capabilities, Stripe adopted Trino for its read-heavy business analytics, contrasting it with Spark's use for data transformation. More significantly, the discussion delves...

X-Ray Vision For Your Flink Stream Processing With Datorios

Practical First Steps In Data Governance For Long Term Success

This podcast episode emphasizes the critical importance of data governance across organizations of all sizes, highlighting its role as a foundation for effective data management. Nicola discusses the necessity of establishing a data governance framework early in an organization's lifecycle, the communication bridge it ...

Data Migration Strategies For Large Scale Systems

Zenlytic Is Building You A Better Coworker With AI Agents

Release Management For Data Platform Services And Logic

This podcast episode explores the challenges of testing data pipelines and managing releases, particularly in relation to maintaining data connections, validating transformations, and ensuring a reliable Quality Assurance (QA) process. It discusses the difficulties of working with production data in a pre-production en...

Barking Up The Wrong GPTree: Building Better AI With A Cognitive Approach

Build Your Second Brain One Piece At A Time

This podcast episode explores Pieces, a personalized AI tool designed to transform the way developers and professional creators interact with small workflow materials. The tool aims to capture and organize code snippets, configs, links, and screenshots, providing enrichment by automatically tagging, associating documen...

Making Email Better With AI At Shortwave

Designing A Non-Relational Database Engine

Establish A Single Source Of Truth For Your Data Consumers With A Semantic Layer

This podcast episode explores the evolution of semantic layers in data platforms and their impact on data modeling, data delivery, and the responsibilities of data teams. It discusses the shift towards standalone semantic layers and their role in providing a single source of truth for metrics and definitions. The episo...