EPISODE · Feb 26, 2026 · 17 MIN
Data ingestion using PyAirbyte: Google Drive to Postgres
from Technology Explorations in Data · host Dataminded
Move your Google Drive documents straight into Postgres using Python and PyAirbyte. In this Technical Explorations episode, Jonny and Tarik from Dataminded show how they ingest internal meeting transcripts (Facts & Breakfast, Learning Over Lunch) from Google Drive into a relational table, ready for querying and AI use cases.You’ll see how to:Configure PyAirbyte to read from a Google Drive folderAuthenticate with a Google service account (JSON key)Convert Airbyte output into a clean pandas DataFrameLoad the processed data into a Postgres tableDiscuss performance limits, API rate limits, and batchingReflect on when PyAirbyte is great for PoCs vs. production setupsWe also touch on:How many connectors Airbyte offers and what PyAirbyte can reuseTrade-offs of code-first ingestion vs. point-and-click UIIdeas for the next step: using MindsDB and LLMs to query this knowledge base
What this episode covers
Move your Google Drive documents straight into Postgres using Python and PyAirbyte. In this Technical Explorations episode, Jonny and Tarik from Dataminded show how they ingest internal meeting transcripts (Facts & Breakfast, Learning Over Lunch) from Google Drive into a relational table, ready for querying and AI use cases.You’ll see how to:Configure PyAirbyte to read from a Google Drive folderAuthenticate with a Google service account (JSON key)Convert Airbyte output into a clean pandas DataFrameLoad the processed data into a Postgres tableDiscuss performance limits, API rate limits, and batchingReflect on when PyAirbyte is great for PoCs vs. production setupsWe also touch on:How many connectors Airbyte offers and what PyAirbyte can reuseTrade-offs of code-first ingestion vs. point-and-click UIIdeas for the next step: using MindsDB and LLMs to query this knowledge base
NOW PLAYING
Data ingestion using PyAirbyte: Google Drive to Postgres
No transcript for this episode yet
Similar Episodes
Mar 19, 2026 ·34m
Feb 18, 2026 ·11m
Feb 11, 2026 ·45m
Nov 12, 2025 ·35m
Oct 17, 2025 ·40m