Scaling Postgres

In this episode of Scaling Postgres, we discuss excluding partitions without using a partition key, a pgBackRest interview, Postgres backup without an incremental chain and a replication deadlock bug in Postgres 14-16. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/425-novel-partition-exclusion/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss the dangers of too many tables, don't worry about extending checkpoint_timeout, a disaster recovery process, and non-repeatable sums with floating point numbers. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/424-too-many-table-danger/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss a new backup tool called pg_hardstorage by Cybertech, bottomless storage & ColdFront, monitoring checkpoints and tracking statistics. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/423-new-backup-tool/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss scaling out application writes to achieve 226K TPS, try to avoid delete, disaster recovery is a process and avoid NULL in your NOT IN. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/422-scaling-out-to-226k-tps/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss scale out Postgres projects getting more funding, getting started with Postgres 19 Beta 1 along with its top features and how to review a Postgres patch. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/421-scale-out-funding/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss the release of Postgres 19 Beta 1, optimizing autovacuum, the release of Multigres 0.1 Alpha 1, and handling graph queries in Postgres. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/420-postgres-19-beta-1-released/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we go over the architecture of Multigres (Vitess for Postgres), pgBackRest's status, pg_flight_recorder and general SQL optimizations. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/419-dynamic-duo/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we go over the architecture of Multigres (Vitess for Postgres), pgBackRest's status, pg_flight_recorder and general SQL optimizations. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/418-multigres-architecture/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss new Postgres releases that patch eleven security issues, a new pgbouncer release patching four security issues, making JSON queryable, and issues with views. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/417-eleven-security-issues/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss a new zero bloat Postgres queue called PgQue, maybe pgBackRest isn't dead, multixact members at 64 bits and using session variables. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/416-zero-bloat-postgres-queue/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss the notice of obsolescence for pgBackRest, the open source environment in general, queries to monitor autovacuum and pg_wait_tracer. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/415-pgbackrest-is-dead/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss repack concurrently coming to PG 19, how to design your schema, all about hints and enforcing constraints across partitions. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/414-repack-concurrently/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss sharding your database with one command, more information about the Linux 7 Postgres performance regression, Xata going open source, and checkpoints and WAL storms. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/413-shard-with-one-command/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss how Postgres may be half as fast on the new Linux 7 kernel, PostgresBench, what is missing in Postgres and WAL to distribute data. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/412-half-as-fast-on-linux-7/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss techniques to absorb excessive query load, BM25 text search via pg_textsearch, good & bad CTEs and plan_cache_mode. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/411-absorbing-load/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss a proprietary way of controlling Postgres query traffic, preserving statistics during upgrades, a DB schema migration survey and a new repack command. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/410-postgres-traffic-cop/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss how Apache Iceberg may have lead to Postgres company acquisitions, presentations on CloudNativePG & query tuning, setting up Patroni and utilizing PgBouncer. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/409-iceberg-causes-postgres-acquisitions/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss how open source is eating the world, mitigating plan flips, migrating from Heroku to RDS, and how work_mem is a trap. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/408-open-source-eating-the-world/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss the possibility of having stable plans in Postgres 19, settings to kill disconnected or crashed clients, on conflict do select and all about Patroni. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/407-stable-plans/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss how a lock can cause data to vanish, new Postgres releases, fast replication with peerDB and pg_ash for wait sampling. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/406-lock-causes-data-to-vanish/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss an out of cycle Postgres release, a Supabase downtime incident, optimizing top K queries and how to maintain reading efficiency. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/405-out-of-cycle-releases/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss how the postmaster does not scale, new Postgres releases, data storage using PAX and a path generation strategies change. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/404-postmaster-does-not-scale/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss a potential way to mitigate retry storms or orphan DB sessions with client_connection_check_interval, checkpoint configuration, skip scans and more just use Postgres. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/403-mitigate-retry-storms/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss how OpenAI's ChatGPT handles millions of queries per second, an update on PgDog, Clickhouse offers OLTP hosted Postgres and partition table source of truth. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/402-millions-of-qps/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss searching one billion vectors on Postgres, how to bypass a vector index search, unconventional optimizations and a 40x boost to listen/notify performance. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/401-one-billion-vectors-on-postgres/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss the cost of arrays, dealing with integer overflow, idle sessions causing transaction wraparound and AI or LLM index recommendations. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/400-the-cost-of-arrays/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss the overhead of indexes, a Postgres year in review, an intro to row locking and table renaming issues. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/399-index-overhead/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we examine how latency impacts performance, naughty queries, bm25 indexes and how to quickly create database clones. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/398-latency-killing-performance/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss if vacuum is lying to you with regard to index cleanup, an agentic toolkit with MCP server, indexes getting corrupted after an upgrade and $50 Planetscale Metal. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/397-vacuum-is-lying-to-you/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss using Postgres queries in ClickHouse, faster faceted search, max_connections & migrations and different scan types. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/396-600-times-faster-analytics/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss a patch that can plan joins 16 times faster, the best way to record text values, extensions via image volumes with CloudNativePG and using pg_partman vs rolling your own. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/395-16-times-faster-join-plans/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss my Black Friday / Cyber Monday course deal, the job security that LLMs provide, new Postgres releases and why you should hard your datbase. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/394-five-times-faster-aggregates/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss my Black Friday / Cyber Monday course deal, the job security that LLMs provide, new Postgres releases and why you should shard your database. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/393-job-security/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss performance improvements related to skip scans, faster backup & restore, benefits of minimal indexes and more details about my upcoming course discount. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/392-100-times-faster-by-skipping/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss the issues of partition locking during planning, the problem of too much memory, the importance of a txvector column and an upcoming sale on my course. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/391-table-lock-explosion/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss how far Postgres can scale with queue and pub/sub workloads, temporal joins, IPC:SyncRep and nested partitioning. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/390-1.2-million-messages-per-second/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss ways to optimize reading or writing, the benefits of a descending index, more information about lightweight locks and a backup public service announcement. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/389-heavy-reader-or-writer/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss PG17 and PG18 benchmarks across storage types, more about Postgres locks, sanitizing SQL and can a faster software & hardware environment cause performance problems? To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/388-nvme-wins/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we explore how PG18 locking changes can boost planning performance, how to store data safely on a budget, how to build a parquet file archive solution and we discuss the completion of the summer of upgrades. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/387-boosting-planning-performance/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss additional Postgres 18 features, some future features for Postgres, how to use update with limit and how recent Ubuntu OS patches cause a Postgres restart. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/386-postgres-18-the-deep-cuts/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss the release of Postgres 18 and cover different features such as asynchronous I/O, enhanced return from statements, parallel apply, adding not null as not valid and more! To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/385-postgres-18-released/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss getting excited about Postgres 18, oauth authentication, reconsidering your interface and a zero downtime upgrade. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/384-preparing-for-postgres-18/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss free availability of an OrioleDB patent, pgEdge going open source, pg_duckdb hitting 1.0 and methods resolve to slow order by limit queries. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/383-orioledb-more-free/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss using a LLM as an agent, the importance of partitioned table statistics, PG 18 RC1, primary keys in sharded databases and a blue/green rollback. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/382-db-llm-agents/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss DocumentDB moving to the Linux Foundation, multi-column indexes, SCRAM pass-through and RDS Proxy oddities. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/381-documentdb-movement/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss enhancements to Oriole DB, new Postgres releases, a logging guide and application framework frustrations. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/380-storage-engine-progress/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss when you should reindex, how to handle case insensitive data, how to index jsonb and the top recommendations when doing performance optimizations. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/379-unconventional-advice/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss Postgres getting a native column store via an index, faster btree_gift indexes, scaling listen/notify, and a logical replication slot deep dive. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/378-native-column-store/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss how to shard your DB at network speeds, how to make your DB 42,000 slower, new monitoring and just enough text searching performance. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/377-sharding-at-network-speeds/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/  

In this episode of Scaling Postgres, we discuss a 100K events per second queue built on Postgres, how an MCP can leak your database, MultiXact ID and space overrun and struggles starting Postgres. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/376-100k-events-per-second-queue/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/