Why Database Time Series Compression Uses Delta and Gorilla Encoding
from Database Tech with Fexingo: SQL, NoSQL, and Data Storage Conversations Hosted by Fexingo
Lucas and Luna unpack the surprisingly compact way modern time-series databases store billions of timestamps and values. They explain why classic compression tricks like dictionary encoding fall short when every data point is unique, and how delta-of-delta encoding plus XOR-based value packing — the approach popularized by Facebook's Gorilla paper — can shrink a metric stream by over 90%. The conversation walks through a concrete example of timestamp and value compression, explores when it's worth the extra CPU cost, and why systems like Prometheus, InfluxDB, and TimescaleDB lean on these ideas. A practical episode for anyone who's ever wondered how monitoring dashboards stay responsive with years of high-frequency data. #TimeSeriesDatabases #Compression #GorillaEncoding #DeltaOfDelta #XORPacking #DatabaseInternals #Prometheus #InfluxDB #TimescaleDB #DataEngineering #MetricStorage #TechPodcast #Databases #SQL #NoSQL #FexingoBusiness #BusinessPodcast #Technology Keep every episode free: buymeacoffee.com/fexingo
Embed this episode
No transcript yet.