Streaming ZIP Archives On the Fly With nginx + mod_zip: No Disk, No Buffers, No Problem episode artwork

EPISODE · Jun 1, 2026 · 13 MIN

Streaming ZIP Archives On the Fly With nginx + mod_zip: No Disk, No Buffers, No Problem

from Programming Tech Brief By HackerNoon · host HackerNoon

This story was originally published on HackerNoon at: https://hackernoon.com/streaming-zip-archives-on-the-fly-with-nginx-mod_zip-no-disk-no-buffers-no-problem. How we stream ZIP archives on the fly at scale using nginx + mod_zip — no disk writes, no buffering, with local and remote files in a single archive. Check more stories related to programming at: https://hackernoon.com/c/programming. You can also check exclusive content about #nginx, #zip, #php, #architecture, #performance, #file-handling, #backend, #hackernoon-top-story, and more. This story was written by: @dmitriistarikov. Learn more about this writer by checking @dmitriistarikov's about page, and for more stories, please visit hackernoon.com. Instead of downloading files to disk, computing checksums, and building a ZIP before serving it, we use nginx + mod_zip to stream archives directly to the client. PHP returns a short manifest listing file URLs and sizes — nginx fetches each file via internal subrequests and pumps them into a ZIP stream in real time. No temp files, no buffering, no waiting. The main gotcha: file sizes are required upfront (ZIP format constraint), which is trivial for local files and requires a HEAD request for remote ones. We hit a production incident caused by zero sizes in metadata from an external team — silent broken archives, hard to debug because mod_zip subrequests don't surface in normal log pipelines.

This story was originally published on HackerNoon at: https://hackernoon.com/streaming-zip-archives-on-the-fly-with-nginx-mod_zip-no-disk-no-buffers-no-problem. How we stream ZIP archives on the fly at scale using nginx + mod_zip — no disk writes, no buffering, with local and remote files in a single archive. Check more stories related to programming at: https://hackernoon.com/c/programming. You can also check exclusive content about #nginx, #zip, #php, #architecture, #performance, #file-handling, #backend, #hackernoon-top-story, and more. This story was written by: @dmitriistarikov. Learn more about this writer by checking @dmitriistarikov's about page, and for more stories, please visit hackernoon.com. Instead of downloading files to disk, computing checksums, and building a ZIP before serving it, we use nginx + mod_zip to stream archives directly to the client. PHP returns a short manifest listing file URLs and sizes — nginx fetches each file via internal subrequests and pumps them into a ZIP stream in real time. No temp files, no buffering, no waiting. The main gotcha: file sizes are required upfront (ZIP format constraint), which is trivial for local files and requires a HEAD request for remote ones. We hit a production incident caused by zero sizes in metadata from an external team — silent broken archives, hard to debug because mod_zip subrequests don't surface in normal log pipelines.

NOW PLAYING

Streaming ZIP Archives On the Fly With nginx + mod_zip: No Disk, No Buffers, No Problem

0:00 13:33

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

MG Show MG Show The MG Show, hosted by Jeffrey Pedersen and Shannon Townsend, is a leading alternative media platform dedicated to uncovering the truth behind today’s most pressing political issues. Launched in 2019, the show has grown exponentially, offering unfiltered insights, comprehensive research, and real-time analysis. With a commitment to independent journalism and factual integrity, the MG Show empowers its audience with knowledge and encourages active participation in the political discourse. That Hoarder: Overcome Compulsive Hoarding That Hoarder Hoarding disorder is stigmatised and people who hoard feel vast amounts of shame. This podcast began life as an audio diary, an anonymous outlet for somebody with this weird condition. That Hoarder speaks about her experiences living with compulsive hoarding, she interviews therapists, academics, researchers, children of hoarders, professional organisers and influencers, and she shares insight and tips for others with the problem. Listened to by people who hoard as well as those who love them and those who work with them, Overcome Compulsive Hoarding with That Hoarder aims to shatter the stigma, share the truth and speak openly and honestly to improve lives. Flottengeflüster ALD Automotive Österreich | LeasePlan Beim Flottengeflüster powered by ALD Automotive | LeasePlan präsentieren Jörg Janik und Peter Gutenbrunner alle zwei Wochen spannende Informationen rund um das Thema nachhaltige Mobilität. Beide beschäftigen sich schon lange mit der Thematik und bringen umfangreiches Fachwissen mit. Sollten sie aber doch einmal nicht weiter wissen, werden unsere Expert*innen hinzugezogen, die ihnen gerne mit Rat und Tat zur Seite stehen. The Small Business Startup School – Business Notes | Financial Literacy | Retail Psychology – For Professionals & Entrepreneurs The Small Business Startup School Inc. Starting or buying a small business? While personal circumstances may vary, business patterns remain timeless. On The Small Business Startup School, we explore strategies, insights, and practical solutions to help entrepreneurs confidently navigate their journey.Hosted by Ola Williams—a retail entrepreneur, fintech founder, and financial coach with over two decades of experience—this podcast marries financial awareness and retail psychology with optimism to deliver actionable takeaways.Join us to learn, grow, and connect as we uncover the keys to business success.Let’s continue to learn together and be encouraged to keep on connecting!

Frequently Asked Questions

How long is this episode of Programming Tech Brief By HackerNoon?

This episode is 13 minutes long.

When was this Programming Tech Brief By HackerNoon episode published?

This episode was published on June 1, 2026.

What is this episode about?

This story was originally published on HackerNoon at: https://hackernoon.com/streaming-zip-archives-on-the-fly-with-nginx-mod_zip-no-disk-no-buffers-no-problem. How we stream ZIP archives on the fly at scale using nginx +...

Can I download this Programming Tech Brief By HackerNoon episode?

Yes, you can download this episode by clicking the download button on the episode player, or subscribe to the podcast in your preferred podcast app for automatic downloads.
URL copied to clipboard!