EPISODE · Dec 3, 2018 · 47 MIN
#81: FPGA-Based ZLIB/GZIP Compression Engine as an NVMe Namespace
from Storage Developer Conference · host Stephen Bates, Chief Technology Officer, Eidetic
Today’s exponential growth of Big-Data makes lossless compression one of the most important operations in a data center as it expands storage capacity, reduces storage costs and speeds up data access. Off-loading compression from processors to FPGAs can free up valuable CPU time while reducing compression time and power consumption. Moreover, sharing accelerators across a data center can further improve resource utilization and lower operation costs. Here, we present an efficient FPGA implementation of a GZIP/ZLIB accelerator which can compress the data at up to 1.7GB/s using about 30KLUTs on a Virtex-7 device. This accelerator is presented as an NVMe namespace via the Eideticom NoLoad platform which allows users to access it locally or across the network using standard NVMe and NVMe over Fabrics drivers available in major operating systems. We also present the software API to access this accelerator which relies on the high-performance inbox NVMe drivers and uses a user-space framework to provide both local and remote access to this accelerator.
What this episode covers
Today’s exponential growth of Big-Data makes lossless compression one of the most important operations in a data center as it expands storage capacity, reduces storage costs and speeds up data access. Off-loading compression from processors to FPGAs can free up valuable CPU time while reducing compression time and power consumption. Moreover, sharing accelerators across a data center can further improve resource utilization and lower operation costs. Here, we present an efficient FPGA implementation of a GZIP/ZLIB accelerator which can compress the data at up to 1.7GB/s using about 30KLUTs on a Virtex-7 device. This accelerator is presented as an NVMe namespace via the Eideticom NoLoad platform which allows users to access it locally or across the network using standard NVMe and NVMe over Fabrics drivers available in major operating systems. We also present the software API to access this accelerator which relies on the high-performance inbox NVMe drivers and uses a user-space framework to provide both local and remote access to this accelerator.
NOW PLAYING
#81: FPGA-Based ZLIB/GZIP Compression Engine as an NVMe Namespace
No transcript for this episode yet
Similar Episodes
No similar episodes found.