Bug#786523: RFP: c-blosc -- an extremely fast, multi-threaded, meta-compressor library
Package: wnpp
Severity: wishlist
* Package name : c-blosc
Version : 1.4.4
Upstream Author : Francesc Alted <francesc@blosc.org>
* URL : https://github.com/Blosc/c-blosc
* License : expat
Programming Lang: C
Description : an extremely fast, multi-threaded, meta-compressor library
it allows you to compress – but especially – decompress your data, fast.
What Makes Blosc Different?
High performance compressor, optimized for binary data (but text is fine too).
Designed to transmit data to the processor cache faster than a memcpy() OS call. Achieving that will obviously depend on the dataset, but that is the goal.
Leverages SIMD (SSE2) and multi-threading capabilities present in modern multi-core processors.
APIs for C and Python.
It can use different, very fast compressors. Just write your code once and get access to an amazing range of compressors, like BloscLZ, LZ4, LZ4HC, Snappy or Zlib.
--
pytables currently uses a convienient copy, and openvdb could use this lib once available.
Reply to: