The archivers/mkz port

mkz-0.1.2 – reversible columnar pre-pass + zstd archiver

Description

mkz is a tar-style archiver whose backend is a reversible, schema-free
auto-columnar transform followed by zstd. It is not a new compressor: it is
a structural pre-pass that makes zstd measurably smaller on structured,
line-oriented data (logs, CSV, JSONL, telemetry) and is provably never worse
anywhere else: each block keeps whichever of raw-zstd or transformed-zstd
is smaller.

Both creating and extracting stream in constant memory (roughly one block,
independent of archive or member size), and every archive carries a SHA-256
of the reconstructed original, verified on extract, so corruption is always
detected and reported (streaming extraction is not yet atomic, so already-
written files may remain on failure).

This is the pure-C build: it depends only on libzstd (SHA-256 and base-95 are
vendored) and is byte-compatible with the reference implementation.

Categories:

archivers

Library dependencies

• archivers/zstd

Build dependencies

Run dependencies