2019-05-22 21:16:55 +00:00
|
|
|
[](https://travis-ci.org/valyala/gozstd)
|
|
|
|
|
[](http://godoc.org/github.com/valyala/gozstd)
|
|
|
|
|
[](https://goreportcard.com/report/github.com/valyala/gozstd)
|
|
|
|
|
[](https://codecov.io/gh/valyala/gozstd)
|
|
|
|
|
|
|
|
|
|
# gozstd - go wrapper for [zstd](http://facebook.github.io/zstd/)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
## Features
|
|
|
|
|
|
|
|
|
|
* Vendors upstream [zstd](https://github.com/facebook/zstd) without any modifications.
|
|
|
|
|
* [Simple API](https://godoc.org/github.com/valyala/gozstd).
|
|
|
|
|
* Optimized for speed. The API may be easily used in zero allocations mode.
|
|
|
|
|
* `Compress*` and `Decompress*` functions are optimized for high concurrency.
|
|
|
|
|
* Proper [Writer.Flush](https://godoc.org/github.com/valyala/gozstd#Writer.Flush)
|
|
|
|
|
for network apps.
|
|
|
|
|
* Supports the following features from upstream [zstd](https://facebook.github.io/zstd/):
|
|
|
|
|
* Block / stream compression / decompression with all the supported compression levels
|
|
|
|
|
and with dictionary support.
|
|
|
|
|
* [Dictionary](https://github.com/facebook/zstd#the-case-for-small-data-compression)
|
|
|
|
|
building from a sample set. The created dictionary may be saved to persistent storage /
|
|
|
|
|
transfered over the network.
|
|
|
|
|
* Dictionary loading for compression / decompression.
|
|
|
|
|
|
|
|
|
|
Pull requests for missing upstream `zstd` features are welcome.
|
|
|
|
|
|
|
|
|
|
## Quick start
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
### How to install `gozstd`?
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
go get -u github.com/valyala/gozstd
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
### How to compress data?
|
|
|
|
|
|
|
|
|
|
The easiest way is just to use [Compress](https://godoc.org/github.com/valyala/gozstd#Compress):
|
|
|
|
|
|
|
|
|
|
```go
|
|
|
|
|
compressedData := Compress(nil, data)
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
There is also [StreamCompress](https://godoc.org/github.com/valyala/gozstd#StreamCompress)
|
|
|
|
|
and [Writer](https://godoc.org/github.com/valyala/gozstd#Writer) for stream compression.
|
|
|
|
|
|
|
|
|
|
### How to decompress data?
|
|
|
|
|
|
|
|
|
|
The easiest way is just to use [Decompress](https://godoc.org/github.com/valyala/gozstd#Decompress):
|
|
|
|
|
|
|
|
|
|
```go
|
|
|
|
|
data, err := Decompress(nil, compressedData)
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
There is also [StreamDecompress](https://godoc.org/github.com/valyala/gozstd#StreamDecompress)
|
|
|
|
|
and [Reader](https://godoc.org/github.com/valyala/gozstd#Reader) for stream decompression.
|
|
|
|
|
|
|
|
|
|
|
2019-06-21 21:14:03 +00:00
|
|
|
### Who uses gozstd?
|
|
|
|
|
|
|
|
|
|
* [VictoriaMetrics](https://github.com/VictoriaMetrics/VictoriaMetrics)
|
|
|
|
|
|
|
|
|
|
|
2019-05-22 21:16:55 +00:00
|
|
|
## FAQ
|
|
|
|
|
|
|
|
|
|
* Q: _Which go version is supported?_
|
2019-06-21 21:14:03 +00:00
|
|
|
A: `go1.10` and newer. Pull requests for older go versions are accepted.
|
2019-05-22 21:16:55 +00:00
|
|
|
|
|
|
|
|
* Q: _Which platforms/architectures are supported?_
|
2019-06-21 21:14:03 +00:00
|
|
|
A: `linux/amd64`, `linux/arm`, `linux/arm64`, `darwin/amd64`, `windows/amd64`. Pull requests for other platforms/architectures
|
2019-05-22 21:16:55 +00:00
|
|
|
are accepted.
|
|
|
|
|
|
|
|
|
|
* Q: _I don't trust `libzstd*.a` binary files from the repo or these files dont't work on my OS/ARCH. How to rebuild them?_
|
|
|
|
|
A: Just run `make clean libzstd.a` if your OS/ARCH is supported.
|
|
|
|
|
|
|
|
|
|
* Q: _Why the repo contains `libzstd*.a` binary files?_
|
|
|
|
|
A: This simplifies package installation to usual `go get` without additional steps for building the `libzstd*.a`
|
