Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Yes, there's a lot better compression available these days, but not everyone has the software installed to unpack them


> not everyone has the software installed to unpack them

People downloading 2 TB of compressed books in plain text format are not exactly the definition of "everyone".

> Yes, there's a lot better compression available these days

Tell me more!


zstd: https://github.com/facebook/zstd

Or any of the ones they benchmark against in their .README (lz4, snappy, zlib, etc.)


We practically need libgen-crystal to use this anyway, so just link zstd to libgen-crystal and now it's available.

* Also, this consideration did not prevent trying .tar.xz. I don't imagine .tar.xz is that much more available than .zstd.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: