Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
SQLite Transparent Compression (github.com/phiresky)
5 points by edweis on Sept 17, 2024 | hide | past | favorite | 2 comments


I used this to index and store a subset of Wikipedia's archive and it works great.


Note: We've crossed paths on another thread (Reddit?).

I have an experiment going (as part of a talk) of how compressed of a sqlite database I can get all of English Wikipedia with full-text search.

So far, the smallest with full articles and titles is 28 GiB.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: