- Bloom filters for queries ('needle in haystack' problem)
- Native OpenTelemetry support
- Updated helm charts
- Lambda/Promtail support dropping labels
- Docs improvements
Personally, I'm thrilled that the problem with high-cardinality labels will [hopefully] get addressed after 6 years (that's the top item, with bloom filters).
The architecture Loki has chosen is great for keeping costs down and using simple blob-storage (S3) for data. However, it makes it hard to quickly query unique keys such as trace IDs or user IDs. But bloom filters will hopefully will do the job.
I raised the needle in haystack problem back in 2018, so it's great to see this landing:
The architecture Loki has chosen is great for keeping costs down and using simple blob-storage (S3) for data. However, it makes it hard to quickly query unique keys such as trace IDs or user IDs. But bloom filters will hopefully will do the job.
I raised the needle in haystack problem back in 2018, so it's great to see this landing:
https://github.com/grafana/loki/issues/91
For anyone that's curious, bloom filters is a clever technique:
https://en.wikipedia.org/wiki/Bloom_filter