Ask HN: How to store KV cache efficiently on disk?

If I have a lot of precomputed KV cache values (basically just tensors), how do I store them efficiently on disk? Ideally, I would want to lookup their values by prefix quickly as well.

Comments URL: https://news.ycombinator.com/item?id=43366877

Points: 1

# Comments: 0