Apply video compression on KV cache to 10,000x less error at Q4 quant

 (github.com)

16 points | by polymorph1sm 6 hours ago

0 comments