Someone apparently managed to kind of replicate what V4.1 flash does on KV for fast prefill on Qwen
Someone apparently managed to kind of replicate what V4.1 flash does on KV for fast prefill on Qwen
Deep Dive
I wonder someone will figure out a way to do this with 27B? Throw Qwen3 on this page for demo https://kishida.github.io/webdemos/llkvapprox/ submitted by /u/T_rex2700 [link] [comments]