Nano-vLLM: How a vLLM-style inference engine works

269 points

by yz-yu

1 days ago

28 comments