GateGPT: 56k tokens per second Transformer (KV cache) on FPGA at 80 MHz

27 points

by laxmena

1 hours ago

8 comments