Edge Inference

MicroGPT Hits 50K tps on FPGA: On-Chip Weights Signal Edge AI Hardware Shift

Karpathy's MicroGPT deployed on FPGA hits 50K tps by storing weights in on-chip ROM instead of external memory. This proves edge AI inference is bottl