I got tired of not understanding how vLLM works under the hood, so I built my own mini inference engine from scratch. (opens in new tab)

Contribute to prathamsingh404/TokenForge-GPU-Accelerated-LLM-Inference-Research-Platform development by creating an account on GitHub.