How I squeezed a BERT sentiment analyzer into 1GB RAM on a $5 VPS

How to fit a transformer model into a low-memory VPS using Dynamic Quantization and ONNX Runtime.

View Post on Scour ↗

More from mohammedeabdelaziz.github.io on Scour.

Discussed on Hacker News