CRAfT: Constant-Round Non-Polynomial Approximation and P2P Network for Secure Transformer Inference (opens in new tab)

Transformer models have recently emerged as a game-changing technology for applications in content generation\. However, severe privacy concerns and the scalability bottlenecks of existing secure protocols limit their large-scale deployment\. To address these challenges, we present CRAfT, an innovative system designed for high-scalability and low-latency secure Transformer inference\. The core contributions of CRAfT are threefold: First, we propose a novel ciphertext packing strategy tailored...