Covers QuantumNous/new-api: AI模型聚合管理中转分发系统，一个应用管理您的所有AI模型，支持将多种大模型转为统一格式调用，支持OpenAI、Claude、Gemini等格式，可供个人或者企业内部管理与分发渠道使用。🍥 The next-generation LLM gateway and AI asset management system supports multiple languages.Discussed on DEV

I've been shipping AI features for the past year. Last month I hit a wall — my API bill crossed $300 and I had no idea where it was going. So I did what any developer would: I built a cost tracker. Here's what 30 days of data taught me. The Setup I built a lightweight middleware that logged every API call: model used, token count, cost, and task type. # Cost-tracking middleware for OpenAI-compatible APIs class CostTracker: def __init__(self): self.records = [] def log(self, model, prompt_toke...

Read the original article