Local LLMs Need More Than OpenAI-Compatible Endpoints (opens in new tab)
Respawn is a stateful OpenAI Responses API gateway for local LLMs, adding stored responses, tools, streaming, files and observability to Ollama.
Read the original articleRespawn is a stateful OpenAI Responses API gateway for local LLMs, adding stored responses, tools, streaming, files and observability to Ollama.
Read the original article