What is an LLM gateway and what features should it provide?

Answer preview

LLM Gateway: Proxy between your apps and LLM providers — centralizes AI infrastructure concerns.…