LangChain Launches LangSmith LLM Gateway in Public Beta With Cross-Model Spend and Rate Controls
LangChain has launched the LangSmith LLM Gateway in public beta, providing a single routing layer that connects developers to multiple model and provider endpoints. The tool allows teams to set spend and rate limits, configure fallback policies, and strip sensitive information or PII before inference requests are sent to external models.
The platform also integrates directly with coding agents and grants access to open-source models including Kimi K3, while offering cost controls that extend to end users. The beta launch makes the traffic management suite available for external testing and integration into commercial agent workflows.
From the sources (4 posts)
@hwchase17RT @LangChain: LangSmith LLM Gateway is now available in public beta. Set spend and rate limits, determine fallback policies, and redact s…
@hacubuRT @LangChain: LangSmith LLM Gateway is now available in public beta. Set spend and rate limits, determine fallback policies, and redact s…
@hwchase17LangSmith Gateway! - cost controls (including for your end users) - rate limiting - data/pii redaction - integrates with coding agents! - access to OSS models like kimi-k3!
@langchainLangSmith LLM Gateway is now available in public beta. Set spend and rate limits, determine fallback policies, and redact sensitive data before it reaches a model provider, all from one gateway that works across models and providers. Lear