Kong AI GatewayKong Inc.
|
RouteLLMLMSYS
|
|||||
Related Products
|
||||||
About
Kong AI Gateway is a semantic AI gateway designed to run and secure Large Language Model (LLM) traffic, enabling faster adoption of Generative AI (GenAI) through new semantic AI plugins for Kong Gateway. It allows users to easily integrate, secure, and monitor popular LLMs. The gateway enhances AI requests with semantic caching and security features, introducing advanced prompt engineering for compliance and governance. Developers can power existing AI applications written using SDKs or AI frameworks by simply changing one line of code, simplifying migration. Kong AI Gateway also offers no-code AI integrations, allowing users to transform, enrich, and augment API responses without writing code, using declarative configuration. It implements advanced prompt security by determining allowed behaviors and enables the creation of better prompts with AI templates compatible with the OpenAI interface.
|
About
Developed by LM-SYS, RouteLLM is an open-source toolkit that allows users to route tasks between different large language models to improve efficiency and manage resources. It supports strategy-based routing, helping developers balance speed, accuracy, and cost by selecting the best model for each input dynamically.
|
|||||
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
|||||
Audience
Organizations interested in a solution to integrate multiple LLMs into their applications, ensuring compliance
|
Audience
AI developers and researchers looking to optimize workflows using multiple LLMs through intelligent routing and performance-aware model selection
|
|||||
Support
Phone Support
24/7 Live Support
Online
|
Support
Phone Support
24/7 Live Support
Online
|
|||||
API
Offers API
|
API
Offers API
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
No information available.
Free Version
Free Trial
|
Pricing
No information available.
Free Version
Free Trial
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Webinars
Live Online
In Person
|
Training
Documentation
Webinars
Live Online
In Person
|
|||||
Company InformationKong Inc.
Founded: 2017
United States
konghq.com/products/kong-ai-gateway
|
Company InformationLMSYS
github.com/lm-sys/RouteLLM
|
|||||
Alternatives |
Alternatives |
|||||
|
|
||||||
|
|
||||||
Categories |
Categories |
|||||
Integrations
Amazon Bedrock
Claude
Gemini
Gemini Enterprise
OpenAI
Anyscale
Chatbot Arena
Cohere
GPT-4
GitHub
|
Integrations
Amazon Bedrock
Claude
Gemini
Gemini Enterprise
OpenAI
Anyscale
Chatbot Arena
Cohere
GPT-4
GitHub
|
|||||
|
|
|