RouteLLMLMSYS
|
||||||
Related Products
|
||||||
About
NeuralTrust is the leading platform for securing and scaling LLM applications and agents. It provides the fastest open-source AI gateway in the market for zero-trust security and seamless tool connectivity, along with automated red teaming to detect vulnerabilities and hallucinations before they become a risk.
Key Features:
- TrustGate: The fastest open-source AI gateway, enabling enterprises to scale LLMs and agents with zero-trust security, advanced traffic management, and seamless app integration.
- TrustTest: A comprehensive adversarial and functional testing framework that detects vulnerabilities, jailbreaks, and hallucinations, ensuring LLM security and reliability.
- TrustLens: A real-time AI observability and monitoring tool that provides deep insights and analytics into LLM behavior.
|
About
Developed by LM-SYS, RouteLLM is an open-source toolkit that allows users to route tasks between different large language models to improve efficiency and manage resources. It supports strategy-based routing, helping developers balance speed, accuracy, and cost by selecting the best model for each input dynamically.
|
|||||
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
|||||
Audience
ML Engineers, Security Engineers, Software Engineers
|
Audience
AI developers and researchers looking to optimize workflows using multiple LLMs through intelligent routing and performance-aware model selection
|
|||||
Support
Phone Support
24/7 Live Support
Online
|
Support
Phone Support
24/7 Live Support
Online
|
|||||
API
Offers API
|
API
Offers API
|
|||||
Screenshots and VideosNo images available
|
Screenshots and Videos |
|||||
Pricing
$0
Free Version
Free Trial
|
Pricing
No information available.
Free Version
Free Trial
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Webinars
Live Online
In Person
|
Training
Documentation
Webinars
Live Online
In Person
|
|||||
Company InformationNeuralTrust
Founded: 2024
Spain
neuraltrust.ai/
|
Company InformationLMSYS
github.com/lm-sys/RouteLLM
|
|||||
Alternatives |
Alternatives |
|||||
|
|
||||||
Categories |
Categories |
|||||
Integrations
Amazon Bedrock
Anyscale
Chatbot Arena
Claude
GPT-4
Gemini
Gemini Enterprise
GitHub
Mixtral 8x7B
Ollama
|
Integrations
Amazon Bedrock
Anyscale
Chatbot Arena
Claude
GPT-4
Gemini
Gemini Enterprise
GitHub
Mixtral 8x7B
Ollama
|
|||||
|
|
|