PortkeyPortkey.ai
|
RouteLLMLMSYS
|
|||||
Related Products
|
||||||
About
Launch production-ready apps with the LMOps stack for monitoring, model management, and more. Replace your OpenAI or other provider APIs with the Portkey endpoint.
Manage prompts, engines, parameters, and versions in Portkey. Switch, test, and upgrade models with confidence!
View your app performance & user level aggregate metics to optimise usage and API costs
Keep your user data secure from attacks and inadvertent exposure. Get proactive alerts when things go bad.
A/B test your models in the real world and deploy the best performers.
We built apps on top of LLM APIs for the past 2 and a half years and realised that while building a PoC took a weekend, taking it to production & managing it was a pain!
We're building Portkey to help you succeed in deploying large language models APIs in your applications.
Regardless of you trying Portkey, we're always happy to help!
|
About
Developed by LM-SYS, RouteLLM is an open-source toolkit that allows users to route tasks between different large language models to improve efficiency and manage resources. It supports strategy-based routing, helping developers balance speed, accuracy, and cost by selecting the best model for each input dynamically.
|
|||||
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
|||||
Audience
Developers that want to ship ambitious generative AI applications
|
Audience
AI developers and researchers looking to optimize workflows using multiple LLMs through intelligent routing and performance-aware model selection
|
|||||
Support
Phone Support
24/7 Live Support
Online
|
Support
Phone Support
24/7 Live Support
Online
|
|||||
API
Offers API
|
API
Offers API
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
$49 per month
Free Version
Free Trial
|
Pricing
No information available.
Free Version
Free Trial
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Webinars
Live Online
In Person
|
Training
Documentation
Webinars
Live Online
In Person
|
|||||
Company InformationPortkey.ai
Founded: 2023
portkey.ai/
|
Company InformationLMSYS
github.com/lm-sys/RouteLLM
|
|||||
Alternatives |
Alternatives |
|||||
Categories |
Categories |
|||||
Integrations
Amazon Bedrock
Claude
Mixtral 8x7B
OpenAI
Anyscale
Azure OpenAI Service
Chatbot Arena
GPT-4
Gemini
Gemini Enterprise
|
Integrations
Amazon Bedrock
Claude
Mixtral 8x7B
OpenAI
Anyscale
Azure OpenAI Service
Chatbot Arena
GPT-4
Gemini
Gemini Enterprise
|
|||||
|
|
|