Kong AI Gateway Integrations

OpenAI’s mission is to ensure that artificial general intelligence (AGI)—by which we mean highly autonomous systems that outperform humans at most economically valuable work—benefits all of humanity. We will attempt to directly build safe and beneficial AGI, but will also consider our mission fulfilled if our work aids others to achieve this outcome. Apply our API to any language task — semantic search, summarization, sentiment analysis, content generation, translation, and more — with only a few examples or by specifying your task in English. One simple integration gives you access to our constantly-improving AI technology. Explore how you integrate with the API with these sample completions.

Claude is a next-generation AI assistant developed by Anthropic to help individuals and teams solve complex problems with safety, accuracy, and reliability at its core. It is designed to support a wide range of tasks, including writing, editing, coding, data analysis, and research. Claude allows users to create and iterate on documents, websites, graphics, and code directly within chat using collaborative tools like Artifacts. The platform supports file uploads, image analysis, and data visualization to enhance productivity and understanding. Claude is available across web, iOS, and Android, making it accessible wherever work happens. With built-in web search and extended reasoning capabilities, Claude helps users find information and think through challenging problems more effectively. Anthropic emphasizes security, privacy, and responsible AI development to ensure Claude can be trusted in professional and personal workflows.

Gemini is Google’s advanced AI assistant designed to help users think, create, learn, and complete tasks with a new level of intelligence. Powered by Google’s most capable models, including Gemini 3, it enables users to ask complex questions, generate content, analyze information, and explore ideas through natural conversation. Gemini can create images, videos, summaries, study plans, and first drafts while also providing feedback on uploaded files and written work. The platform is grounded in Google Search, allowing it to deliver accurate, up-to-date information and support deep follow-up questions. Gemini connects seamlessly with Google apps like Gmail, Docs, Calendar, Maps, YouTube, and Photos to help users complete tasks without switching tools. Features such as Gemini Live, Deep Research, and Gems enhance brainstorming, research, and personalized workflows. Available through flexible free and paid plans, Gemini supports everyday users, students, and professionals across devices.

Mistral AI is a pioneering artificial intelligence startup specializing in open-source generative AI. The company offers a range of customizable, enterprise-grade AI solutions deployable across various platforms, including on-premises, cloud, edge, and devices. Flagship products include "Le Chat," a multilingual AI assistant designed to enhance productivity in both personal and professional contexts, and "La Plateforme," a developer platform that enables the creation and deployment of AI-powered applications. Committed to transparency and innovation, Mistral AI positions itself as a leading independent AI lab, contributing significantly to open-source AI and policy development.

Cohere is an enterprise AI platform that enables developers and businesses to build powerful language-based applications. Specializing in large language models (LLMs), Cohere provides solutions for text generation, summarization, and semantic search. Their model offerings include the Command family for high-performance language tasks and Aya Expanse for multilingual applications across 23 languages. Focused on security and customization, Cohere allows flexible deployment across major cloud providers, private cloud environments, or on-premises setups to meet diverse enterprise needs. The company collaborates with industry leaders like Oracle and Salesforce to integrate generative AI into business applications, improving automation and customer engagement. Additionally, Cohere For AI, their research lab, advances machine learning through open-source projects and a global research community.

Confidently evaluate, test, and ship LLM applications with a suite of observability tools to calibrate language model outputs across your dev and production lifecycle. Log traces and spans, define and compute evaluation metrics, score LLM outputs, compare performance across app versions, and more. Record, sort, search, and understand each step your LLM app takes to generate a response. Manually annotate, view, and compare LLM responses in a user-friendly table. Log traces during development and in production. Run experiments with different prompts and evaluate against a test set. Choose and run pre-configured evaluation metrics or define your own with our convenient SDK library. Consult built-in LLM judges for complex issues like hallucination detection, factuality, and moderation. Establish reliable performance baselines with Opik's LLM unit tests, built on PyTest. Build comprehensive test suites to evaluate your entire LLM pipeline on every deployment.

Weaviate is an open-source vector database. It allows you to store data objects and vector embeddings from your favorite ML-models, and scale seamlessly into billions of data objects. Whether you bring your own vectors or use one of the vectorization modules, you can index billions of data objects to search through. Combine multiple search techniques, such as keyword-based and vector search, to provide state-of-the-art search experiences. Improve your search results by piping them through LLM models like GPT-3 to create next-gen search experiences. Beyond search, Weaviate's next-gen vector database can power a wide range of innovative apps. Perform lightning-fast pure vector similarity search over raw vectors or data objects, even with filters. Combine keyword-based search with vector search techniques for state-of-the-art results. Use any generative model in combination with your data, for example to do Q&A over your dataset.

Vespa is forBig Data + AI, online. At any scale, with unbeatable performance. To build production-worthy online applications that combine data and AI, you need more than point solutions: You need a platform that integrates data and compute to achieve true scalability and availability - and which does this without limiting your freedom to innovate. Only Vespa does this. Vespa is a fully featured search engine and vector database. It supports vector search (ANN), lexical search, and search in structured data, all in the same query. Users can easily build recommendation applications on Vespa. Integrated machine-learned model inference allows you to apply AI to make sense of your data in real-time. Together with Vespa's proven scaling and high availability, this empowers you to create production-ready search applications at any scale and with any combination of features.

Kong Konnect Enterprise Service Connectivity Platform brokers an organization’s information across all services. Built on top of Kong’s battle-tested core, Kong Konnect Enterprise enables customers to simplify management of APIs and microservices across hybrid-cloud and multi-cloud deployments. With Kong Konnect Enterprise, customers can proactively identify anomalies and threats, automate tasks, and improve visibility across their entire organization. Stop managing your applications and services, and start owning them with the Kong Konnect Enterprise Service Connectivity Platform. Kong Konnect Enterprise provides the industry’s lowest latency and highest scalability to ensure your services always perform at their best. Kong Konnect has a lightweight, open source core that allows you to optimize performance across all your services, no matter where they run.

Enterprise search, observability, and security for the cloud. Quickly and easily find information, gain insights, and protect your technology investment whether you run on Amazon Web Services, Google Cloud, or Microsoft Azure. We handle the maintenance and upkeep, so you can focus on gaining the insights that help you run your business. Configuration and deployment are a breeze. Simple scaling, custom plugins, and architecture optimized for log and time series data are only a taste of what’s possible. Get the complete Elastic experience with features like machine learning, Canvas, APM, index lifecycle management, Elastic App Search, Elastic Workplace Search, and more — exclusively available here. Logging and metrics are just the start. Bring your diverse data together to address security, observability, and other critical use cases.

Vertex AI Notebooks is a fully managed, scalable solution from Google Cloud that accelerates machine learning (ML) development. It provides a seamless, interactive environment for data scientists and developers to explore data, prototype models, and collaborate in real-time. With integration into Google Cloud’s vast data and ML tools, Vertex AI Notebooks supports rapid prototyping, automated workflows, and deployment, making it easier to scale ML operations. The platform’s support for both Colab Enterprise and Vertex AI Workbench ensures a flexible and secure environment for diverse enterprise needs.

Gemini Enterprise is a comprehensive AI platform built by Google Cloud designed to bring the full power of Google’s advanced AI models, agent-creation tools, and enterprise-grade data access into everyday workflows. The solution offers a unified chat interface that lets employees interact with internal documents, applications, data sources, and custom AI agents. At its core, Gemini Enterprise comprises six key components: the Gemini family of large multimodal models, an agent orchestration workbench (formerly Google Agentspace), pre-built starter agents, robust data-integration connectors to business systems, extensive security and governance controls, and a partner ecosystem for tailored integrations. It is engineered to scale across departments and enterprises, enabling users to build no-code or low-code agents that automate tasks, such as research synthesis, customer support response, code assist, contract analysis, and more, while operating within corporate compliance standards.

We are an intelligent HelpDesk, we will optimize management processes, increase the productivity of your team and increase the efficiency of your support. Offer more possibilities to your customers, opening tickets from different devices. Have more flexibility to configure your customers' SLA in a unique, simple and direct way. Use the mobile app of the inventory management system and ensure the good management of IT assets, through the monitoring and total control of the entire equipment park of your customers wherever and whenever you want. Increase the productivity of your technical support team with intelligent and automated inventory control , see some of the resources. Optimize your management and relationship with your customers! Get alerts of key machine features on your dashboard. Workflow, automation and ticket triggers. Password Vault, satisfaction survey, ticket scheduling, follow customer, service catalog, follow ticket, ticket conference, advanced dashboard.

The AI Knowledge Platform. The Pinecone Database, Inference, and Assistant make building high-performance vector search apps easy. Developer-friendly, fully managed, and easily scalable without infrastructure hassles. Once you have vector embeddings, manage and search through them in Pinecone to power semantic search, recommenders, and other applications that rely on relevant information retrieval. Ultra-low query latency, even with billions of items. Give users a great experience. Live index updates when you add, edit, or delete data. Your data is ready right away. Combine vector search with metadata filters for more relevant and faster results. Launch, use, and scale your vector search service with our easy API, without worrying about infrastructure or algorithms. We'll keep it running smoothly and securely.

Qdrant is a vector similarity engine & vector database. It deploys as an API service providing search for the nearest high-dimensional vectors. With Qdrant, embeddings or neural network encoders can be turned into full-fledged applications for matching, searching, recommending, and much more! Provides the OpenAPI v3 specification to generate a client library in almost any programming language. Alternatively utilise ready-made client for Python or other programming languages with additional functionality. Implement a unique custom modification of the HNSW algorithm for Approximate Nearest Neighbor Search. Search with a State-of-the-Art speed and apply search filters without compromising on results. Support additional payload associated with vectors. Not only stores payload but also allows filter results based on payload values.

Amazon Bedrock is a fully managed service that simplifies building and scaling generative AI applications by providing access to a variety of high-performing foundation models (FMs) from leading AI companies such as AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, and Amazon itself. Through a single API, developers can experiment with these models, customize them using techniques like fine-tuning and Retrieval Augmented Generation (RAG), and create agents that interact with enterprise systems and data sources. As a serverless platform, Amazon Bedrock eliminates the need for infrastructure management, allowing seamless integration of generative AI capabilities into applications with a focus on security, privacy, and responsible AI practices.

Microsoft Foundry Agent Service is a secure, enterprise-ready platform for designing, deploying, and orchestrating AI agents at scale. It gives teams a streamlined interface and toolset to automate complex workflows using multi-agent systems. Developers can build with hosted agents, custom code, or agent frameworks while taking advantage of Azure’s reliability, scalability, and integrated observability. Built-in tools, enterprise connectors, and Model Context Protocol support make it easy for agents to interact with business systems and organizational data. Security, access governance, and compliance are embedded throughout, allowing companies to maintain full control while deploying intelligent automation across critical processes. With one-click deployment to Microsoft 365 experiences, Foundry Agent Service accelerates how organizations operationalize AI in everyday work.

Llama (Large Language Model Meta AI) is a state-of-the-art foundational large language model designed to help researchers advance their work in this subfield of AI. Smaller, more performant models such as Llama enable others in the research community who don’t have access to large amounts of infrastructure to study these models, further democratizing access in this important, fast-changing field. Training smaller foundation models like Llama is desirable in the large language model space because it requires far less computing power and resources to test new approaches, validate others’ work, and explore new use cases. Foundation models train on a large set of unlabeled data, which makes them ideal for fine-tuning for a variety of tasks. We are making Llama available at several sizes (7B, 13B, 33B, and 65B parameters) and also sharing a Llama model card that details how we built the model in keeping with our approach to Responsible AI practices.