Kubeflow Integrations

Kubernetes (K8s) is an open-source system for automating deployment, scaling, and management of containerized applications. It groups containers that make up an application into logical units for easy management and discovery. Kubernetes builds upon 15 years of experience of running production workloads at Google, combined with best-of-breed ideas and practices from the community. Designed on the same principles that allows Google to run billions of containers a week, Kubernetes can scale without increasing your ops team. Whether testing locally or running a global enterprise, Kubernetes flexibility grows with you to deliver your applications consistently and easily no matter how complex your need is. Kubernetes is open source giving you the freedom to take advantage of on-premises, hybrid, or public cloud infrastructure, letting you effortlessly move workloads to where it matters to you.

Union.ai is an award-winning, Flyte-based data and ML orchestrator for scalable, reproducible ML pipelines. With Union.ai, you can write your code locally and easily deploy pipelines to remote Kubernetes clusters. “Flyte’s scalability, data lineage, and caching capabilities enable us to train hundreds of models on petabytes of geospatial data, giving us an edge in our business.” — Arno, CTO at Blackshark.ai “With Flyte, we want to give the power back to biologists. We want to stand up something that they can play around with different parameters for their models because not every … parameter is fixed. We want to make sure we are giving them the power to run the analyses.” — Krishna Yeramsetty, Principal Data Scientist at Infinome “Flyte plays a vital role as a key component of Gojek's ML Platform by providing exactly that." — Pradithya Aria Pura, Principal Engineer at Goj

Camunda enables organizations to orchestrate and automate processes across people, systems, and devices to continuously overcome complexity, increase efficiency, and fully operationalize AI. Built for business and IT users, Camunda’s leading orchestration and automation platform executes any process at the required speed and scale to remain competitive without compromising security and governance. Over 700 companies across all industries, including Atlassian, ING, and Vodafone trust Camunda with the design, orchestration, automation, and improvement of their business-critical processes to accelerate digital transformation. To learn more visit camunda.com.

Highly scalable and standards-based model inference platform on Kubernetes for trusted AI. KServe is a standard model inference platform on Kubernetes, built for highly scalable use cases. Provides performant, standardized inference protocol across ML frameworks. Support modern serverless inference workload with autoscaling including a scale to zero on GPU. Provides high scalability, density packing, and intelligent routing using ModelMesh. Simple and pluggable production serving for production ML serving including prediction, pre/post-processing, monitoring, and explainability. Advanced deployments with the canary rollout, experiments, ensembles, and transformers. ModelMesh is designed for high-scale, high-density, and frequently-changing model use cases. ModelMesh intelligently loads and unloads AI models to and from memory to strike an intelligent trade-off between responsiveness to users and computational footprint.

The workflow automation platform for complex, mission-critical data and ML processes at scale. Flyte makes it easy to create concurrent, scalable, and maintainable workflows for machine learning and data processing. Flyte is used in production at Lyft, Spotify, Freenome, and others. At Lyft, Flyte has been serving production model training and data processing for over four years, becoming the de-facto platform for teams like pricing, locations, ETA, mapping, autonomous, and more. In fact, Flyte manages over 10,000 unique workflows at Lyft, totaling over 1,000,000 executions every month, 20 million tasks, and 40 million containers. Flyte has been battle-tested at Lyft, Spotify, Freenome, and others. It is entirely open-source with an Apache 2.0 license under the Linux Foundation with a cross-industry overseeing committee. Configuring machine learning and data workflows can get complex and error-prone with YAML.

Vertex AI Notebooks is a fully managed, scalable solution from Google Cloud that accelerates machine learning (ML) development. It provides a seamless, interactive environment for data scientists and developers to explore data, prototype models, and collaborate in real-time. With integration into Google Cloud’s vast data and ML tools, Vertex AI Notebooks supports rapid prototyping, automated workflows, and deployment, making it easier to scale ML operations. The platform’s support for both Colab Enterprise and Vertex AI Workbench ensures a flexible and secure environment for diverse enterprise needs.

Giskard provides interfaces for AI & Business teams to evaluate and test ML models through automated tests and collaborative feedback from all stakeholders. Giskard speeds up teamwork to validate ML models and gives you peace of mind to eliminate risks of regression, drift, and bias before deploying ML models to production.

Get in minutes what used to take years to build. Simple, customizable, scalable, secure, ML monitoring. Everything you need to deploy, maintain and improve ML in production. Superwise is an open platform that integrates with any ML stack and connects to your choice of communication tools. Want to take it further? Superwise is API-first and everything (and we mean everything) is accessible via our APIs. All from the comfort of the cloud of your choice. When it comes to ML monitoring you have full self-service control over everything. Configure metrics and policies through our APIs and SDK or simply select a monitoring template and set the sensitivity, conditions, and alert channels of your choice. Try Superwise out or contact us to learn more. Easily create alerts with Superwise’s ML monitoring policy templates and builder. Select from dozens of pre-build monitors ranging from data drift to equal opportunity, or customize policies to incorporate your domain expertise.

Simplify your MLOps pipelines. Manage, deploy, and scale on any infrastructure with ZenML. ZenML is completely free and open-source. See the magic with just two simple commands. Set up ZenML in a matter of minutes, and start with all the tools you already use. ZenML standard interfaces ensure that your tools work together seamlessly. Gradually scale up your MLOps stack by switching out components whenever your training or deployment requirements change. Keep up with the latest changes in the MLOps world and easily integrate any new developments. Define simple and clear ML workflows without wasting time on boilerplate tooling or infrastructure code. Write portable ML code and switch from experimentation to production in seconds. Manage all your favorite MLOps tools in one place with ZenML's plug-and-play integrations. Prevent vendor lock-in by writing extensible, tooling-agnostic, and infrastructure-agnostic code.

Kedro is the foundation for clean data science code. It borrows concepts from software engineering and applies them to machine-learning projects. A Kedro project provides scaffolding for complex data and machine-learning pipelines. You spend less time on tedious "plumbing" and focus instead on solving new problems. Kedro standardizes how data science code is created and ensures teams collaborate to solve problems easily. Make a seamless transition from development to production with exploratory code that you can transition to reproducible, maintainable, and modular experiments. A series of lightweight data connectors is used to save and load data across many different file formats and file systems.

D2iQ Enterprise Kubernetes Platform (DKP) Run Kubernetes Workloads at Scale DKP includes everything you need to ease Kubernetes adoption, expand Kubernetes use, and enable advanced workloads across any infrastructure, whether on-prem, on the cloud, in air-gapped environments, or at the edge. Built to Solve the Toughest Enterprise Kubernetes Challenges Created to accelerate the journey to production at scale, DKP provides a single, centralized point of control to build, run, and manage applications across any infrastructure. Enable Day 2 Readiness Out-of-the-Box Without Lock-In DKP takes care of the heavy lifting by providing a comprehensive, enterprise-grade Kubernetes distribution and a full stack of CNCF-certified Day 2 platform applications that are integrated, automated, and tested at scale for an out-of-the-box, production-ready experience.

CometLLM is a tool to log and visualize your LLM prompts and chains. Use CometLLM to identify effective prompt strategies, streamline your troubleshooting, and ensure reproducible workflows. Log your prompts and responses, including prompt template, variables, timestamps and duration, and any metadata that you need. Visualize your prompts and responses in the UI. Log your chain execution down to the level of granularity that you need. Visualize your chain execution in the UI. Automatically tracks your prompts when using the OpenAI chat models. Track and analyze user feedback. Diff your prompts and chain execution in the UI. Comet LLM Projects have been designed to support you in performing smart analysis of your logged prompt engineering workflows. Each column header corresponds to a metadata attribute logged in the LLM project, so the exact list of the displayed default headers can vary across projects.

DagsHub is a collaborative platform designed for data scientists and machine learning engineers to manage and streamline their projects. It integrates code, data, experiments, and models into a unified environment, facilitating efficient project management and team collaboration. Key features include dataset management, experiment tracking, model registry, and data and model lineage, all accessible through a user-friendly interface. DagsHub supports seamless integration with popular MLOps tools, allowing users to leverage their existing workflows. By providing a centralized hub for all project components, DagsHub enhances transparency, reproducibility, and efficiency in machine learning development. DagsHub is a platform for AI and ML developers that lets you manage and collaborate on your data, models, and experiments, alongside your code. DagsHub was particularly designed for unstructured data for example text, images, audio, medical imaging, and binary files.

Civo is a cloud-native platform designed to simplify cloud computing for developers and businesses, offering fast, predictable, and scalable infrastructure. It provides managed Kubernetes clusters with industry-leading launch times of around 90 seconds, enabling users to deploy and scale applications efficiently. Civo’s offering includes enterprise-class compute instances, managed databases, object storage, load balancers, and cloud GPUs powered by NVIDIA A100 for AI and machine learning workloads. Their billing model is transparent and usage-based, allowing customers to pay only for the resources they consume with no hidden fees. Civo also emphasizes sustainability with carbon-neutral GPU options. The platform is trusted by industry-leading companies and offers a robust developer experience through easy-to-use dashboards, APIs, and educational resources.

Make your Kubernetes autoscaling proactivе. From reactive scaling to proactive, with PredictKube, you’ll be able to finish autoscaling before the load rise thanks to predictions made by our AI model. Our AI model can start working with the data for 2 weeks to provide you with reliable prediction and autoscaling. The predictive Keda scaler named PredictKube helps you to minimize time-wasting on manual setup of autoscaling and gives you an automated performance. We made our KEDA scaler out of the top-notch technologies available for Kubernetes and AI. Input the data for 1+ week and get proactive autoscaling up to 6 hours horizon based on AI prediction. The right time for scaling is selected by our trained AI model that analyzes your historical data and can utilize the data of custom and public business metrics that can affect the traffic load. We’ll support free access to API in general with all basic features available to provide autoscaling possibilities.

The Robust Intelligence Platform integrates seamlessly into your ML lifecycle to eliminate model failures. The platform detects your model’s vulnerabilities, prevents aberrant data from entering your AI system, and detects statistical data issues like drift. At the core of our test-based approach is a single test. Each test measures your model’s robustness to a specific type of production model failure. Stress Testing runs hundreds of these tests to measure model production readiness. The results of these tests are used to auto-configure a custom AI Firewall that protects the model against the specific forms of failure to which a given model is susceptible. Finally, Continuous Testing runs these tests during production, providing automated root cause analysis informed by the underlying cause of any single test failure. Using all three elements of the Robust Intelligence platform together helps ensure ML Integrity.

Data is used in every aspect of a processing plant or facility, it is underlying most operational processes, most business decisions, and most environmental events. Failures are often attributed to this same data, in terms of operator error, bad sensors, safety or environmental events, or poor analytics. This is where APERIO can alleviate these problems. Data integrity is a key element of Industry 4.0; the foundation upon which more advanced applications, such as predictive models, process optimization, and custom AI tools are developed. APERIO DataWise is the industry-leading provider of reliable, trusted data. Automate the quality of your PI data or digital twins continuously and at scale. Ensure validated data across the enterprise to improve asset reliability. Empower the operator to make better decisions. Detect threats made to operational data to ensure operational resilience. Accurately monitor & report sustainability metrics.

Azure Marketplace is a comprehensive online store that provides access to thousands of certified, ready-to-use software applications, services, and solutions from Microsoft and third-party vendors. It enables businesses to discover, purchase, and deploy software directly within the Azure cloud environment. The marketplace offers a wide range of products, including virtual machine images, AI and machine learning models, developer tools, security solutions, and industry-specific applications. With flexible pricing options like pay-as-you-go, free trials, and subscription models, Azure Marketplace simplifies the procurement process and centralizes billing through a single Azure invoice. It supports seamless integration with Azure services, enabling organizations to enhance their cloud infrastructure, streamline workflows, and accelerate digital transformation initiatives.

Unremot is a go-to place for anyone aspiring to build an AI product - with 120+ pre-built APIs, you can build and launch AI products 2X faster, at 1/3rd cost. Even, some of the most complicated AI product APIs take less than a few minutes to deploy and launch, with minimal code or even no-code. Choose an AI API that you want to integrate to your product from 120+ APIs we have on Unremot. Provide your API private key to authenticate Unremot to access the API. Use unremot unique URL to connect the product API - the whole process takes only minutes, instead of days and weeks.