Audience
Developers looking for a solution to deploy and manage AI workloads on GPUs
About NVIDIA Cloud Functions
NVIDIA Cloud Functions (NVCF) is a serverless API designed to deploy and manage AI workloads on GPUs, providing security, scalability, and reliability. It supports HTTP polling, HTTP streaming, and gRPC protocols for accessing workloads. Cloud Functions is primarily suited for shorter-running, preemptable workloads such as inferencing and fine-tuning. It supports two function types: "Container" and "Helm Chart", allowing users to define functions based on their specific requirements. Workloads are ephemeral and preemptable, so users should ensure they save their work appropriately. Models, containers, helm charts, and additional resources are hosted and pulled from the NGC Private Registry. To get started, users can follow the functions quickstart guide, which provides an end-to-end workflow for creating and deploying a container-based function using the fastapi_echo_sample container.
Other Popular Alternatives & Related Software
AWS Lambda
Run code without thinking about servers. Pay only for the compute time you consume. AWS Lambda lets you run code without provisioning or managing servers. You pay only for the compute time you consume. With Lambda, you can run code for virtually any type of application or backend service - all with zero administration. Just upload your code and Lambda takes care of everything required to run and scale your code with high availability. You can set up your code to automatically trigger from other AWS services or call it directly from any web or mobile app. AWS Lambda automatically runs your code without requiring you to provision or manage servers. Just write the code and upload it to Lambda. AWS Lambda automatically scales your application by running code in response to each trigger. Your code runs in parallel and processes each trigger individually, scaling precisely with the size of the workload.
Learn more
DigitalOcean
The simplest cloud platform for developers & teams. Deploy, manage, and scale cloud applications faster and more efficiently on DigitalOcean. DigitalOcean makes managing infrastructure easy for teams and businesses, whether you’re running one virtual machine or ten thousand. DigitalOcean App Platform: Build, deploy, and scale apps quickly using a simple, fully managed solution. We’ll handle the infrastructure, app runtimes and dependencies, so that you can push code to production in just a few clicks. Use a simple, intuitive, and visually rich experience to rapidly build, deploy, manage, and scale apps. Secure apps automatically. We create, manage and renew your SSL certificates and also protect your apps from DDoS attacks. Focus on what matters the most: building awesome apps. Let us handle provisioning and managing infrastructure, operating systems, databases, application runtimes, and other dependencies.
Learn more
Vercel
Vercel combines the best developer experience with an obsessive focus on end-user performance. Our platform enables frontend teams to do their best work. Developers love Next.js, the open source React framework Vercel built together with Google and Facebook. Next.js powers the biggest websites like Airbnb, Twilio, and Washington Post, for use cases in e-commerce, travel, news, and marketing. Vercel is the best place to deploy any frontend app. Start by deploying with zero configuration to our global edge network. Scale dynamically to millions of pages without breaking a sweat. Reliable live-editing experience for your UI components. Connect your pages to any data source, headless CMS, or API and make it work in everyone’s dev environment. From caching to Serverless Functions, all our cloud primitives work perfectly on localhost.
Learn more
JFrog Artifactory
The Industry Standard Universal Binary Repository Manager.
Supports all major package types (over 27 and growing) such as Maven, npm, Python, NuGet, Gradle, Go, and Helm including Kubernetes and Docker as well as integration with leading CI servers and DevOps tools that you already use.
Additional functionalities include:
- High Availability that scales to infinity with active/active clustering of your DevOps environment and scales as business grows
- On-Prem, Cloud, Hybrid, or Multi-Cloud Solution
- De Facto Kubernetes Registry managing application packages, operating system’s component dependencies, open source libraries, Docker containers, and Helm charts with full visibility of all dependencies. Compatible with a growing list of Kubernetes cluster providers.
Learn more
Company Information
NVIDIA
Founded: 1993
United States
docs.nvidia.com/cloud-functions/index.html
Videos and Screen Captures
Other Useful Business Software
Gen AI apps are built with MongoDB Atlas
MongoDB Atlas is the developer-friendly database used to build, scale, and run gen AI and LLM-powered apps—without needing a separate vector database. Atlas offers built-in vector search, global availability across 115+ regions, and flexible document modeling. Start building AI apps faster, all in one place.
Product Details
Platforms Supported
Cloud
Training
Documentation
Live Online
Webinars
In Person
Videos
Support
Phone Support
24/7 Live Support
Online