NVIDIA TensorRTNVIDIA
|
||||||
Related Products
|
||||||
About
NVIDIA TensorRT is an ecosystem of APIs for high-performance deep learning inference, encompassing an inference runtime and model optimizations that deliver low latency and high throughput for production applications. Built on the CUDA parallel programming model, TensorRT optimizes neural network models trained on all major frameworks, calibrating them for lower precision with high accuracy, and deploying them across hyperscale data centers, workstations, laptops, and edge devices. It employs techniques such as quantization, layer and tensor fusion, and kernel tuning on all types of NVIDIA GPUs, from edge devices to PCs to data centers. The ecosystem includes TensorRT-LLM, an open source library that accelerates and optimizes inference performance of recent large language models on the NVIDIA AI platform, enabling developers to experiment with new LLMs for high performance and quick customization through a simplified Python API.
|
About
Ship AI faster with managed, cloud-hosted AI packages. Full, built-in support for GPT-4. No API tokens are necessary. Build with our low code framework. Integrations with all major models are built-in. Deploy for an instant API. Scale and share without managing infrastructure. Turn prompts, prompt chains, and basic Python into a managed API. Turn a clever prompt into a published API you can share. Add logic and routing smarts with Python. Steamship connects to your favorite models and services so that you don't have to learn a new API for every provider. Steamship persists in model output in a standardized format. Consolidate training, inference, vector search, and endpoint hosting. Import, transcribe, or generate text. Run all the models you want on it. Query across the results with ShipQL. Packages are full-stack, cloud-hosted AI apps. Each instance you create provides an API and private data workspace.
|
|||||
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
|||||
Audience
Machine learning engineers and data scientists seeking a tool to optimize their deep learning operations
|
Audience
Developers seeking a low code framework to build, generate, and deploy code and applications
|
|||||
Support
Phone Support
24/7 Live Support
Online
|
Support
Phone Support
24/7 Live Support
Online
|
|||||
API
Offers API
|
API
Offers API
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
Free
Free Version
Free Trial
|
Pricing
No information available.
Free Version
Free Trial
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Webinars
Live Online
In Person
|
Training
Documentation
Webinars
Live Online
In Person
|
|||||
Company InformationNVIDIA
Founded: 1993
United States
developer.nvidia.com/tensorrt
|
Company InformationSteamship
United States
www.steamship.com
|
|||||
Alternatives |
Alternatives |
|||||
|
|
||||||
Categories |
Categories |
|||||
Integrations
Hugging Face
Python
Dataoorts GPU Cloud
Deepgram
Giveaway.com
JavaScript
Microsoft 365
NLP Cloud
NVIDIA Broadcast
NVIDIA Clara
|
Integrations
Hugging Face
Python
Dataoorts GPU Cloud
Deepgram
Giveaway.com
JavaScript
Microsoft 365
NLP Cloud
NVIDIA Broadcast
NVIDIA Clara
|
|||||
|
|
|