+

Related Products

  • Vertex AI
    944 Ratings
    Visit Website
  • LM-Kit.NET
    25 Ratings
    Visit Website
  • RunPod
    205 Ratings
    Visit Website
  • Google AI Studio
    11 Ratings
    Visit Website
  • Google Cloud Speech-to-Text
    375 Ratings
    Visit Website
  • Google Cloud Platform
    60,526 Ratings
    Visit Website
  • PBRS Power BI Reports Distribution
    12 Ratings
    Visit Website
  • Synchredible
    13 Ratings
    Visit Website
  • ManageEngine OpManager
    1,635 Ratings
    Visit Website
  • Azore CFD
    24 Ratings
    Visit Website

About

This is a model quantization tool for convolution neural networks(CNN). This tool could quantize both weights/biases and activations from 32-bit floating-point (FP32) format to 8-bit integer(INT8) format or any other bit depths. With this tool, you can boost the inference performance and efficiency significantly, while maintaining the accuracy. This tool supports common layer types in neural networks, including convolution, pooling, fully-connected, batch normalization and so on. The quantization tool does not need the retraining of the network or labeled datasets, only one batch of pictures are needed. The process time ranges from a few seconds to several minutes depending on the size of neural network, which makes rapid model update possible. This tool is collaborative optimized for DeePhi DPU and could generate INT8 format model files required by DNNC.

About

We take the hard work out of AI processing on the edge. The Latent AI Efficient Inference Platform (LEIP) enables adaptive AI at the edge by optimizing for compute, energy and memory without requiring changes to existing AI/ML infrastructure and frameworks. LEIP is a modular, fully-integrated workflow designed to train, quantize, adapt and deploy edge AI neural networks. LEIP is a modular, fully-integrated workflow designed to train, quantize and deploy edge AI neural networks. Latent AI believes in a vibrant and sustainable future driven by the power of AI and the promise of edge computing. Our mission is to deliver on the vast potential of edge AI with solutions that are efficient, practical, and useful. Latent AI helps a variety of federal and commercial organizations gain the most from their edge AI with an automated edge MLOps pipeline that creates ultra-efficient, compressed, and secured edge models at scale while also removing all maintenance and configuration concerns

About

Build, train, and deploy models faster at scale with fully managed infrastructure, tools, and workflows. Deploy custom AI & LLMs on any infrastructure in seconds and scale inference with ease. Handle your most demanding tasks with batch job scheduling, only paying with per-second billing. Optimize costs with GPU usage, spot instances, and built-in automatic failover. Train with a single command with YAML, simplifying complex infrastructure setups. Automatically scale up workers during high traffic and scale down to zero during inactivity. Deploy cutting-edge models with persistent endpoints in a serverless environment, optimizing resource usage. Monitor system and inference metrics in real-time, including worker count, GPU utilization, latency, and throughput. Efficiently conduct A/B testing by splitting traffic among multiple models for evaluation.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Anyone searching for a neural network solution

Audience

System Integrators, AI Developers, ML Engineers, Data Scientists

Audience

High-performance ML teams

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

Screenshots and Videos

Pricing

$0.90 per hour
Free Version
Free Trial

Pricing

No information available.
Free Version
Free Trial

Pricing

$100 + compute/month
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

DeePhi Quantization Tool
aws.amazon.com/marketplace/pp/prodview-bwtx6kzwg3gva

Company Information

Latent AI
Founded: 2018
United States
latentai.com

Company Information

VESSL AI
Founded: 2020
United States
vessl.ai/

Alternatives

Alternatives

Alternatives

Deci

Deci

Deci AI
Deci

Deci

Deci AI

Categories

Categories

Categories

Integrations

Amazon Web Services (AWS)
FLUX.1
FLUX.2
Gemma
Gemma 2
Google Cloud Platform
Jupyter Notebook
Kubernetes
LangChain
Llama 3
Llama 3.1
Llama 3.2
Mixtral 8x22B
Mixtral 8x7B
MusicGen
Pinecone
Stable Diffusion
Visual Studio Code
Vultr
Whisper

Integrations

Amazon Web Services (AWS)
FLUX.1
FLUX.2
Gemma
Gemma 2
Google Cloud Platform
Jupyter Notebook
Kubernetes
LangChain
Llama 3
Llama 3.1
Llama 3.2
Mixtral 8x22B
Mixtral 8x7B
MusicGen
Pinecone
Stable Diffusion
Visual Studio Code
Vultr
Whisper

Integrations

Amazon Web Services (AWS)
FLUX.1
FLUX.2
Gemma
Gemma 2
Google Cloud Platform
Jupyter Notebook
Kubernetes
LangChain
Llama 3
Llama 3.1
Llama 3.2
Mixtral 8x22B
Mixtral 8x7B
MusicGen
Pinecone
Stable Diffusion
Visual Studio Code
Vultr
Whisper
Claim DeePhi Quantization Tool and update features and information
Claim DeePhi Quantization Tool and update features and information
Claim Latent AI and update features and information
Claim Latent AI and update features and information
Claim VESSL AI and update features and information
Claim VESSL AI and update features and information