SageMaker Hugging Face Inference Toolkit Files

Library for serving Transformers models on Amazon SageMaker

This is an exact mirror of the SageMaker Hugging Face Inference Toolkit project, hosted at https://github.com/aws/sagemaker-huggingface-inference-toolkit. SourceForge is not affiliated with SageMaker Hugging Face Inference Toolkit.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
v2.6.0	2025-04-23		0
v2.5.0	2025-04-01		0
v2.4.1	2024-10-18		0
v2.4.0	2024-05-08		0
v2.3.0	2023-11-17		0
Totals: 5 Items			0

Other Useful Business Software

Fully Managed MySQL, PostgreSQL, and SQL Server

Automatic backups, patching, replication, and failover. Focus on your app, not your database.

Cloud SQL handles your database ops end to end, so you can focus on your app.

Try Free

Gemini 3 and 200+ AI Models on One Platform

Access Google's best plus Claude, Llama, and Gemma. Fine-tune and deploy from one console.

Build generative AI apps with Vertex AI. Switch between models without switching platforms.

Start Free

MongoDB Atlas runs apps anywhere

Deploy in 115+ regions with the modern database for every enterprise.

MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.

Start Free

Recommended Projects

SageMaker Python SDK
Training and deploying machine learning models on Amazon SageMaker
AWS Deep Learning Containers
A set of Docker images for training and serving models in TensorFlow
Hugging Face - Speech To Speech
Open speech-to-speech models and pipelines by Hugging Face toolkit AI
PyTorch Image Models
The largest collection of PyTorch image encoders / backbones
MCP HFSpace
MCP Server to Use HuggingFace spaces, easy configuration

SageMaker Hugging Face Inference Toolkit Files

Library for serving Transformers models on Amazon SageMaker

Get an email when there's a new version of SageMaker Hugging Face Inference Toolkit