Curated Transformers Files

✨ New features and improvements

• Add support for model repositories other than Hugging Face Hub (#331).
• Add support for fsspec filesystems as a repository type (#327, [#331]).
• Add support for NVTX Ranges (#320).
• Add a config property to models to query their configuration (#328).

🔴 Bug fixes

• Fix a potential loading issue that may arise when a model's dtype is not set in the Hugging Face configuration (#330).

🏛️ Feature: Model repositories

The new (experimental) repository API adds support for loading models from repositories other than Hugging Face Hub. You can also easily add your own repository types by implementing the Repository interface. Using a repository is as easy as calling the new from_repo method that is provided by all models and tokenizers:

:::python
from curated_transformers.models import AutoDecoder

decoder = AutoDecoder.from_repo(MyRepository("mpt-7b-my-qa"))

Curated Transformers comes with two repository classes out-of-the-box:

• HfHubRepository downloads models from Hugging Face Hub and is now used by the from_hf_hub methods.
• FsspecRepository supports the wide range of filesystems provided by the fsspec package and third-party implementations.

👥 Contributors

@danieldk, @honnibal, @ines, @shadeMe