Stable LM

Stable LM

Stability AI
+
+

Related Products

  • Windsurf Editor
    155 Ratings
    Visit Website
  • Boozang
    15 Ratings
    Visit Website
  • Vertex AI
    783 Ratings
    Visit Website
  • Sevocity EHR
    191 Ratings
    Visit Website
  • OORT DataHub
    13 Ratings
    Visit Website
  • imgproxy
    15 Ratings
    Visit Website
  • Teradata VantageCloud
    992 Ratings
    Visit Website
  • SKU Science
    16 Ratings
    Visit Website
  • dbt
    212 Ratings
    Visit Website
  • ClickLearn
    65 Ratings
    Visit Website

About

Stable LM: Stability AI Language Models. The release of Stable LM builds on our experience in open-sourcing earlier language models with EleutherAI, a nonprofit research hub. These language models include GPT-J, GPT-NeoX, and the Pythia suite, which were trained on The Pile open-source dataset. Many recent open-source language models continue to build on these efforts, including Cerebras-GPT and Dolly-2. Stable LM is trained on a new experimental dataset built on The Pile, but three times larger with 1.5 trillion tokens of content. We will release details on the dataset in due course. The richness of this dataset gives Stable LM surprisingly high performance in conversational and coding tasks, despite its small size of 3 to 7 billion parameters (by comparison, GPT-3 has 175 billion parameters). Stable LM 3B is a compact language model designed to operate on portable digital devices like handhelds and laptops, and we’re excited about its capabilities and portability.

About

The TinyLlama project aims to pretrain a 1.1B Llama model on 3 trillion tokens. With some proper optimization, we can achieve this within a span of "just" 90 days using 16 A100-40G GPUs. We adopted exactly the same architecture and tokenizer as Llama 2. This means TinyLlama can be plugged and played in many open-source projects built upon Llama. Besides, TinyLlama is compact with only 1.1B parameters. This compactness allows it to cater to a multitude of applications demanding a restricted computation and memory footprint.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Developers interested in an open source large language model

Audience

Developers interested in a small language model

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

No images available

Pricing

Free
Free Version
Free Trial

Pricing

Free
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

Stability AI
Founded: 2019
United Kingdom
stability.ai/

Company Information

TinyLlama
github.com/jzhang38/TinyLlama

Alternatives

Cerebras-GPT

Cerebras-GPT

Cerebras

Alternatives

Llama 2

Llama 2

Meta
Dolly

Dolly

Databricks
Falcon-40B

Falcon-40B

Technology Innovation Institute (TII)
GPT-J

GPT-J

EleutherAI
LTM-2-mini

LTM-2-mini

Magic AI

Categories

Categories

Integrations

Alpaca
Automi
Gopher
RunPod

Integrations

Alpaca
Automi
Gopher
RunPod
Claim Stable LM and update features and information
Claim Stable LM and update features and information
Claim TinyLlama and update features and information
Claim TinyLlama and update features and information