Chinchilla

Chinchilla

Google DeepMind
StarCoder

StarCoder

BigCode
+
+

Related Products

  • LM-Kit.NET
    16 Ratings
    Visit Website
  • Vertex AI
    726 Ratings
    Visit Website
  • Google AI Studio
    9 Ratings
    Visit Website
  • Stack AI
    18 Ratings
    Visit Website
  • CredentialStream
    161 Ratings
    Visit Website
  • PESTBOSS
    2 Ratings
    Visit Website
  • Pipedrive
    8,713 Ratings
    Visit Website
  • CLEAR
    1 Rating
    Visit Website
  • Amp
    86 Ratings
    Visit Website
  • Quaeris
    6 Ratings
    Visit Website

About

Chinchilla is a large language model. Chinchilla uses the same compute budget as Gopher but with 70B parameters and 4× more more data. Chinchilla uniformly and significantly outperforms Gopher (280B), GPT-3 (175B), Jurassic-1 (178B), and Megatron-Turing NLG (530B) on a large range of downstream evaluation tasks. This also means that Chinchilla uses substantially less compute for fine-tuning and inference, greatly facilitating downstream usage. As a highlight, Chinchilla reaches a state-of-the-art average accuracy of 67.5% on the MMLU benchmark, greater than a 7% improvement over Gopher.

About

StarCoder and StarCoderBase are Large Language Models for Code (Code LLMs) trained on permissively licensed data from GitHub, including from 80+ programming languages, Git commits, GitHub issues, and Jupyter notebooks. Similar to LLaMA, we trained a ~15B parameter model for 1 trillion tokens. We fine-tuned StarCoderBase model for 35B Python tokens, resulting in a new model that we call StarCoder. We found that StarCoderBase outperforms existing open Code LLMs on popular programming benchmarks and matches or surpasses closed models such as code-cushman-001 from OpenAI (the original Codex model that powered early versions of GitHub Copilot). With a context length of over 8,000 tokens, the StarCoder models can process more input than any other open LLM, enabling a wide range of interesting applications. For example, by prompting the StarCoder models with a series of dialogues, we enabled them to act as a technical assistant.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Developers interested in a powerful large language model (LLM)

Audience

Developers interested in an LLM for code generation

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

No images available

Screenshots and Videos

Pricing

No information available.
Free Version
Free Trial

Pricing

Free
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

Google DeepMind
United States
arxiv.org/abs/2203.15556

Company Information

BigCode
Founded: 2023
huggingface.co/blog/starcoder

Alternatives

Alternatives

CodeGemma

CodeGemma

Google
Qwen2.5-Max

Qwen2.5-Max

Alibaba
CodeQwen

CodeQwen

Alibaba
Mistral 7B

Mistral 7B

Mistral AI
DeepSeek Coder

DeepSeek Coder

DeepSeek
Llama 2

Llama 2

Meta
CodeGen

CodeGen

Salesforce
Phi-2

Phi-2

Microsoft

Categories

Categories

Integrations

ChatGPT
CodeQwen
Git
GitHub
LM Studio
MusicFX
OpenAI
Python
Stitch
Tabby
Taylor AI
Visual Studio Code
WeatherNext

Integrations

ChatGPT
CodeQwen
Git
GitHub
LM Studio
MusicFX
OpenAI
Python
Stitch
Tabby
Taylor AI
Visual Studio Code
WeatherNext
Claim Chinchilla and update features and information
Claim Chinchilla and update features and information
Claim StarCoder and update features and information
Claim StarCoder and update features and information