Baichuan-13B

Baichuan-13B

Baichuan Intelligent Technology
+
+

Related Products

  • Vertex AI
    827 Ratings
    Visit Website
  • Google AI Studio
    11 Ratings
    Visit Website
  • LM-Kit.NET
    24 Ratings
    Visit Website
  • isoTracker Quality Management
    19 Ratings
    Visit Website
  • Digital WarRoom
    55 Ratings
    Visit Website
  • CYPHER Learning
    451 Ratings
    Visit Website
  • Axis LMS
    5 Ratings
    Visit Website
  • Nexo
    16,466 Ratings
    Visit Website
  • Visual Lease
    428 Ratings
    Visit Website
  • Trinium TMS
    1 Rating
    Visit Website

About

Baichuan-13B is an open source and commercially available large-scale language model containing 13 billion parameters developed by Baichuan Intelligent following Baichuan -7B . It has achieved the best results of the same size on authoritative Chinese and English benchmarks. This release contains two versions of pre-training ( Baichuan-13B-Base ) and alignment ( Baichuan-13B-Chat ). Larger size, more data : Baichuan-13B further expands the number of parameters to 13 billion on the basis of Baichuan -7B , and trains 1.4 trillion tokens on high-quality corpus, which is 40% more than LLaMA-13B. It is currently open source The model with the largest amount of training data in the 13B size. Support Chinese and English bilingual, use ALiBi position code, context window length is 4096.

About

The TinyLlama project aims to pretrain a 1.1B Llama model on 3 trillion tokens. With some proper optimization, we can achieve this within a span of "just" 90 days using 16 A100-40G GPUs. We adopted exactly the same architecture and tokenizer as Llama 2. This means TinyLlama can be plugged and played in many open-source projects built upon Llama. Besides, TinyLlama is compact with only 1.1B parameters. This compactness allows it to cater to a multitude of applications demanding a restricted computation and memory footprint.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Developers interested in a powerful large language model

Audience

Developers interested in a small language model

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

No images available

Pricing

Free
Free Version
Free Trial

Pricing

Free
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

Baichuan Intelligent Technology
Founded: 1998
China
github.com/baichuan-inc/Baichuan-13B

Company Information

TinyLlama
github.com/jzhang38/TinyLlama

Alternatives

ChatGLM

ChatGLM

Zhipu AI

Alternatives

Llama 2

Llama 2

Meta
Mistral 7B

Mistral 7B

Mistral AI
Qwen-7B

Qwen-7B

Alibaba
Llama 2

Llama 2

Meta
DeepSeek-V2

DeepSeek-V2

DeepSeek
Llama

Llama

Meta

Categories

Categories

Integrations

APIPark
C
C#
C++
CSS
Clojure
Elixir
F#
HTML
Java
JavaScript
Kotlin
R
Ruby
RunPod
Rust
SQL
Scala
TypeScript
Visual Basic

Integrations

APIPark
C
C#
C++
CSS
Clojure
Elixir
F#
HTML
Java
JavaScript
Kotlin
R
Ruby
RunPod
Rust
SQL
Scala
TypeScript
Visual Basic
Claim Baichuan-13B and update features and information
Claim Baichuan-13B and update features and information
Claim TinyLlama and update features and information
Claim TinyLlama and update features and information