GPT-J

GPT-J

EleutherAI
GPT-NeoX

GPT-NeoX

EleutherAI
+
+

Related Products

  • Vertex AI
    827 Ratings
    Visit Website
  • LM-Kit.NET
    24 Ratings
    Visit Website
  • Google AI Studio
    11 Ratings
    Visit Website
  • dbt
    227 Ratings
    Visit Website
  • SKU Science
    16 Ratings
    Visit Website
  • Datasite Diligence Virtual Data Room
    619 Ratings
    Visit Website
  • RealEstateAPI (REAPI)
    45 Ratings
    Visit Website
  • Synchredible
    13 Ratings
    Visit Website
  • Kubit
    33 Ratings
    Visit Website
  • FinOpsly
    3 Ratings
    Visit Website

About

GPT-J is a cutting-edge language model created by the research organization EleutherAI. In terms of performance, GPT-J exhibits a level of proficiency comparable to that of OpenAI's renowned GPT-3 model in a range of zero-shot tasks. Notably, GPT-J has demonstrated the ability to surpass GPT-3 in tasks related to generating code. The latest iteration of this language model, known as GPT-J-6B, is built upon a linguistic dataset referred to as The Pile. This dataset, which is publicly available, encompasses a substantial volume of 825 gibibytes of language data, organized into 22 distinct subsets. While GPT-J shares certain capabilities with ChatGPT, it is important to note that GPT-J is not designed to operate as a chatbot; rather, its primary function is to predict text. In a significant development in March 2023, Databricks introduced Dolly, a model that follows instructions and is licensed under Apache.

About

An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library. This repository records EleutherAI's library for training large-scale language models on GPUs. Our current framework is based on NVIDIA's Megatron Language Model and has been augmented with techniques from DeepSpeed as well as some novel optimizations. We aim to make this repo a centralized and accessible place to gather techniques for training large-scale autoregressive language models, and accelerate research into large-scale training.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Developers interested in a powerful large language model

Audience

Developers interested in a large language model

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

Pricing

Free
Free Version
Free Trial

Pricing

Free
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

EleutherAI
Founded: 2020
eleuther.ai

Company Information

EleutherAI
Founded: 2020
github.com/EleutherAI/gpt-neox

Alternatives

Pythia

Pythia

EleutherAI

Alternatives

GPT-J

GPT-J

EleutherAI
T5

T5

Google
OPT

OPT

Meta
Stable LM

Stable LM

Stability AI
Pythia

Pythia

EleutherAI
DeepSpeed

DeepSpeed

Microsoft
ByteDance Seed

ByteDance Seed

ByteDance

Categories

Categories

Integrations

Forefront
Axolotl
ZBrain

Integrations

Forefront
Axolotl
ZBrain
Claim GPT-J and update features and information
Claim GPT-J and update features and information
Claim GPT-NeoX and update features and information
Claim GPT-NeoX and update features and information