AudioLM

AudioLM

Google
+
+

Related Products

  • LALAL.AI
    3,774 Ratings
    Visit Website
  • Amazon Bedrock
    72 Ratings
    Visit Website
  • Ango Hub
    15 Ratings
    Visit Website
  • Harmoni
    14 Ratings
    Visit Website
  • Google Cloud Speech-to-Text
    374 Ratings
    Visit Website
  • 4K Video Downloader
    7,556 Ratings
    Visit Website
  • EBizCharge
    180 Ratings
    Visit Website
  • Volumo
    19 Ratings
    Visit Website
  • DropTrack
    170 Ratings
    Visit Website
  • Imorgon
    3 Ratings
    Visit Website

About

AudioLM is a pure audio language model that generates high‑fidelity, long‑term coherent speech and piano music by learning from raw audio alone, without requiring any text transcripts or symbolic representations. It represents audio hierarchically using two types of discrete tokens, semantic tokens extracted from a self‑supervised model to capture phonetic or melodic structure and global context, and acoustic tokens from a neural codec to preserve speaker characteristics and fine waveform details, and chains three Transformer stages to predict first semantic tokens for high‑level structure, then coarse and finally fine acoustic tokens for detailed synthesis. The resulting pipeline allows AudioLM to condition on a few seconds of input audio and produce seamless continuations that retain voice identity, prosody, and recording conditions in speech or melody, harmony, and rhythm in music. Human evaluations show that synthetic continuations are nearly indistinguishable from real recordings.

About

We’re introducing Jukebox, a neural net that generates music, including rudimentary singing, as raw audio in a variety of genres and artistic styles. We’re releasing the model weights and code, along with a tool to explore the generated samples. Provided with genre, artist, and lyrics as input, Jukebox outputs a new music sample produced from scratch. Jukebox produces a wide range of music and singing styles and generalizes to lyrics not seen during training. All the lyrics below have been co-written by a language model and OpenAI researchers. When conditioned on lyrics seen during training, Jukebox produces songs very different from the original songs it was trained on. We provide 12 seconds of audio to condition on and Jukebox completes the rest in a specified style. We chose to work on music because we want to continue to push the boundaries of generative models. Jukebox’s autoencoder model compresses audio to a discrete space, using a quantization-based approach called VQ-VAE.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Audio researchers and developers needing a solution for creating realistic speech and music continuations directly from raw audio

Audience

Anyone seeking a tool to generates music samples, including rudimentary voice-oriented music tracks

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

Pricing

No information available.
Free Version
Free Trial

Pricing

No information available.
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

Google
United States
research.google/blog/audiolm-a-language-modeling-approach-to-audio-generation/

Company Information

OpenAI
Founded: 2015
United States
openai.com/blog/jukebox/

Alternatives

AudioCraft

AudioCraft

Meta AI

Alternatives

MusicAI

MusicAI

iMyFone
MuseNet

MuseNet

OpenAI
MuseNet

MuseNet

OpenAI
Mureka

Mureka

Mureka AI

Categories

Categories

Integrations

Microsoft Azure
Opal
OpenAI

Integrations

Microsoft Azure
Opal
OpenAI
Claim AudioLM and update features and information
Claim AudioLM and update features and information
Claim OpenAI Jukebox and update features and information
Claim OpenAI Jukebox and update features and information