SingFit

SingConvert is an AI-powered web application that converts vocal recordings (a cappella or accompanied) and YouTube videos into precise sheet music, MIDI, and MusicXML files. Tailored for singers, vocal coaches, arrangers, and choral composers, it detects pitch, tempo, rhythm, and expressive nuances with impressive accuracy. Whether you’re transcribing a solo idea or a full vocal arrangement, SingConvert simplifies the process with professional-grade outputs in seconds — no software installation required.

We’re introducing Jukebox, a neural net that generates music, including rudimentary singing, as raw audio in a variety of genres and artistic styles. We’re releasing the model weights and code, along with a tool to explore the generated samples. Provided with genre, artist, and lyrics as input, Jukebox outputs a new music sample produced from scratch. Jukebox produces a wide range of music and singing styles and generalizes to lyrics not seen during training. All the lyrics below have been co-written by a language model and OpenAI researchers. When conditioned on lyrics seen during training, Jukebox produces songs very different from the original songs it was trained on. We provide 12 seconds of audio to condition on and Jukebox completes the rest in a specified style. We chose to work on music because we want to continue to push the boundaries of generative models. Jukebox’s autoencoder model compresses audio to a discrete space, using a quantization-based approach called VQ-VAE.