Vibeleaderboard
← All Intel
Intel / post

ElevenLabs ships one-pass video scoring with music and effects

Source
x.com
Date
ElevenLabs@ElevenLabs

Instant Soundtracks let you elevate any video with music and sound effects, in one pass. Upload your footage and the model scores it with original music, then watches for moments that call for an effect and places each one at the right timestamp. You can also use the original audio as a reference, so the new score matches its character. Available today in @ElevenCreative, @elevenmusic_io, and ElevenAPI.

Context

ElevenLabs has released Instant Soundtracks, a feature that adds both a music score and sound effects to an uploaded video in a single step (ElevenLabs on X). As the company describes it, the work happens in two parts. The model first scores the footage with original music, then watches the video for moments that call for an effect and places each effect at the matching timestamp. Users can also give the clip's original audio as a reference, so the new score matches its character.

ElevenLabs' blog post, stored as separate Intel, adds that the generated effects are placed on the ElevenCreative editor's timeline automatically, so they can still be refined there. Its example is a whoosh timed to the logo at the end of an ad. The same post says the update improves timing for short-form content and switches mood more accurately between scenes. The feature is available in ElevenCreative, ElevenMusic and the ElevenLabs API.

This explanation is based only on ElevenLabs' own announcement and a truncated excerpt of its blog post. The demo video in the post was not transcribed. Nothing in the evidence shows independent tests of how accurately effects line up with the picture or how the generated music sounds.

More from ElevenLabs
Recommended reads
Comments

Checking sign-in…

Loading comments…