Introducing Instant Soundtracks

Video-to-soundtrack and synchronized sound effects are now available through an API, so pipelines that produce short-form video can add scored audio programmatically.

• ElevenLabs' Instant Soundtracks scores an uploaded video with original music, detects moments that call for sound effects, and places generated effects at those timestamps on the timeline, such as a whoosh timed to an ad's closing logo.
• The model can use a video's existing audio as a reference, analyzing genre, crescendos, tempo and instrumentation to shape the new score, and can shift the music's mood between scenes.
• Via the API, new parameters add_sfx, separate_tracks and use_audio_as_reference are available; separate_tracks=true returns a ZIP with music and effects as separate files, and a request accepts up to 10 videos totaling 200 MB and 10 minutes.

• articleHow To Use Agent Skils
• articleAudio Deepfake Detection Guide
• articleDesigning Secure Caller Identity Authentication Flows For Voice Agents
• articleCascaded Vs Fused Models

• articleFrom Speech To Audio Creation Introducing The Seed Audio 1 0 Audio Creation ModelByteDance Seed
• clipHow audio-video sync is evaluated without recognizing the soundAI Engineer
• postSeedance 2.5 generates 30 seconds of video with audio in one passOpenRouter

Checking sign-in…

Loading comments…