Sfx V3 For Developers
- Source
- elevenlabs.io
- Author
- ElevenLabs editorial sitemap
- Date
Context
ElevenLabs has released SFX v3, a new model behind its Sound Effects API, which turns a text description into an audio clip. The company says v3 follows prompts that contain several instructions more closely than SFX v2, handles vocals and music better, and is less likely to clip on high-frequency sounds such as gongs, chimes and kettle whistles. Clipping is the harsh distortion that occurs when a sound is louder than the audio format can hold. Developers switch by setting model_id to eleven_text_to_sound_v3 on the same endpoint they already use (ElevenLabs developer post).
ElevenLabs calls the release an incremental update and publishes no measurements. Its evidence for quality is that its engineering team says the output sounds more natural overall. Because v2 and v3 run on the same endpoint, the post recommends running your most common prompts through both and comparing the results before switching. One feature keeps some users on v2: looping, requested with loop: true, still works only with eleven_text_to_sound_v2.
The better handling of multi-part prompts changes how prompts should be written. The post says order matters, so events should be listed in the sequence they should happen, as in "Footsteps on gravel, then a metallic door opens," while a single sound works best with a short, concrete prompt. Wording matters too: one tester got much better results from "a couple arguing in French" than from "a couple fighting in French." The model chooses a clip's length from the prompt unless duration_seconds is set, and raising prompt_influence above its default of 0.3 makes outputs follow the prompt more closely and vary less between generations.
- ElevenLabs' SFX v3 runs on the existing POST /v1/sound-generation endpoint by setting model_id to eleven_text_to_sound_v3. The company says it follows prompts with multiple instructions more closely than v2 and handles vocals and music better.
- For multi-part effects, ElevenLabs advises listing events in the order they should happen, such as footsteps on gravel then a metallic door opening, and keeping single-sound prompts short and concrete. One tester found 'arguing' worked much better than 'fighting'.
- SFX v3 chooses clip length from the prompt unless duration_seconds is set. Raising prompt_influence above its 0.3 default makes outputs follow the prompt more closely and vary less between generations. Looping still works only with the v2 model.
- ElevenLabs describes v3 as an incremental update that is less likely to clip on high-frequency sounds like gongs, chimes and kettle whistles. Because v2 and v3 share one endpoint, it recommends running common prompts through both before switching.
Checking sign-in…
Loading comments…
