概述
It lets a short idea grow into a full track or a flawed take be repaired without rerecording. It matters because it changes how people draft and edit music, but it has clear quality limits and does not remove the rights of whoever owns the original audio.
深入探讨
Extension takes an existing clip and generates what comes next. One common approach is autoregressive continuation. Meta's MusicGen, released in 2023 as part of AudioCraft, converts audio into discrete tokens with a neural codec called EnCodec and predicts further tokens after the ones you supply, much as a language model continues a sentence. Consumer services such as Suno and Udio offer this as an Extend feature, usually letting you pick a start point and change lyrics or style for the new section. Inpainting regenerates a masked region in the middle while preserving audio on both sides, useful for fixing a lyric or replacing four bars. Diffusion models suit this because the known audio can be held fixed while only the masked span is denoised. Audio-to-audio or remix modes, like the one Stability AI introduced with Stable Audio 2.0 in 2024, partially add noise to an input and regenerate it under a new prompt, so structure survives while timbre and style change. A strength setting controls how much of the original remains. Stem work combines separation and generation. Source separation models such as Meta's open-source Demucs split a mix into vocals, drums, bass and other; a generator can then add or replace one part conditioned on the rest. The limits are real. Long extensions drift: tempo, key, mix balance and vocal timbre can wander. Joins can click or jump in loudness. Models see a limited context window, so a motif from the first minute may be forgotten. A common misconception is that the model understands the song's structure the way a musician does; it is matching patterns in recent audio. Rights also persist: extending a commercial recording you do not own creates a derivative of it, and many services' terms forbid uploading audio you lack rights to.
战略影响
交通与覆盖范围
它通过转录、旁白和语音界面提高了可访问性。
成本与预算
媒体团队可以用更少的预算更快地交付精美的音频。
速度与规模
面向客户的系统可以处理更大规模的语音交互。
The Future of AI Music Extension and Continuation
Research is pushing toward longer context, better structure awareness, and finer control over individual stems, which should reduce drift and make section-level edits more predictable. Integration into digital audio workstations is a likely direction, since editing inside an existing project is more useful than generating whole songs in a browser. Quality at the seams and preservation of a specific singer's identity remain hard problems. On the rights side, upload screening and licensing arrangements between services and rights holders are still developing, so what users may legally extend will depend on evolving terms and court outcomes rather than on the technology alone.
现实世界的实施
A songwriter hums a 20-second chorus idea, uploads it to a music generator, and uses an Extend feature from the 0:18 mark to produce a verse and bridge that follow on in the same key and tempo.
A podcast editor has a 30-second licensed music bed that is too short for the intro, so she generates a continuation and crossfades it at a bar line to reach 60 seconds.
A producer separates an old demo into vocals, drums, bass and other stems with Demucs, mutes the weak drum stem, and has a model generate a new drum part conditioned on the remaining stems.
A band inpaints two bars where the singer fluffed a lyric, keeping the audio on both sides intact, then checks that the regenerated vocal still sounds like the same singer.
风险与防护栏
如果未征得同意,语音滥用和冒充风险就会增加。
由于口音、方言或嘈杂的环境,准确性可能会下降。
如果没有明确的标签,合成音频可能会被误认为是真实的语音。
实施路线图
获得语音捕获、克隆和重用的明确同意。
测试不同扬声器和背景条件下的质量。
定义人员必须审查或批准输出的时间。
标记合成音频并保留来源记录以供问责。
不断探索
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the AI Music Extension and Continuation quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
常见问题
What is AI Music Extension and Continuation?
AI music extension uses a generative model to continue an existing audio clip, regenerate a section in the middle (inpainting), restyle it, or add and replace individual instrument stems. It lets a short idea grow into a full track or a flawed take be repaired without rerecording. It matters because it changes how people draft and edit music, but it has clear quality limits and does not remove the rights of whoever owns the original audio.
How does an autoregressive model like MusicGen continue an audio clip?
The clip is converted into discrete tokens and the model predicts what tokens come next, similar to how a language model continues text.
Which neural codec does MusicGen use to turn audio into tokens?
MusicGen relies on EnCodec, a neural audio codec from Meta, to represent audio as discrete tokens.
What does audio inpainting do?
Inpainting fills or replaces a selected span, such as a flubbed lyric, while keeping surrounding audio intact.
Why are diffusion models well suited to inpainting?
Diffusion can constrain known regions during denoising, so only the missing section is regenerated to fit its surroundings.
In a remix or audio-to-audio mode, what does the strength setting control?
Higher strength adds more noise and regenerates more, changing the input further; lower strength keeps more of its structure.
继续学习
相关指南
为此主题精选的更多指南