音訊人工智慧指南

AI Music Extension and Continuation

AI music extension uses a generative model to continue an existing audio clip, regenerate a section in the middle (inpainting), restyle it, or add and replace individual instrument stems.

  • 4 分鐘閱讀
  • 最後更新
本頁4 分鐘閱讀
  1. 概述
  2. 深入探討
  3. 戰略影響
  4. The Future of AI Music Extension and Continuation
  5. 現實世界的實施
  6. 風險與防護欄
  7. 實施路線圖
  8. 不斷探索
  9. 常見問題

概述

It lets a short idea grow into a full track or a flawed take be repaired without rerecording. It matters because it changes how people draft and edit music, but it has clear quality limits and does not remove the rights of whoever owns the original audio.

深入探討

Extension takes an existing clip and generates what comes next. One common approach is autoregressive continuation. Meta's MusicGen, released in 2023 as part of AudioCraft, converts audio into discrete tokens with a neural codec called EnCodec and predicts further tokens after the ones you supply, much as a language model continues a sentence. Consumer services such as Suno and Udio offer this as an Extend feature, usually letting you pick a start point and change lyrics or style for the new section. Inpainting regenerates a masked region in the middle while preserving audio on both sides, useful for fixing a lyric or replacing four bars. Diffusion models suit this because the known audio can be held fixed while only the masked span is denoised. Audio-to-audio or remix modes, like the one Stability AI introduced with Stable Audio 2.0 in 2024, partially add noise to an input and regenerate it under a new prompt, so structure survives while timbre and style change. A strength setting controls how much of the original remains. Stem work combines separation and generation. Source separation models such as Meta's open-source Demucs split a mix into vocals, drums, bass and other; a generator can then add or replace one part conditioned on the rest. The limits are real. Long extensions drift: tempo, key, mix balance and vocal timbre can wander. Joins can click or jump in loudness. Models see a limited context window, so a motif from the first minute may be forgotten. A common misconception is that the model understands the song's structure the way a musician does; it is matching patterns in recent audio. Rights also persist: extending a commercial recording you do not own creates a derivative of it, and many services' terms forbid uploading audio you lack rights to.

戰略影響

交通與覆蓋範圍

它透過轉錄、旁白和語音介面提高了可訪問性。

成本與預算

媒體團隊可以用更少的預算更快地交付精美的音訊。

速度與規模

面向客戶的系統可以處理更大規模的語音互動。

The Future of AI Music Extension and Continuation

Research is pushing toward longer context, better structure awareness, and finer control over individual stems, which should reduce drift and make section-level edits more predictable. Integration into digital audio workstations is a likely direction, since editing inside an existing project is more useful than generating whole songs in a browser. Quality at the seams and preservation of a specific singer's identity remain hard problems. On the rights side, upload screening and licensing arrangements between services and rights holders are still developing, so what users may legally extend will depend on evolving terms and court outcomes rather than on the technology alone.

現實世界的實施

A songwriter hums a 20-second chorus idea, uploads it to a music generator, and uses an Extend feature from the 0:18 mark to produce a verse and bridge that follow on in the same key and tempo.

A podcast editor has a 30-second licensed music bed that is too short for the intro, so she generates a continuation and crossfades it at a bar line to reach 60 seconds.

A producer separates an old demo into vocals, drums, bass and other stems with Demucs, mutes the weak drum stem, and has a model generate a new drum part conditioned on the remaining stems.

A band inpaints two bars where the singer fluffed a lyric, keeping the audio on both sides intact, then checks that the regenerated vocal still sounds like the same singer.

風險與防護欄

  • 如果未徵得同意,語音濫用和冒充風險就會增加。

  • 由於口音、方言或嘈雜的環境,準確性可能會下降。

  • 如果沒有明確的標籤,合成音訊可能會被誤認為是真實的語音。

實施路線圖

  1. 獲得語音捕獲、克隆和重用的明確同意。

  2. 測試不同揚聲器和背景條件下的品質。

  3. 定義人員必須審查或批准輸出的時間。

  4. 標記合成音訊並保留來源記錄以供問責。

不斷探索

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the AI Music Extension and Continuation quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

開始測驗

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

常見問題

What is AI Music Extension and Continuation?

AI music extension uses a generative model to continue an existing audio clip, regenerate a section in the middle (inpainting), restyle it, or add and replace individual instrument stems. It lets a short idea grow into a full track or a flawed take be repaired without rerecording. It matters because it changes how people draft and edit music, but it has clear quality limits and does not remove the rights of whoever owns the original audio.

How does an autoregressive model like MusicGen continue an audio clip?

The clip is converted into discrete tokens and the model predicts what tokens come next, similar to how a language model continues text.

Which neural codec does MusicGen use to turn audio into tokens?

MusicGen relies on EnCodec, a neural audio codec from Meta, to represent audio as discrete tokens.

What does audio inpainting do?

Inpainting fills or replaces a selected span, such as a flubbed lyric, while keeping surrounding audio intact.

Why are diffusion models well suited to inpainting?

Diffusion can constrain known regions during denoising, so only the missing section is regenerated to fit its surroundings.

In a remix or audio-to-audio mode, what does the strength setting control?

Higher strength adds more noise and regenerates more, changing the input further; lower strength keeps more of its structure.