引導式測驗 · 中等 等級
基於文字描述的人工智慧語音設計測驗
測試語音設計與語音克隆有何不同,如何建立描述標記的訓練數據,以及為什麼必須保存設計的語音以保持一致。
問題 1 的 8
語音設計和語音克隆的核心差異是什麼?
預覽每個問題8 問題
當您參加測驗時,就會出現答案和解釋。
- 語音設計和語音克隆的核心差異是什麼?
- Voice design needs more sample audio than cloning
- Voice design creates a new voice from a text description, while cloning reproduces a specific speaker from reference audio
- Cloning works only in English
- Voice design can only make robotic-sounding voices
- 為什麼訓練資料是語音設計模型的主要挑戰?
- Speech audio is illegal to store
- Models need speech paired with descriptions, and hand labeling large amounts is expensive
- Descriptions must be written in code
- Voice models cannot learn from more than one speaker
- 2024 年 Stability AI 和愛丁堡方法如何大規模創建描述?
- By hiring voice actors to describe themselves
- By automatically measuring attributes like pitch and speaking rate and having a language model turn them into sentences
- By copying descriptions from audiobook covers
- By using only synthetic speech
- 告訴預設聲音聽起來更興奮的指令主要改變了什麼?
- Voice identity
- Delivery
- The underlying codec
- The speaker's accent training data
- 為什麼同一描述的兩代人可能會發出不同的聲音?
- The model samples one of many voices consistent with the text
- The description is ignored after the first use
- Audio codecs randomly change language
- The model always adds background music
- In production, how do you keep a designed voice consistent across an audiobook?
- Rewrite the description for every chapter
- Save the chosen speaker embedding, latent or reference clip and fix the seed
- Lower the audio sample rate
- Switch to a different model each chapter
- In Parler-TTS, how does the description influence generation?
- It is converted into a reference audio clip
- It is encoded by a frozen T5-family encoder and used through cross-attention
- It sets only the volume of the output
- It is appended to the end of the waveform
- Which statement about designed voices is accurate?
- A designed voice can never resemble a real person
- Designed voices need no disclosure because no one was cloned
- A designed voice can resemble a real person by chance, and many services block prompts naming real people
- Designed voices can only speak one sentence