Maswali yanayounganishwa na mwongozo · Kati Kiwango
Maswali ya Kuvunja Jela na Timu Nyekundu
Pitia uvunjaji wa jela, mashambulizi ya muktadha mrefu, majaribio ya timu nyekundu na kwa nini tathmini za usalama lazima zijumuishe vidokezo vya kiadui. kwa vitendo.
Swali 1 ya 8
Je, lengo kuu la haraka ya kuzuiliwa kwa jela ni lipi?
Hakiki kila swali8 maswali
Majibu na maelezo huonekana unapojibu maswali.
- Je, lengo kuu la haraka ya kuzuiliwa kwa jela ni lipi?
- Ili kupata mfano wa kupita sheria zake za usalama zilizojengwa
- Ili kuharakisha wakati wa majibu ya mfano
- Ili kutafsiri maandishi kwa lugha nyingine
- Ili kupunguza gharama ya kuendesha modeli
- How does NIST define red teaming in the AI context?
- Training a model to imitate a specific person
- Structured adversarial testing to find flaws, vulnerabilities or unexpected system behaviors
- A way to increase context length
- A method for compressing neural-network weights
- Kwa nini mapumziko ya jela ya risasi nyingi hufanya kazi vyema kadiri madirisha ya muktadha yanavyokuwa marefu?
- Vidokezo vya muda mrefu zaidi ni nafuu kusindika
- Muktadha mrefu zaidi huzima kiainishaji cha usalama kiotomatiki
- Mfano huo unaweza kujazwa na mifano mingi ya uwongo ya uwongo ambayo hubadilisha tabia yake
- Mfano husahau maagizo yake ya asili baada ya maneno 100
- What does a Constitutional Classifier defense add in the cited study?
- A larger context window only
- A database of human names
- An automatic guarantee that all harmful outputs are impossible
- Classifiers trained on synthetic examples from natural-language rules to screen harmful inputs or outputs
- What did the Many-shot Jailbreaking study demonstrate about safeguards?
- In its tested settings, long-context demonstrations could elicit behavior that safety training aimed to prevent
- Every model always complies with every harmful request
- Safety classifiers eliminate every possible attack
- The study only measured speech recognition accuracy
- What does the RedAgent paper automate in its red-team method?
- The training of a new foundation model from scratch
- Generation of context-aware jailbreak prompts using an autonomous language-agent system
- The legal review of every generated answer
- The deletion of all model safety policies
- What relationship did the Many-shot Jailbreaking study report between demonstration count and attack effectiveness?
- It dropped to zero after one example
- It was identical for every context size
- Effectiveness followed a power law up to hundreds of demonstrations in tested settings
- It depended only on image resolution
- What should a red-team report include to make findings interpretable?
- Only one successful prompt without context
- A claim that all models fail identically
- The model’s hidden training data
- The tested model and version, prompt conditions, evaluation scope and limitations