Misalai na Kishiya da Karfi
Misalai na gaba su ne abubuwan da ke damun su ta hanyar ƴan ƙanana, sau da yawa canje-canjen da ba za a iya fahimta ba waɗanda ke haifar da abin ƙira don yin gaba gaɗi, hasashen kuskure.
Dubawa
Robustness is the field dedicated to defending against them, and it reveals deep gaps between machine and human perception.
Zurfafa nutsewa
A cikin 2013-2014, masu bincike sun nuna cewa ƙara ƙirar hayaniyar da ba a iya gani a hankali zuwa hoto zai iya juyar da na'ura daga 'panda' zuwa 'gibbon' tare da babban kwarin gwiwa. Waɗannan misalan abokan gaba suna amfani da gaskiyar cewa hanyoyin sadarwa na jijiyoyi suna koyon iyakokin yanke shawara waɗanda ba su da ƙarfi a cikin sararin sararin samaniya. Hare-hare yawanci farin-akwatin (wanda ya kai harin ya san samfurin kuma yana amfani da gradients, kamar yadda yake a cikin FGSM da PGD) ko akwatin baƙar fata (fitowa kawai ake iya gani). Abin sha'awa, misalan ƙiyayya galibi suna canzawa tsakanin ƙira daban-daban, suna ba da damar kai hari ba tare da shiga ciki ba. Haɗarin abu ne mai amfani: lambobi na zahiri na iya yaudarar masu gano alamar tsayawa, da allurar da sauri 'warkewa' su ne analog-samfurin harshe. Bincike mai ƙarfi yana neman samfura waɗanda ke yin daidai ko da a cikin mafi munin yanayi, rikice-rikicen gaba.
Fahimtar Fasaha
Yawancin hare-hare sun dogara ne akan gradient: FGSM yana ɗaukar mataki ɗaya zuwa alamar alamar rashi game da shigarwar, yayin da PGD ke maimaita wannan a cikin ƙaramin iyaka (misali, L-infinity) ƙwallon kusa da ainihin shigarwar. Babban sanannen tsaro shine horo na gaba, sake horarwa akan misalan abokan gaba, wanda aka ƙirƙira azaman matsalar min-max: rage asara akan mafi munin hargitsi. Yana inganta ƙarfi amma yawanci yana biyan daidaitattun daidaito da ƙididdigewa.
Dabarun Tasiri
Kudin da kasafin kuɗi
Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru.
Shawarwari masu haske
Ilimin fasaha yana taimaka wa ƙungiyoyi su zaɓi tari mai kyau, ba kawai sabon abu ba.
Kula da inganci
Zaɓuɓɓukan injiniya mafi kyau suna rage abin dogaro a cikin samarwa.
Makomar Misalai masu Kaya da Karfi
Yayin da AI ke shiga cikin mahimman tsarin aminci, ƙarfi yana motsawa daga sha'awar ilimi zuwa buƙatun injiniya. Ana ci gaba da aiki akan ƙwararrun kariyar da lissafi ke ba da garantin cewa babu wata matsala a cikin iyaka da za ta iya canza abin da ake fitarwa, da kuma ƙarfi kan faɗuwar hare-hare masu wuyar ɗaure da ke fuskantar manyan nau'ikan harshe, irin su fasa gidan yari da alluran gaggawa. Yi tsammanin daidaitattun ma'auni na gaba, bututun haɗin gwiwar ja, da matsa lamba na tsari don ƙirar da aka tura a cikin tuƙi mai cin gashin kai, tsaro, da kiwon lafiya don nuna ingantaccen yanayin.
Aiwatar da Gaskiyar Duniya
Masu bincike sun sanya ƙananan lambobi na jiki akan alamar tsayawa wanda ya haifar da samfurin hangen nesa don kuskuren karanta shi a matsayin alamar iyakacin sauri, yana kwatanta barazanar gaske ga motoci masu tuka kansu.
Ƙungiyoyin tsaro jajayen fuska na ƙungiyar tare da buga facin da aka buga akan tabarau ko tufafi waɗanda ke gujewa ko wawatar da kamanceceniya.
Ana bincika masu tace spam da malware tare da abubuwan da ke da ruɗani waɗanda ke adana munanan abubuwan biyan kuɗi yayin da suke zamewa da abubuwan ƙira.
Masu haɓakawa na LLM suna kare allura da sauri 'jailbreaks', misalin harshe na misalan abokan gaba, wannan dabarar yin watsi da umarnin aminci.
Hatsari & Tsare-tsare
Haɓaka ma'auni ɗaya na iya ɓoye manyan raunin tsarin.
Sau da yawa ana raina kayan more rayuwa da kuma kuɗin kulawa.
Tsaro da gibin lura na iya girma yayin da tsarin ke ƙara haɓaka.
Taswirar Hanya
Ƙayyade latency, inganci, da maƙasudin farashi kafin aiwatarwa.
Alamar ma'auni a ƙarƙashin ainihin kaya da yanayin bayanai.
Kula da kayan aiki don kurakurai, ɗigo, da tasirin mai amfani.
Shirya bijirowa da hanyoyin mayar da martani kafin sikeli.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Adversarial Examples and Robustness quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Generative Adversarial Networks
Tambayoyin da ake yawan yi
What is Adversarial Examples and Robustness?
Misalai na gaba su ne abubuwan da ke damun su ta hanyar ƴan ƙanana, sau da yawa canje-canjen da ba za a iya fahimta ba waɗanda ke haifar da abin ƙira don yin gaba gaɗi, hasashen kuskure. Ƙarfi shine filin da aka sadaukar don karewa a kansu, kuma yana bayyana zurfin gibi tsakanin na'ura da tsinkayen ɗan adam.
Menene misali na gaba?
Misalai na abokan gaba suna ƙara ƙanana, ƙwararrun ɓarna waɗanda ɗan adam ba sa lura da su amma suna yaudarar abin ƙira zuwa manyan kurakurai.
Menene ya bambanta harin 'farin-kwali' da harin 'black-box'?
Masu kai hari na farin-akwatin sun san samfurin kuma suna iya amfani da gradients; Masu kai hare-haren baƙar fata suna gani kawai abubuwan shigarwa da abubuwan fitarwa.
Menene kariyar da aka fi amfani da ita don inganta ƙarfin gaba?
Horar da abokan gaba yana haɓaka koyo tare da mafi munin abubuwan da suka ruɗe, waɗanda aka tsara azaman ingantawa mafi ƙarancin, kuma shine mafi ƙarfi abin dogaro, kodayake yana iya rage daidaito mai tsabta.
Me yasa 'canjawa' misalan abokan gaba ya shafi?
Saboda misalan abokan gaba suna canjawa cikin ƙira, mai hari zai iya ƙera su akan ƙirar maye kuma ya sami nasarar kai hari kan abin da ba za su iya dubawa ba.
Menene babban-samfurin babban yare na misalan abokan gaba?
Jailbreaks da alluran gaggawa an ƙera su ne waɗanda ke sarrafa LLM zuwa halaye marasa aminci ko waɗanda ba a yi niyya ba, masu kama da harin gaba a hangen nesa.