Tunani da Ma'aikatan Gyaran Kai
Reflexion wata dabara ce inda wakilin AI ke nunawa a rubuce a kan gazawarsa kuma yana ciyar da waɗancan darussan a cikin ƙoƙari na gaba.
Dubawa
It matters because it lets agents improve on a task without retraining the underlying model.
Zurfafa nutsewa
Reflexion, wanda aka gabatar a cikin takarda na 2023 ta Shinn da abokan aiki, yana ba wakili madauki: yana ƙoƙarin aiki, yana karɓar sigina game da yadda ya yi (sakamakon gwaji, lada, ko zargi), sannan ya rubuta ɗan gajeren yanayi na harshe 'tunanin' yana bayyana abin da ba daidai ba da abin da za a gwada na gaba. Ana adana wannan tunani a cikin ƙwaƙwalwar ajiya kuma an riga an saita shi zuwa saurin ƙoƙari na gaba. Mahimmanci, ma'aunin samfurin ba ya canzawa; koyo yana faruwa gaba ɗaya a cikin taga mahallin azaman rubutu. Wannan 'koyon ƙarfafawa na magana' yana bawa wakilai damar yin tsokaci akan matsalolin coding, kewayawa yanar gizo, da ayyukan tunani. A kan ma'aunin coding na HumanEval, gyaran kai-style na Reflexion ya tura ƙimar wucewa sama da yunƙurin harbi ɗaya, ta hanyar barin wakili ya gyara kurakuransa a cikin ƴan gwaje-gwaje.
Fahimtar Fasaha
Tunani yana raba ayyuka guda uku: ɗan wasan kwaikwayo wanda ke haifar da ayyuka, Mai kimantawa wanda ya ƙididdige sakamakon (gwajin raka'a, tantance daidai-wasan, ko alƙalin LLM), da samfurin Tunanin Kai wanda ke juya wannan maki zuwa darasi na rubutu. Darasin ya sauka a cikin maƙallan ƙwaƙwalwar ajiya da aka sake amfani da shi akan gwaji na gaba. Saboda martani yare ne maimakon gradients, ba a buƙatar horo na GPU, amma ya dogara sosai akan ingantaccen siginar kimantawa don guje wa ƙarfafa kwarin gwiwa amma tunani mara kyau.
Dabarun Tasiri
Gina zaɓuɓɓuka
Tsarin matakin aikace-aikacen yana ƙayyade ko AI yana inganta sakamako na gaske.
Ƙungiya da aikin aiki
Kyakkyawan haɗin gwiwar aiki yana haifar da ribar yawan aiki masu amfani za su iya amincewa.
Haɗari da aminci
Abubuwan da aka yi amfani da su da kyau suna rage gajiyar canji da haɗarin aiwatarwa.
Makomar Juyawa da Wakilan Gyaran Kai
Gyaran kai yana zama tsoho a cikin tsarin wakilai maimakon dabarar bincike. Yi tsammanin haɗin kai mai ƙarfi tare da masu tabbatarwa ta atomatik, kamar akwatin yashi na lamba, masu dubawa na yau da kullun, da dawo da abin da ke tabbatar da gaskiya, don haka tunani yana kan tushe cikin sigina na haƙiƙa maimakon ƙirar ƙira ta biyu. Kalubalen buɗaɗɗen suna nisantar madaukai inda wakili ba ya ƙare 'gyara' fitarwar aiki, yanke shawarar lokacin da za a dakatar da maimaitawa, da hana tunani daga jujjuyawa zuwa sauti mai ma'ana amma ba a tantance ba.
Aiwatar da Gaskiyar Duniya
Wakilin codeing wanda ke gudanar da gwaje-gwajen naúrar, yana karanta furucin da ya gaza, ya rubuta rubutu akan kwaro, kuma ya gyara lambar sa kafin sake gudanar da suite.
Mataimaki na bincike wanda ya kama bayanin da aka gani lokacin da rajistan dawowa ya kasa, sannan ya sake bitar amsar don amfani da ingantattun tushe kawai.
Wakilin kewayawa yanar gizo (misali, akan ma'auni na AlfWorld ko WebShop) wanda ke yin rikodin 'Na danna matatar da ba daidai ba' kuma yana guje wa wannan kuskuren a sake gwadawa.
Mai warware matsalar lissafi wanda ke bincika amsarsa ta ƙarshe akan takura, lura da kuskuren alamar, kuma ya sake yin aikin matakin da ya dace.
Hatsari & Tsare-tsare
Yin aiki da ɓaryayyen tsari na iya haɓaka matsalolin da ke akwai.
Ƙungiyoyi na iya wuce gona da iri kuma su cire hukuncin ɗan adam da ake buƙata.
Ingancin na iya motsawa idan ba a ci gaba da kimanta abubuwan da aka fitar ba.
Taswirar Hanya
Taswirar tsarin aiki na yanzu kuma gano matakin mafi girman juzu'i.
Ƙayyade wuraren bincike na ɗan adam kafin cikakken aiki da kai.
Horar da masu amfani akan faɗakarwa, hanyoyin haɓakawa, da ƙa'idodi masu inganci.
Bibiyar sakamakon matakin ɗawainiya don tabbatar da ƙima mai dorewa.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Reflexion and Self-Correcting Agents quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Tunanin Kai a Madaidaicin Madaukai
Tambayoyin da ake yawan yi
What is Reflexion and Self-Correcting Agents?
Reflexion wata dabara ce inda wakilin AI ke nunawa a rubuce a kan gazawarsa kuma yana ciyar da waɗancan darussan a cikin ƙoƙari na gaba. Yana da mahimmanci saboda yana ƙyale wakilai su inganta kan ɗawainiya ba tare da sake horar da ƙirar da ke ƙasa ba.
Menene ma'anar siffa ta yadda wakilin Reflexion 'koyi'?
Tunani wani lokaci ana kiransa 'koyan ƙarfafawa na magana' saboda ana adana darussa azaman rubutun yaren halitta a cikin ƙwaƙwalwar ajiya, ba a sanya su cikin sigogin ƙirar ba.
A cikin tsarin Reflexion, menene Evaluator yake yi?
Mai kimantawa (gwajin naúrar, rajistan wasa daidai, ko alƙali na LLM) yana samar da siginar cewa matakin Tunanin Kai ya juya zuwa darasi na rubutu.
Me yasa ingancin siginar kimantawa ke da mahimmanci a cikin Reflexion?
Idan mai kimantawa ba abin dogaro ba ne, wakili na iya rubuta tunani mai ƙarfin gwiwa dangane da mummunan ra'ayi, yana jagorantar yunƙurin gaba ta hanyar da ba daidai ba.
A wanne ma'auni ne gyaran kai na salon Reflexion ya inganta musamman inganta ƙimar wucewar coding?
HumanEval alama ce ta ƙira-ƙira, kuma barin wakili ya yi kuskure a cikin gwaje-gwaje da yawa ya ɗaga ƙimar wucewa sama da aikin harbi ɗaya.
Wanne babban haɗari ne na gaske tare da wakilai masu gyara kansu?
Ba tare da kyakkyawar ƙa'idar tsayawa ba, wakili na iya ci gaba da bitar ingantattun amsoshi, ɓata lissafi kuma wani lokacin yana wulakanta ingantaccen fitarwa.