Overview
Constitutional AI inzira ye Anthropic yekuenzanisa mamodheru vachishandisa bumbiro remitemo rakanyorwa - 'bumbiro' - saka iyo AI inotsoropodza nekugadzirisa mhinduro dzayo pachinzvimbo chekuvimba nevanhu chete kuti vatumire zvinokuvadza. Inovavarira kuita kuti mamodheru abatsire uye asakuvadze nevashandi vashoma.
Constitutional AI chikamu chemutauro-AI stack inoshandiswa kuverenga, kugadzira, kuronga, uye kushandura zvinyorwa uye kutaura pamwero.
Deep Dive
Kurongeka kwechinyakare kunotsamira pakusimbisa kudzidza kubva kumhinduro dzevanhu (RLHF), uko vanhu vanoisa mizhinji yemhando yezvinobuda, kusanganisira zvinoshungurudza, kudzidzisa modhi zvekudzivisa. Bumbiro reMitemo AI rinoderedza mutoro iwoyo nekupa modhi iri rondedzero yakajeka yemisimboti yakanyorwa yakatorwa kubva kunzvimbo dzakaita seUN Declaration of Human Rights uye kuvimba-ne-chengetedzo yakanakisa maitiro. Kudzidzira kune matanho maviri. Chekutanga, chinhanho chinotariswa: modhi yacho inoburitsa mhinduro, yozoitsoropodza ichipesana nebumbiro remutemo woinyora zvakare kuti ive nani; mhinduro dzakazvivandudza idzi dzinoshandiswa kuigadzirisa. Chechipiri, nhanho yekusimbisa-yekudzidza, RLAIF, apo modhi pachayo inoisa maviri emhinduro zvinoenderana nebumbiro, uye iyo AI-yakagadzirwa nedata rekuda inodzidzisa mubairo modhi. Misimboti iri pachena uye inogadzirika, ichiita kuti hunhu hutarise modhi yacho pane kuvanzwa mukati memavara emunhu asina kujeka.
Technical Insight
Zvikamu zviviri izvi zvinowanzodaidzwa kuti SL-CAI uye RL-CAI. Mukudzidza kwakatariswa, 'critique-and-review' loop inoita kuti modhi iwane apo mhinduro yayo pachayo inotyora musimboti wemuenzaniso woinyora patsva, ichigadzira dhata rekudzidziswa pasina kukuvadza kwevanhu. Muchikamu cheRL, yechipiri modhi inotonga kuti ndeipi yemhinduro mbiri zviri nani inotevera bumbiro, ichigadzira AI predo labels (RLAIF) inodzidzisa modhi yemubairo inoshandiswa mune yakajairwa RL. Bumbiro nderegwara-gwaro rakapinzwa mukurudziro, saka kushandura maitiro emodhi kunogona kuve kwakananga sekugadzirisa misimboti.
Kudzidzira Constitutional AI
Constitutional AI inzira ye Anthropic yekuenzanisa mamodheru vachishandisa bumbiro remitemo rakanyorwa - 'bumbiro' - saka iyo AI inotsoropodza nekugadzirisa mhinduro dzayo pachinzvimbo chekuvimba nevanhu chete kuti vatumire zvinokuvadza. Inovavarira kuita kuti mamodheru abatsire uye asakuvadze nevashandi vashoma. Constitutional AI chikamu chemutauro-AI stack inoshandiswa kuverenga, kugadzira, kuronga, uye kushandura zvinyorwa uye kutaura pamwero. Kuvaka kunzwisisa kwakadzama, tora Bumbiro reMitemo AI semuenzaniso wekushandisa, kwete chinhu chimwe chete: tsanangura zvinodikanwa, kujekesa fungidziro, uye patsanura zvinogona kuitwa nehurongwa hwakavimbika kubva kune zvichiri kuda kutonga kwenyanzvi.
Mukuita, zvikwata zvakasimba zvinoshandisa Constitutional AI dhizaini inosimudzira, kudzoreredza, uye kuongorora zvishwe seimwe yakabatanidzwa yekutaurirana system. Ivo vanonyora zvakajeka maitiro ebudiriro, bvunzo vachipokana ne data rechokwadi uye mafambiro ebasa, uye iterate zvichibva pane zvakacherechedzwa maitiro ekutadza kwete kuhwina-nguva imwe chete yebhenji. Apa ndipo apo kunzwisisa kwe theoretical kunoshanduka kuve kugona kwakasimba pane chigadzirwa, mutemo, uye mashandiro.
Mutauro workflows inogona kufamba nekukurumidza pasina kupira kuenderana. Panguva imwecheteyo, chokwadi cheHallucified chinogona kupinda chinyararire mishumo, kuyerera kwetsigiro, kana kutsvagisa zvinobuda. Nzira yakatsiga ndeyekubatanidza kukurumidza kuyedza nekutonga: mhanyisa vatyairi vendege, tora humbowo, buritsa matanda esarudzo, uye urambe uchivandudza chengetedzo semaitiro emuenzaniso, zvinotarisirwa nemushandisi, uye zvinodikanwa zvekutonga.
Strategic Impact
Mutauro workflows inogona kufamba nekukurumidza pasina kupira kuenderana.
Mutauro workflows inogona kufamba nekukurumidza pasina kupira kuenderana. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Inopamhidzira kupinda mumitauro yese nemataera ekutaurirana.
Inopamhidzira kupinda mumitauro yese nemataera ekutaurirana. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Zvikwata zvinogona kupedza nguva yakawanda pakutonga uku otomatiki ichibata kudzokorora.
Zvikwata zvinogona kupedza nguva yakawanda pakutonga uku otomatiki ichibata kudzokorora. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Real-World Implementation
Kudzidzisa chatbot kuramba kubatsira kuvaka chombo nekuita kuti ishoropodze mhinduro yayo pachayo vachipesana netsika yekudzivisa kukuvadza uye kuinyora zvakare.
Kutsiva inodhura yevanhu tsvuku-timu rekodhi yezvinobuda zvine muchetura neAI-yakagadzirwa dhata rekuda (RLAIF) inotungamirwa nebumbiro.
Kugadzirisa musimboti wakanyorwa kuti ugadzirise kungwarira kwakaita modhi, wobva waona shanduko yemaitiro pasina kunyora zviuru zvemienzaniso.
Kumhanyisa mapoinzi edzidziso apo veruzhinji vanopa mazano anoumba bumbiro remutemo
Maitiro Ekuita
Constitutional AI mukuita
Kudzidzisa chatbot kuramba kubatsira kugadzira chombo nekuita kuti ishoropodze mhinduro yayo pachayo vachipesana netsika yekudzivisa kukuvadza uye kuinyora zvakare.
Kudzidzisa chatbot kuramba kubatsira kuvaka chombo nekuita kuti ishoropodze mhinduro yayo pachayo ichipokana nemusimboti wekudzivirira kukuvadza uye kuinyora zvakare Matimu anowanzo kuwana mhedzisiro iri nani kana achinge atsanangura zvikumbaridzo zvemhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi ekumucheto, uye kuteedzera zvese zvakawanikwa zvechigadzirwa uye mutengo wekukanganisa nekufamba kwenguva.
Constitutional AI mukuita
Kutsiva inodhura yevanhu tsvuku-timu yakanyorwa yezvinobuda zvine muchetura neAI-yakagadzirwa nedatha yekuda (RLAIF) inotungamirwa nebumbiro.
Kutsiva inodhura yevanhu tsvuku-timu yekunyorwa kwezvinobuda zvine muchetura neAI-yakagadzirwa kufarira data (RLAIF) inotungamirwa nebumbiro Matimu anowanzo kuwana mibairo iri nani kana achinge atsanangura zvikumbaridzo zvemhando yepamusoro kumberi, chengeta nzira yekukwira kwevanhu yemakesi emupendero, uye kuteedzera zvese zvakawanikwa zvechigadzirwa uye kukanganisa mutengo nekufamba kwenguva.
Constitutional AI mukuita
Kugadzirisa musimboti wakanyorwa kuti ugadzirise kungwarira kwakaita modhi, wozoona shanduko yemaitiro pasina kunyora zviuru zvemienzaniso.
Kugadzirisa musimboti wakanyorwa kuti ugadzirise kuchenjerera kwakaita modhi, wozoona shanduko yemaitiro pasina kunyora zviuru zvemienzaniso Matimu anowanzo kuwana mhedzisiro iri nani kana achinge atsanangura emhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi ekumucheto, uye kuteedzera zvese zvakawanikwa zvechigadzirwa uye mutengo wekukanganisa nekufamba kwenguva.
Constitutional AI mukuita
Kumhanyisa mapoinzi edzidziso apo veruzhinji vanopa mazano anoumba bumbiro remutemo.
Kumhanyisa maekisesaizi ezvibodzwa apo veruzhinji vanoronga zviga zvinoumba bumbiro remuenzaniso Matimu anowanzo kuwana mibairo iri nani kana achinge atsanangura mabindu emhando kumberi, anochengeta nzira yekukwira kwevanhu yemakesi emupendero, uye kuteedzera zvese zvakawanikwa zvechigadzirwa nemitengo yekukanganisa nekufamba kwenguva.
Njodzi & Guardrails
Chokwadi chehuroyi chinogona kupinda chinyararire mishumo, kuyerera kwetsigiro, kana tsvakiridzo.
Kunzwa nekukasira kunogona kugadzira mhedzisiro isingaenderane pane zvikumbiro zvakafanana.
Sensitive text data inogona kuburitswa kana zvidhiraivho zvisina kusimba.
Implementation Roadmap
Tsanangura chimiro chekubuda, toni, uye mhando zviyero usati waburitsa.
Tsanangura chimiro chekubuda, toni, uye mhando zviyero usati waburitsa. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Mhinduro dzepasi neakavimbika masosi pese pazvine basa.
Mhinduro dzepasi neakavimbika masosi pese pazvine basa. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Chengetedza ongororo yekuongorora yemunhu kune yakakwira-stake zvinobuda.
Chengetedza ongororo yekuongorora yemunhu kune yakakwira-stake zvinobuda. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Tevera maitiro ekutadza uye dzidzisazve kukurudzira kana mafambiro ebasa nguva nenguva.
Tevera maitiro ekutadza uye dzidzisazve kukurudzira kana mafambiro ebasa nguva nenguva. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.