Ubuyobozi bwa tekiniki

Ray yo gukwirakwiza AI

Ray ni isoko ifunguye yorohereza gupima akazi ka Python na AI kuva kuri mudasobwa igendanwa kugeza kumashini ibihumbi.

Incamake

Ray ni isoko ifunguye yorohereza gupima akazi ka Python na AI kuva kuri mudasobwa igendanwa kugeza kumashini ibihumbi. Nibyingenzi kuko itanga inzira yoroshye, ihuriweho yo gukwirakwiza amahugurwa, guhuza, gutunganya amakuru, no gutanga utanditse kode yawe kuri buri.

Ray kuri Ikwirakwizwa rya AI ni tekiniki yubaka tekinike igira ingaruka kumiterere yicyitegererezo, igiciro cyibikorwa remezo, ubukererwe, no kwizerwa mubipimo.

Kwibira cyane

Ray igitekerezo cyibanze ni uguhindura imikorere isanzwe ya Python namasomo mubice byagabanijwe hamwe nimpinduka nto. Igikorwa cyaranzwe nk 'kure' umurimo 'ikora idahwitse kumukozi uwo ari we wese muri cluster; icyiciro cyaranzwe nk '' umukinnyi 'wa kure gihinduka serivisi ya leta iba ku mukozi. Ray isubiza ejo hazaza horoheje (ibintu bifatika) kandi ikemura gahunda, kugenda kwamakuru ukoresheje ububiko busangiwe, hamwe no kwihanganira amakosa. Hejuru yibi byicaro byibitabo byubatswe byubatswe: Ray Gariyamoshi yo gukwirakwiza amahugurwa yicyitegererezo, Ray Tune yo gushakisha hyperparameter, Ray Data yo gutambutsa imiyoboro yamakuru, RLlib yo kwiga gushimangira, na Ray Serve kubikorwa byerekana urugero rwiza. Ibi bituma cluster imwe ikora ML yakazi yose irangira kurangira.

Ubushishozi

Ibyingenzi byingenzi ni imirimo (idafite ubwenegihugu, igereranya imikorere ihamagarwa) hamwe nabakinnyi (abakozi ba leta bafata ibintu nkicyitegererezo kiremereye cyangwa compteur). Iyo uhamagaye akazi ka kure, Ray ahita asubiza ejo hazaza kandi ateganya akazi murwego rwa CPU / GPUs; uhamagara ray.get () kugirango uzane ibisubizo. Ikwirakwizwa mububiko bwibikoresho hamwe na zeru-kopi yibikoresho bisangiwe byibutsa ibintu binini nka array hagati yabakozi neza, birinda gukurikiranwa kenshi no gukora imiyoboro iremereye ya AI byihuse.

Kumenya Ray kubitangwa na AI

Ray ni isoko ifunguye-yorohereza gupima akazi ka Python na AI kuva kuri mudasobwa igendanwa kugeza kumashini ibihumbi. Nibyingenzi kuko itanga inzira yoroshye, ihuriweho yo gukwirakwiza amahugurwa, guhuza, gutunganya amakuru, no gutanga utanditse kode yawe kuri buri. Ray kuri Ikwirakwizwa rya AI ni tekinoroji yubaka tekinike igira ingaruka kumiterere yicyitegererezo, igiciro cyibikorwa remezo, ubukererwe, no kwizerwa mubipimo. Kugira ngo wubake byimbitse, fata Ray kuri AI ikwirakwizwa nkicyitegererezo gikora, ntabwo ari ikintu kimwe: gusobanura ibyagezweho, gusobanura ibitekerezo, no gutandukanya ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.

Mubimenyerezo, amakipe akomeye akoresha Ray kuri Ikwirakwizwa rya AI atezimbere imyubakire, amakuru, hamwe nibikorwa remezo birwanya kwizerwa nigiciro. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.

Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka. Mugihe kimwe, Guhindura igipimo kimwe gishobora guhisha intege nke za sisitemu. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.

Ingaruka z'Ingamba

Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.

Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.

Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.

Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Kazoza ka Ray kuri AI yatanzwe

Ray yabaye inkingi ya AI nini nini, ikoreshwa cyane mumahugurwa no gukorera imiterere nini yindimi. Witegereze iterambere muri serivisi yihariye ya LLM (Ray Serve hamwe na vLLM), gahunda ya GPU itandukanye, gahunda yo guhuza ibiyaga byamakuru na Kubernetes ukoresheje KubeRay, hamwe na autoscaling nziza kubikorwa byinshi bitanga akazi. Mugihe icyitegererezo gikura, uruhare rwa Ray mugutegura amahugurwa menshi, imiyoboro ya RLHF, hamwe nu mwanzuro wibice byihuta byihuta byiyongera.

Gushyira mu bikorwa Isi

Gukoresha Ray Tune kugirango ushakishe amajana ya hyperparameter ikomatanya murwego rwa GPU kugirango ubone imiterere myiza yicyitegererezo

Koresha Ray Gariyamoshi kugirango ukwirakwize amahugurwa yuburyo bwimbitse bwo kwiga muri GPUs nyinshi hamwe na code ntoya

Kubaka umuyoboro-wuzuye hamwe na Ray Data kugirango utange amamiriyoni yinyandiko ubinyujije mubyitegererezo hejuru ya cluster

Kohereza moderi nyinshi inyuma yumurongo umwe wa autoscaling hamwe na Ray Serve kugirango ukemure ibicuruzwa bihinduka

Uburyo bwo Gushyira mu bikorwa

Ray yo gukwirakwiza AI mubikorwa

Gukoresha Ray Tune kugirango ushakishe amagana ya hyperparameter ihuriweho murwego rumwe rwa GPU kugirango ubone imiterere myiza yicyitegererezo.

Gukoresha Ray Tune kugirango ushakishe amajana ya hyperparameter ihuriweho hamwe murwego rwa GPU kugirango ubone uburyo bwiza bw'icyitegererezo Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.

Ray yo gukwirakwiza AI mubikorwa

Koresha Ray Gariyamoshi kugirango ukwirakwize amahugurwa yuburyo bwimbitse bwo kwiga muri GPUs nyinshi hamwe na code ntoya.

Gukoresha Ray Gariyamoshi kugirango ukwirakwize amahugurwa yuburyo bwimbitse bwo kwiga muri GPU nyinshi hamwe nu mpinduka zifite kode ntoya Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro nibiciro byigihe.

Ray yo gukwirakwiza AI mubikorwa

Kubaka umuyoboro-wuzuye hamwe na Ray Data kugirango utange amamiriyoni yinyandiko ubinyujije mubyitegererezo hejuru ya cluster.

Kubaka icyiciro-cyerekana umuyoboro hamwe na Ray Data kugirango utange amamiriyoni yinyandiko ubinyujije mucyitegererezo hakurya ya cluster Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe runaka.

Ray yo gukwirakwiza AI mubikorwa

Kohereza moderi nyinshi inyuma yumurongo umwe wa autoscaling hamwe na Ray Serve kugirango ukemure ibicuruzwa bihinduka.

Kohereza moderi nyinshi inyuma yimodoka imwe ya autoscaling hamwe na Ray Serve kugirango ikemure ibinyabiziga bigenda bihinduka Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.

Ingaruka & Kurinda

!

Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.

!

Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.

!

Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.

Igishushanyo mbonera

1

Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.

Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

2

Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.

Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

3

Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.

Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

4

Tegura inzira yo gusubiza ibyabaye mbere yo gupima.

Tegura inzira yo gusubiza ibyabaye mbere yo gupima. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

Komeza Ubushakashatsi