Ubuyobozi bwa tekiniki

Slurm ya AI Amahugurwa

Slurm nisoko rifunguye-ryakazi rishinzwe gucunga gahunda no gukora imirimo kumasoko yo kubara cyane, kandi byahindutse amahitamo asanzwe mumahugurwa manini ya AI.

Umva iki gitaboAI-byavuzwe · ~2 min

Kuriyi page2 min soma
  1. Incamake
  2. Kwibira cyane
  3. Gushyira mu bikorwa Isi
  4. Ejo hazaza ha Slurm kumasomo ya AI
  5. Kubishyira mubikorwa
  6. Komeza Ubushakashatsi
  7. Ibibazo bikunze kubazwa

Incamake

Nibyingenzi kuko ikwirakwiza rwose imyitozo nini ikora ibihumbi bya GPU.

Kwibira cyane

Slurm (Byoroheje Linux Utility for Resource Management) yatangiriye muri supercomputing none iha imbaraga amatsinda menshi yo guhugura AI. Abakoresha batanga ibyiciro byanditse hamwe na sbatch, basaba ibikoresho nka node na GPUs hamwe nubuyobozi nka --gres = gpu: 8, na Slurm umurongo, bashyira imbere, bagatangira akazi. Srun itangiza ibyara inzira ihuza inzira, ikomatanya muburyo busanzwe hamwe na PyTorch DDP na NCCL. Slurm ikurikirana ibaruramari ryumutungo, ikurikiza neza-kugabana no kugabanya imipaka, kandi ikemura gahunda yo gusubira inyuma kugirango uhindure imirimo mito mu cyuho. Ku myitozo yicyitegererezo cyumupaka, amakipe yishingikiriza kuri Slurm gucunga ibihumbi bya GPU, gutangira kuri bariyeri nyuma yo kunanirwa, no kubika ubushobozi bwabigenewe kumara ibyumweru byinshi.

Gushyira mu bikorwa Isi

Laboratoire yumupaka itangiza ibyumweru byinshi byamahugurwa ikora ibihumbi n'ibihumbi GPU hamwe ninyandiko imwe ya sbatch isaba amajana.

Umushakashatsi atanga 'srun --gres = gpu: 8' gufata GPU umunani kumurongo umwe kugirango igeragezwa rya PyTorch DDP.

Guteganya gusubira inyuma umwanya muto wo gusuzuma akazi muri GPU idafite akazi mugihe amahugurwa manini yabitswe ategereje gutangira.

Nyuma yuko node yananiwe gukora hagati, Slurm isaba akazi kandi igakomeza kuva kuri bariyeri iheruka aho gutangira.

Ejo hazaza ha Slurm kumasomo ya AI

Slurm ikomeje kongeramo ibicu biturika, inkunga ya kontineri ikoresheje Pyxis na Enroot, hamwe nibiranga GPU-izi neza. Nkuko ihuriro rya AI rigera ku 100.000-wongeyeho GPUs, tegereza kwihanganira amakosa akomeye, kugenzura byikora-gutangiza, hamwe nakazi ka elastike gahinduka nyuma yo gutsindwa. Amashyirahamwe menshi ubu akoresha Slurm kuruhande cyangwa munsi ya Kubernetes, kandi gahunda ya Hybrid igamije guhuza imikorere ya HPC hamwe nigicu-kavukire cyoroshye kugirango imyitozo ihore nini.

Kubishyira mubikorwa

Impamvu ari ngombwa

  • Igiciro na bije. Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
  • Ibyemezo bisobanutse. Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
  • Kugenzura ubuziranenge. Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.

Witondere

  • Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
  • Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
  • Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.

Intambwe ikurikira

  1. Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
  2. Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
  3. Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
  4. Tegura inzira yo gusubiza ibyabaye mbere yo gupima.

Komeza Ubushakashatsi

Ibaruwa y'amakuru y'ubuntu

Ibuka amakuru ya buri munsi ya AI

Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.

Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.

Isuzume

Take the Slurm for AI Training Clusters quiz

Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.

Tangira ikibazo

Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano

Ibibazo bikunze kubazwa

Slurm niki kumasomo yo guhugura AI?

Slurm nisoko rifunguye-ryakazi rishinzwe gucunga gahunda no gukora imirimo kumasoko yo kubara cyane, kandi byahindutse amahitamo asanzwe mumahugurwa manini ya AI. Nibyingenzi kuko ikwirakwiza rwose imyitozo nini ikora ibihumbi bya GPU.

Ni irihe tegeko abakoresha basanzwe bakoresha kugirango batange akazi kamwe muri Slurm?

sbatch itanga inyandiko yinyandiko isobanura ibikoresho namabwiriza kumurimo kumurongo wa Slurm.

Nigute akazi ka Slurm gasaba GPUs?

Sisitemu Rusange (GRES) sisitemu ireka imirimo isaba GPU mu buryo bweruye, urugero --gres = gpu: 8.

Nibihe Slurm ifata ibyemezo byingengabihe?

slurmctld ni mugenzuzi daemon uteganya imirimo, mugihe slurmd ikora kuri buri node kugirango itangire imirimo.

Why can srun help launch distributed training tasks inside a Slurm allocation?

srun launches task steps in the allocation and exposes Slurm task information; distributed frameworks may still require explicit rendezvous settings.

Niyihe ntego yo gusubira inyuma muri Slurm?

Backfill itezimbere imikoreshereze ihuza imirimo mito muguteganya icyuho mugihe cyose badasubiza inyuma imirimo yabitswe.