Overview
Modal ipuratifomu yegore isina server inoita kuti vanogadzira vamhanye kodhi yePython, kusanganisira maGPU anoremerwa, mugore nekuwedzera anoshongedza kune basa. Izvo zvine basa nekuti zvinobvisa marwadzo emidziyo, zvivakwa, uye kuyera kuitira kuti AI nezvikwata zvedata zvikwanise kuendesa modhi uye batch mabasa mumaminitsi.
Modal Labs inonzwisiswa zvakanyanya mumamiriro ehurongwa, kuwana modhi, sarudzo dzepuratifomu, uye ecosystem kudyidzana.
Deep Dive
Yakavambwa muna 2021 naErik Bernhardsson (mugadziri weSpotify's Annoy raibhurari uye Luigi) uye Akshat Bubna, Modal inotarisa iyo yekuvandudza-chiitiko gap muML zvivakwa. Iwe unotsanangura nharaunda yako, zvinotsamira, uye hardware zvakananga muPython, uye Modal inovaka midziyo, inopihwa maCPU kana maGPU, uye inomhanyisa kodhi yako painoda, kukwira kumazana emidziyo uye kudzokera pasi kusvika zero. Chimiro chayo chekumira itsika yemudziyo yekumhanya uye faira system yakagadzirirwa sub-yechipiri kutonhora kunotanga, inozivikanwa inorwadza nzvimbo isina server. Modal yakakurumbira kune modhi inference endpoints, kunyatso-tuning, batch process, yakarongwa mabasa (cron), uye webhu endpoints. Kubhadhara kuri pasekondi yega yega yekombuta chaiyo inoshandiswa. Inokwikwidza zvine musoro neAWS Lambda, SageMaker, uye Runpod, asi inosimbisa kodhi-yekutanga, Pythonic workflow.
Technical Insight
Modal's kiyi yeinjiniya kubudirira inokurumidza kutonhora kunotanga: yakavaka tsika yemidziyo stack uye ine usimbe-kurodha faira system kuitira kuti midziyo igone kutenderera mumasekonzi kwete maminetsi, kunyangwe iine maremu mahombe emhando. Vagadziri vanotsanangura mifananidzo uye GPU zvinodiwa mukodhi; Modal snapshots uye cache izvi, wobva waita autoscales mudziyo replicas kufananidza unouya mutoro uye zvikero kune zero kana zvisina basa, saka unobhadhara chete compute yakanyatso shandiswa.
Mastering Modal Labs
Modal ipuratifomu yegore isina server inoita kuti vanogadzira vamhanye kodhi yePython, kusanganisira maGPU anoremerwa, mugore nekuwedzera anoshongedza kune basa. Izvo zvine basa nekuti zvinobvisa marwadzo emidziyo, zvivakwa, uye kuyera kuitira kuti AI nezvikwata zvedata zvikwanise kuendesa modhi uye batch mabasa mumaminitsi. Modal Labs inonzwisiswa zvakanyanya mumamiriro ehurongwa, kuwana modhi, sarudzo dzepuratifomu, uye ecosystem kudyidzana. Kuti uvake kunzwisisa kwakadzama, bata Modal Labs semuenzaniso wekushandisa, kwete chinhu chimwe chete: tsanangura zvinodiwa, kujekesa fungidziro, uye patsanura izvo zvinogona kuitwa nehurongwa hwakavimbika kubva kune zvichiri kuda kutonga kwenyanzvi.
Mukuita, zvikwata zvakasimba zvinoshandisa Modal Labs zvinoongorora zano revatengesi, kuvimbika kwemepu yemugwagwa, uye njodzi yekuvhara isati yaita. Ivo vanonyora zvakajeka maitiro ebudiriro, bvunzo vachipokana ne data rechokwadi uye mafambiro ebasa, uye iterate zvichibva pane zvakacherechedzwa maitiro ekutadza kwete kuhwina-nguva imwe chete yebhenji. Apa ndipo apo kunzwisisa kwe theoretical kunoshanduka kuve kugona kwakasimba pane chigadzirwa, mutemo, uye mashandiro.
Mamepu emigwagwa emutengesi anopesvedzera izvo izvo timu yako inogona kugadzira inotevera. Panguva imwecheteyo, zviziviso zveLaunch zvinogona kupfuura kugadzikana mune chaiyo yekugadzira workflows. Nzira yakatsiga ndeyekubatanidza kukurumidza kuyedza nekutonga: mhanyisa vatyairi vendege, tora humbowo, buritsa matanda esarudzo, uye urambe uchivandudza chengetedzo semaitiro emuenzaniso, zvinotarisirwa nemushandisi, uye zvinodikanwa zvekutonga.
Strategic Impact
Mamepu emigwagwa emutengesi anopesvedzera izvo izvo timu yako inogona kugadzira inotevera.
Mamepu emigwagwa emutengesi anopesvedzera izvo izvo timu yako inogona kugadzira inotevera. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Mamiriro ezvekutengeserana uye sarudzo dzekuendesa dzinokanganisa mutengo wenguva refu uye njodzi.
Mamiriro ezvekutengeserana uye sarudzo dzekuendesa dzinokanganisa mutengo wenguva refu uye njodzi. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Kambani inokurudzira inogadzirisa kusarudzika kwechigadzirwa, mamiriro ekuchengetedza, uye kuvhurika.
Kambani inokurudzira inogadzirisa kusarudzika kwechigadzirwa, mamiriro ekuchengetedza, uye kuvhurika. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Real-World Implementation
Mugadziri anoputira mufananidzo-chizvarwa basa neModal decorator uye pakarepo anowana autoscaling GPU-inotsigirwa newebhu endpoint.
Chikwata chedata chinoita basa rehusiku batch pazviuru zvemafaira uchishandisa Modal's cron kuronga uye fan-out parallelism.
Iyo AI yekutanga-inonongedza yakavhurika modhi paModal GPU, ichibhadhara pasekondi uye kukwira kusvika zero kana basa rapera.
Chikuva chemumiririri inoshandisa Modal sandboxes kuita zvakachengeteka zvisina kuvimbika, AI-yakagadzirwa kodhi mumidziyo yakasarudzika.
Maitiro Ekuita
Modal Labs mukuita
Mugadziri anoputira mufananidzo-chizvarwa basa neModal decorator uye pakarepo anowana autoscaling GPU-inotsigirwa newebhu endpoint.
Mugadziri anoputira mufananidzo-wekuita basa neModal decorator uye pakarepo anowana autoscaling GPU-inotsigirwa webhu endpoint Matimu anowanzo kuwana mhedzisiro iri nani kana achinge atsanangura mhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi emupendero, uye kuteedzera zvese zvakawanikwa zvechigadzirwa uye kukanganisa mutengo nekufamba kwenguva.
Modal Labs mukuita
Chikwata chedata chinoita basa rehusiku batch pazviuru zvemafaira uchishandisa Modal's cron kuronga uye fan-out parallelism.
Chikwata chedata chinomhanyisa basa rehusiku batch pazviuru zvemafaira uchishandisa Modal's cron kuronga uye fan-out parallelism Matimu anowanzo kuwana mhedzisiro iri nani kana achinge atsanangura emhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi emupendero, uye kuteedzera zvese zvakawanikwa zvechigadzirwa uye mutengo wekukanganisa nekufamba kwenguva.
Modal Labs mukuita
Iyo AI yekutanga-inonongedza yakavhurika modhi paModal GPU, ichibhadhara pasekondi uye kukwira kusvika zero kana basa rapera.
Iyo AI yekutanga-inonongedza yakavhurika modhi paModal GPUs, ichibhadhara pasekondi uye kukwira kusvika zero kana basa rapera Matimu anowanzo kuwana mhedzisiro iri nani kana achinge atsanangura zvikumbaridzo zvemhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi emupendero, uye kuteedzera zvese zvakawanikwa zvechigadzirwa uye kukanganisa mutengo nekufamba kwenguva.
Modal Labs mukuita
Chikuva chemumiririri inoshandisa Modal sandboxes kuita zvakachengeteka zvisina kuvimbika, AI-yakagadzirwa kodhi mumidziyo yakasarudzika.
Chikuva chemumiririri chinoshandisa Modal sandboxes kuita zvakachengeteka kusavimbika, AI-yakagadzirwa kodhi mumidziyo yakasarudzika Matimu anowanzo kuwana mhedzisiro iri nani kana achinge atsanangura emhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi emupendero, uye kuteedzera zvese zvakawanikwa zvechigadzirwa uye mutengo wekukanganisa nekufamba kwenguva.
Njodzi & Guardrails
Zviziviso zvekutanga zvinogona kupfuura kugadzikana mune chaiyo yekugadzira workflows.
Mitengo yeAPI kana shanduko yepolicy inogona kukanganisa fungidziro husiku.
Kutsamira kune mumwe-mutengesi kunowedzera kukiya-mukati uye mari yekufambisa.
Implementation Roadmap
Ongorora vanopa uchishandisa ako ega mabasa uye dataset.
Ongorora vanopa uchishandisa ako ega mabasa uye dataset. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Wongorora zvakavanzika, chengetedzo, uye mazwi emutemo usati wabatanidzwa.
Wongorora zvakavanzika, chengetedzo, uye mazwi emutemo usati wabatanidzwa. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Chengetedza chirongwa chekudzokera kumashure kune mamodheru kana vatengesi.
Chengetedza chirongwa chekudzokera kumashure kune mamodheru kana vatengesi. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Tarisa zvinyorwa zvekuburitsa kuitira kuti shanduko yemigwagwa isashamise zvikwata.
Tarisa zvinyorwa zvekuburitsa kuitira kuti shanduko yemigwagwa isashamise zvikwata. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.