Awọn ile-iṣẹ Itọsọna
ServiceNow ati StarCoder
The original StarCoder models were developed by the BigCode collaboration, co-led by ServiceNow Research and Hugging Face.
Gbọ si itọsọna yiiAI-ṣe afihan · ~2 min
Lori iwe yi2 min ka
Akopọ
Their paper documents training data and model capabilities, while the OpenRAIL-M license permits use subject to stated restrictions.
Jin Dive
The 2023 BigCode paper introduced StarCoderBase and StarCoder as 15.5-billion-parameter code models with an 8,000-token context. StarCoderBase was pretrained on about one trillion tokens from The Stack, and StarCoder was produced by further fine-tuning StarCoderBase on 35 billion Python tokens. The paper describes fill-in-the-middle training, multi-query attention, data documentation, opt-out mechanisms, and release under BigCode’s OpenRAIL-M license. StarCoder2 is a later, separate model family introduced in 2024.
Real-World imuse
Agbara adaṣe adaṣe ati awọn imọran ipari koodu inu awọn afikun IDE ati awọn amugbooro olootu
Ṣiṣẹda awọn iṣẹ igbomikana, awọn idanwo ẹyọkan, ati awọn gbolohun ọrọ lati asọye ede adayeba
Titumọ tabi koodu atunṣe laarin awọn ede siseto laarin koodu koodu iṣowo kan
Ṣiṣẹ bi oluranlọwọ ifaminsi gbigbalejo fun awọn ẹgbẹ ti ko le fi koodu ohun-ini ranṣẹ si awọn API awọsanma pipade
Ọjọ iwaju ti ServiceNow ati StarCoder
Awọn awoṣe koodu n lọ si awọn ṣiṣan iṣẹ aṣoju nibiti wọn kii ṣe adaṣe adaṣe nikan ṣugbọn gbero, ṣiṣe awọn idanwo, ati ṣatunṣe iṣelọpọ tiwọn. StarCoder2, ti a ṣe ikẹkọ lori akopọ Stack v2 nla ti a ṣe pẹlu Ajogunba sọfitiwia, tọka si agbegbe agbegbe ti o gbooro ati iṣafihan data to dara julọ. Reti tcnu tẹsiwaju lori data ikẹkọ itara, awọn ọna ijade, ati mimọ iwe-aṣẹ bi iṣayẹwo ofin ti awọn awoṣe ti a ti kọ koodu ti ndagba, pẹlu isọpọ ṣinṣin sinu awọn iru ẹrọ idagbasoke ile-iṣẹ.
Fifi o sinu iwa
Kini idi ti o ṣe pataki
- Ilana olutaja. Awọn maapu opopona olutaja ni ipa kini awọn ẹya ti ẹgbẹ rẹ le kọ ni atẹle.
- Iye owo ati isuna. Awọn ofin iṣowo ati awọn aṣayan imuṣiṣẹ ni ipa lori idiyele igba pipẹ ati eewu.
- Ewu ati ailewu. Awọn imoriya ile-iṣẹ ṣe apẹrẹ awọn abawọn ọja, iduro ailewu, ati ṣiṣi.
Ṣọra fun
- Awọn ikede ifilọlẹ le ju iduroṣinṣin lọ ni awọn iṣan-iṣẹ iṣelọpọ gidi.
- Ifowoleri API tabi awọn iyipada eto imulo le fọ awọn arosinu ni alẹ.
- Igbẹkẹle olutaja ẹyọkan ṣe alekun titiipa-inu ati awọn idiyele ijira.
Next awọn igbesẹ
- Ṣe ayẹwo awọn olupese nipa lilo awọn iṣẹ ṣiṣe tirẹ ati awọn ipilẹ data.
- Ṣe atunyẹwo asiri, aabo, ati awọn ofin ofin ṣaaju iṣọpọ.
- Ṣetọju eto ipadabọ kọja awọn awoṣe tabi awọn olutaja.
- Bojuto awọn akọsilẹ itusilẹ nitoribẹẹ awọn iyipada maapu oju-ọna ma ṣe iyalẹnu awọn ẹgbẹ.
Tesiwaju Ṣiṣawari
Ìwé ìròyìn ọfẹ
Gba ìkànìyàn AI ojoojúmọ́
Ìtàn AI mẹta tó jẹ́rìí ní gbogbo owurọ́ ọjọ́ iṣẹ́, kọ́wé ní Gẹ̀ẹ́sì tó rọrùn. Ọfẹ́ fún gbogbo àkókò, kò sí ìpolówó.
Ìmeèlì kan ní gbogbo ọjọ́ iṣẹ́. Yọkúrò ní ìkànìyàn ní ìkànìyàn kan. A kò ta tàbí pín àdírẹ́sì rẹ.
Ṣe idanwo fun ara rẹ
Take the ServiceNow and StarCoder quiz
Ìdáhùn lẹ́sẹ̀kẹsẹ̀ lórí gbogbo ìdáhùn, àti iwe-ẹ̀rí tó lè pin pẹ̀lú ID tó lè jẹ́rìí lẹ́yìn tí o bá kọ́ ẹ̀kọ́.
Ṣe àtìlẹ́yìn ẹ̀kọ́ AI ọfẹ́. AI Understanding jẹ́ àjọ àìní èrè 501(c)(3) — kò sí ìpolówó, kò sí àkúnya owó, ní gbogbo àkókò. Ṣe ẹbun kan
Awọn ibeere ti a beere nigbagbogbo
Kí ni ServiceNow àti StarCoder?
The original StarCoder models were developed by the BigCode collaboration, co-led by ServiceNow Research and Hugging Face. Their paper documents training data and model capabilities, while the OpenRAIL-M license permits use subject to stated restrictions.
Awọn ajo meji wo ni o ṣe akoso iṣẹ akanṣe BigCode ti o ṣe agbekalẹ StarCoder?
BigCode jẹ igbiyanju ifowosowopo ifowosowopo nipasẹ Iwadi ServiceNow ati Face Face lati kọ sisi, awọn awoṣe koodu ti o ni idagbasoke ni ifojusọna.
Which dataset was used for StarCoderBase pretraining?
StarCoderBase was pretrained on The Stack, a large collection of permissively licensed source code.
Ilana ikẹkọ wo ni o jẹ ki StarCoder pari koodu nipa lilo ipo ni ẹgbẹ mejeeji ti kọsọ?
Fọwọsi-ni-Aarin ikẹkọ n ṣe atunṣe awọn iwe aṣẹ ki awoṣe naa kọ ẹkọ lati ṣe agbekalẹ akoko ti o padanu ti a fun ni iṣaaju ati atẹle ipo.
Ni aijọju bawo ni awoṣe flagship StarCoderBase ṣe tobi?
StarCoderBase ni o ni awọn iwọn 15.5 bilionu, iwọntunwọnsi nipasẹ awọn iṣedede aala ṣugbọn lagbara fun iwọn rẹ lori awọn iṣẹ ṣiṣe koodu.
Iru iṣapeye akiyesi wo ni StarCoder lo lati dinku iranti ati iyara iyara?
StarCoder nlo ifarabalẹ ibeere pupọ, bọtini pinpin ati awọn asọtẹlẹ iye kọja awọn ori lati ge iranti ati mu itọsi ọrọ-ọrọ gigun.
Tesiwaju kikọ
Jẹmọ awọn itọsọna
Awọn itọsọna diẹ sii ti a yan fun koko yii