Ci bi mu melGis bi ci topp
Medical Large Language Models
IA làkk
Làkk AI GUIDE
Mën-mën yuy feeñ mooy mën-mën yiy feeñ ci saasi ci misaali làkk yu mag yi ginaaw bi ñu weesee benn eskaal, doonte misaal yu ndaw yi wone wuñu leen benn màndarga.
Déglul tegtal biiIA-nettali · ~2 min
They matter because they make capabilities hard to predict from small-scale experiments.
Ñu siiwal ko ci benn téere bu Wei ak ay naataangoom bind ci 2022, génne gi dafay wax ci liggéey yu performance yi di des ci wetu saas ngir model yu gëna ndaw ba noppi di tëb bu baax su model bi jéggee benn dayo ci parametre yi, done yi, wala calcul yi. Ay misaal yuñ joxe bokkuna ci xayma yu bari, yenn tegtali xalaat, ak topp tegtal yu bees. Li ci gënoon fës mooy ñàkka wéy: mën mën bi nekkul woon luy yokk ndànk, dafa melni lu amul ba noppi nekk. Benn toppu bu 2023 bu Schaeffer ak ay naataangoom wax ni yenn feeñte yi bokk nañu ci ay mbiri natt, ndax ay metrik yu dëgër yu mel ni exact-match dañuy juum ci ay tëb yu gaaw yuy nuru lu nooy ci suufu poñ yu gëna woyof. Werante bi soppali na anam wi gëstukat yi di joxee rapoor ci resultaa yi ak tànneefi evaluation yi.
Modèle yu mag yiy saafara jafe-jafe baat yu bari te version yu ndaw yi tontu ci niveau chance.
Benn model buy jekki saa rek topp ay tegtal yu jafee xam, yu kenn musul gis ginaaw bimu jàllee benn ëttu balans.
Caden-de-pensée biy ñaax nit ñi ñu xalaat ludul su model yi yeggee ci dayo bu doy.
Gëstukat yi dañu defaraat ap tëb bu 'ci saasi' ak poñ yu xaaj ci kredi ba noppi gis courbe bu neex.
Leegi gëstukat yi dañuy boole njàngum scaling ak metrics yu bari ngir tàqale coppite fase yu dëggu yi ak artifact yi, ba noppi ñuy saytu ban kàttan mooy yegsi ci scale bi. Li gëna am solo mooy gëna mëna xam luy am ci kaaraange, ndax mën nañu am luñu xamul luy am risk. Xaarandil liggéey bu gëna bari ci yooni scaling yiy wax luy waaja am ci kanam, boole ci jëmmal benchmark bu jaar yoon suko defee ñu wax ni 'feññ' dafay wane doxalinu model bi te baña nekk benn quirk ci natt gi.
Bulletin bu amul fayda
Ñatti jaar-jaari IA yuñ firndeel bis bu nekk ci ayu-bis bi, ñu bind leen ci Àngle bu leer. Gratis ba fàww, amul yëgle.
Benn email bis bu nekk ci ayu-bis bi. Benn klik nga dindi abonemaa bi. Dunu musa jaay wala séddoo sa adres.
Nattal sa bopp
Feedback ci saasi ci bépp tontu, ak sertifikaa buñ mëna séddoo ak ID buñ mëna saytu soo jàllee ci njàng mi.
Jàppale njàngum IA te doo fay. AI Understanding mbootaay la buy def te Yàlla tax — amul yëgle, amul paywall, musul am. Defal ab sarax
Mën-mën yuy feeñ mooy mën-mën yiy feeñ ci saasi ci misaali làkk yu mag yi ginaaw bi ñu weesee benn eskaal, doonte misaal yu ndaw yi wone wuñu leen benn màndarga. Dañu am solo ndax dañu tax ñu baña mëna wax luy am ci jàngat yu ndaw.
The cited work described apparently sharp capability changes for some tasks.
The follow-up argues nonlinear or discontinuous metrics can create apparent abrupt jumps.
The study explains that all-or-nothing metrics can exaggerate a discontinuity.
The paper reports metric changes can reveal smoother performance trends.
The research debate emphasizes metric choice and better statistics.
Weyal di jàng
Tann nañu yeneen njiit ngir topic bii
Ci bi mu melGis bi ci topp
Medical Large Language Models
IA làkk