Abubuwan Amfani da Kwamfuta
Masu amfani da kwamfuta suna aiki da kwamfuta kamar yadda mutum yake yi: kallon allo, motsa siginan kwamfuta, dannawa, da bugawa.
Dubawa
This lets AI use any software with a graphical interface, even apps with no API.
Zurfafa nutsewa
Wakilin mai amfani da kwamfuta (CUA) yana sarrafa ainihin tebur ko kama-da-wane ta hanyar allon sa da na'urorin shigar da shi maimakon ta APIs masu lamba. Samfurin yana karɓar hotunan allo na nuni, dalilai game da abin da yake gani, kuma yana fitar da ƙananan ayyuka kamar 'danna a coordinate (412, 230)', 'buga wannan rubutu', ko' gungura ƙasa'. Wannan madauki-hankali yana maimaitawa: yi, ɗora sabon hoton allo, yanke shawara na gaba. Saboda yana aiki a matakin pixel-da-keystroke, CUA na iya fitar da masu binciken gidan yanar gizo, cike fom, kewaya menus, da kuma amfani da aikace-aikacen gado waɗanda ba su fallasa wata hanyar sadarwa ta shirye-shirye. Misalai sun haɗa da Anthropic's Claude amfani da kwamfuta da OpenAI's Operator. Kasuwancin ciniki na gaske ne: karatun allo na iya zama a hankali, dannawa na iya ɓacewa, kuma ba da ikon sarrafa na'ura yana haifar da damuwa na aminci, don haka galibi suna gudana a cikin akwatin yashi ko kulawa.
Fahimtar Fasaha
Ana ba wa wakili hoton sikirin tare da ɗawainiyar, da ƙirar ƙira mai iya hangen nesa abubuwa (maɓallai, filaye) zuwa daidaitawar pixel. Yana fitar da wani tsari wanda Layer na atomatik ke aiwatarwa akan OS ko mai bincike. Bayan kowane aiki sabon hoton allo yana rufe madauki, don haka wakili ya fahimci sakamakon kafin sake yin aiki. Dogaro ya dogara sosai akan ingantacciyar ƙasa na gani da kuma kan sake gwadawa ko tabbatarwa dabaru lokacin danna ƙasa akan abin da bai dace ba.
Dabarun Tasiri
Gina zaɓuɓɓuka
Tsarin matakin aikace-aikacen yana ƙayyade ko AI yana inganta sakamako na gaske.
Ƙungiya da aikin aiki
Kyakkyawan haɗin gwiwar aiki yana haifar da ribar yawan aiki masu amfani za su iya amincewa.
Haɗari da aminci
Abubuwan da aka yi amfani da su da kyau suna rage gajiyar canji da haɗarin aiwatarwa.
Makomar Wakilan Amfani da Kwamfuta
Daidaituwa da saurin gudu za su inganta yayin da ƙira ke samun ƙwaƙƙwara a ƙaddamar da abubuwan UI kuma yayin da wasu hulɗar ke canzawa zuwa bishiyar samun dama ga sauri maimakon ɗanyen pixels. Yi tsammanin hanyoyin tsaro masu ƙarfi: tabbatarwa yana faɗakarwa kafin ayyuka masu haɗari, ƙuntataccen akwatunan yashi, da rajistan ayyukan tantancewa. Madaidaitan ma'auni na tebur da ayyukan yanar gizo suna girma, suna tura ci gaba mai iya aunawa. Tsawon lokaci, CUAs na iya haɗa ikon sarrafa pixel tare da kiran API kai tsaye, ta yin amfani da duk wanda ya fi dogara ga kowane app, yayin da yake kiyaye matakin amincewar ɗan adam don ayyuka masu mahimmanci kamar biyan kuɗi.
Aiwatar da Gaskiyar Duniya
Wakilin da ke lissafta gidan abinci ta hanyar buɗe mai bincike, kewaya wurin ajiyar wuri, ɗaukar lokaci, da shigar da bayanan tuntuɓar.
Aiwatar da rahotannin kashe kuɗi ta atomatik ta hanyar karanta raddi akan allo da buga ƙima cikin ƙa'idar lissafin tebur wacce ba ta da API.
Gwajin QA inda wakili ya danna ta hanyar shigar da aikace-aikacen yanar gizo don tabbatar da kowane maɓalli da tsari yana aiki.
Cika maimaitawa gwamnati ko fom ɗin gidan yanar gizon inshora ta hanyar karanta kowane lakabin filin da buga bayanan da suka dace.
Hatsari & Tsare-tsare
Yin aiki da ɓaryayyen tsari na iya haɓaka matsalolin da ke akwai.
Ƙungiyoyi na iya wuce gona da iri kuma su cire hukuncin ɗan adam da ake buƙata.
Ingancin na iya motsawa idan ba a ci gaba da kimanta abubuwan da aka fitar ba.
Taswirar Hanya
Taswirar tsarin aiki na yanzu kuma gano matakin mafi girman juzu'i.
Ƙayyade wuraren bincike na ɗan adam kafin cikakken aiki da kai.
Horar da masu amfani akan faɗakarwa, hanyoyin haɓakawa, da ƙa'idodi masu inganci.
Bibiyar sakamakon matakin ɗawainiya don tabbatar da ƙima mai dorewa.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Computer-Using Agents quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Tunani da Ma'aikatan Gyaran Kai
Tambayoyin da ake yawan yi
What is Computer-Using Agents?
Masu amfani da kwamfuta suna aiki da kwamfuta kamar yadda mutum yake yi: kallon allo, motsa siginan kwamfuta, dannawa, da bugawa. Wannan yana ba AI damar amfani da kowace software tare da ƙirar hoto, har ma da aikace-aikacen da ba su da API.
Ta yaya wakili mai amfani da kwamfuta ke hulɗa da software da farko?
A CUA tana tsinkayar hotunan kariyar kwamfuta kuma tana fitar da ayyukan shigarwa irin na mutum kamar dannawa da maɓalli.
Menene babban fa'idar aiki a matakin pixel-da-keystroke?
Saboda yana aiki kamar mai amfani da ɗan adam, CUA na iya fitar da gado ko aikace-aikace marasa ƙarancin API.
Menene wakilin yake karɓa don yanke shawarar mataki na gaba?
Bayan kowane aiki wakilin yana ɗaukar sabon hoton allo, yana samar da madauki-hankali.
Wanne daga cikin waɗannan shine ainihin misali na samfurin wakili mai amfani da kwamfuta?
Claude Amfani da kwamfuta da OpenAI's Operator sanannu ne masu amfani da kwamfuta.
Me yasa ake yawan amfani da na'urori masu amfani da kwamfuta a cikin wurare masu yashi?
Bayar da wakili na sarrafa kwamfuta na ainihi yana ɗaukar haɗari, don haka keɓewa da kulawa suna rage haɗarin haɗari.