Dellu ci xibaar yi
ProduitAI Understanding

GitHub Copilot yokk otomatisaasioŋ aplikaasioŋu biro jaaraleko ci jàngat jëfandikoo ordinatër

GitHub xamlena ni Copilot leegi mën na yoree aplikaasioŋu biro macOS ak Windows ci preview publik, may developpeur yi ñu joxe leeral ci njariñ yi ñu bëgg, ba noppi IA bi def ay klike, bind, scrolling ak yeneen jëfi GUI.

4 min readRead the primary source
Source-provided image accompanying GitHub Copilot adds desktop‑app automation via computer‑use preview
Këyitu xët bu njëkkSource biñ enregistre
Siiwalkat
github.blog
Lëkkalekaayu cosaan
github.bloghttps://github.blog/changelog/2026-10-01-github-copilot-can-now-interact-with-desktop-apps
Xeetu balluwaay
Këyitu njëkk - ab yëgle ofisel, këyit, dosiye, wala xëtu pàrti bu njëkk bi ñuy jàng ci saasi.
KontekstXam lii ci 60 seconde

Tambalil fii

Term yu am solo

Man-man
Variable input bu model bi di jëfandikoo ngir wax luy am.
Nattal sa boppQuiz Agent IA
Source video from github.blog · shown with attribution.

Lu xew

GitHub released a public preview of “computer use” for GitHub Copilot, available in the Copilot CLI and the Copilot desktop app for macOS and Windows. The lets the AI read accessible content from any application, click controls, type or edit text, press keys, scroll, drag, and navigate multi‑step workflows across apps that lack APIs or command‑line interfaces. The preview includes a demo where Copilot automates an expense‑report workflow in Safari. Users must approve each interaction, can set permanent allowances for trusted apps, and on macOS must grant Accessibility and Screen Recording permissions. Organization administrators can disable the capability via policy settings.

GitHub’s announcement, dated October 1 2026, describes the computer‑use capability as a public preview. It is integrated into the existing Copilot CLI and the Copilot desktop application for both macOS and Windows platforms.

The AI can perform a range of actions that mimic a human user: reading accessible UI elements, clicking buttons, entering or editing text, pressing keyboard shortcuts, scrolling, dragging items, and moving through multi‑step workflows. The is designed for apps that do not expose APIs, command‑line interfaces, or other programmatic hooks.

Interaction is gated by user consent. Copilot prompts for approval before taking control of an app, and users can review or reset permissions at any time. On macOS, the also guides users through the required Accessibility and Screen Recording permissions. Enterprise administrators can disable the feature via organization‑level settings.

The preview includes a visual example where Copilot navigates an expense‑report workflow in Safari, demonstrating end‑to‑end automation of a real‑world task.

Ay leeral ci cosaan: github.blog ↗

Lu tax mu am solo

The addition expands Copilot from code‑centric assistance to broader desktop automation, enabling developers to script repetitive GUI tasks without writing custom bots or macros. This could accelerate onboarding for legacy tools, reduce context‑switching, and lower the barrier for non‑technical staff to automate routine workflows. Because the works on any app that exposes accessibility data, it opens a pathway for AI‑driven integration with proprietary or legacy software that otherwise cannot be programmatically accessed. At the same time, granting an AI control over the desktop raises security and privacy considerations; organizations will need to manage permissions, audit logs, and policy controls to prevent unintended actions or data leakage.

By moving beyond code suggestions to direct desktop manipulation, Copilot addresses a long‑standing productivity gap for developers who must interact with GUI‑only tools. This could reduce the need for custom scripting or third‑party automation platforms.

The capability democratizes automation for legacy software that cannot be instrumented through traditional APIs, potentially extending the useful life of older enterprise applications.

Security and privacy implications are significant. Granting an AI the ability to control the desktop requires robust permission models, audit trails, and clear organizational policies to prevent accidental data exposure or malicious use.

The preview’s limited availability—requiring explicit user approval and organization‑level enablement—suggests GitHub is testing both technical feasibility and governance frameworks before a broader rollout.

Interactive Mechanism

Mekanism buy weccoo xalaat: naka lay doxee

Saytu xarala yu bees yi ci ginaaw yokkute bii ci anam wu weccoo xalaat.

Agent Lifecycle Stage:
1
User Intent & Planning: "Audit customer refund request #4092 and settle payment."
2
Tool Calling: Emits structured JSON call crm_get_transaction(id='4092').
3
Guardrail & Verification:🛡️ Paused: High-value action requires human operator sign-off.
4
Final Settlement: Refund recorded, email receipt dispatched, and audit log stored.
Core takeaway: An AI agent is not just a language model—it is a closed loop of planning, tool invocation, and environment feedback. Production systems require self-healing retries and strict human approval guardrails.
Saytu konsept buy weccoo xalaat+10 Points
AI Agents Quiz

An agent must create a draft calendar event for Tuesday at 2 p.m. Which evidence would establish the requested result?

Li nga wara seetaan ci topp

Key signals to monitor include adoption rates among individual developers and enterprise teams, the evolution of permission‑management features, and any reported misuse or security incidents. GitHub’s roadmap for expanding computer‑use to more complex multi‑app orchestrations will indicate how quickly the capability matures. Regulators and corporate IT departments may issue guidelines on AI‑driven desktop control, especially in environments handling sensitive data. Finally, competitor responses—whether other IDE or AI‑assistant vendors introduce similar GUI‑automation features—will shape the broader market for AI‑augmented productivity tools.

User and enterprise adoption metrics released by GitHub in the coming weeks.

Enhancements to permission granularity, logging, and admin controls that address security concerns.

Reports of any unintended behavior, bugs, or security incidents linked to the computer‑use .

Competitive moves from other AI‑assistant providers that may introduce similar desktop‑automation capabilities.

Regulatory or industry guidance on AI‑driven desktop control, especially in sectors handling regulated data.

Gid ak quiz yu ci méngoo

Agent IAModel IA leeral nañu koËllëgu AILuy IA?Natt li nga xam — natt quiz IA bu amul faydaSeetal benn baat IA ci sunu glossaireToppal toppukaayu génne xeetu IA
Gis nga lii am njariñ?