Satya Nadella Unveils AI That Clicks, Types, and Navigates for You

Microsoft Corporation has rolled out a new experimental feature within Copilot Studio called “Computer Use,” designed to enable AI-powered agents to carry out tasks directly on desktop and web applications. This innovation allows the AI to click, type, and navigate through user interfaces—even where APIs don’t exist.

CEO Satya Nadella shared the announcement on X (formerly Twitter), stating that users can now create AI agents capable of performing tasks across both web and desktop environments. The technology is driven by a large language model that adapts fluidly to changes in UI layouts, ensuring consistent performance.

What makes this tool especially user-friendly is its no-code interface. Users only need to enter instructions in simple English—everything else is managed by the AI. A split-screen view even allows users to observe the AI’s actions in real-time, making it easier to refine prompts and commands.

Designed with enterprise usage in mind, Microsoft confirmed that the tool runs entirely within the Microsoft Cloud infrastructure. All user data stays securely within these boundaries and, importantly, will not be used to train any AI models.

This launch highlights Microsoft’s broader AI ambition. Nadella recently emphasized during Q2 earnings that the company’s AI segment has already hit an annual revenue run rate of $13 billion, marking a 175% increase year-over-year. He also highlighted Microsoft’s continued efforts to optimize return on investment for businesses utilizing AI.

Earlier, the company had introduced Dragon Copilot, an AI assistant tailored for healthcare professionals that integrates voice commands, ambient listening, and generative AI to streamline clinical workflows.

However, Microsoft has also faced criticism. Salesforce CEO Marc Benioff labeled Copilot as a “rebranded ChatGPT” with low adoption, raising doubts about its long-term impact. In February, Microsoft unexpectedly reduced its AI data center expansion in the US, just a month after unveiling an $80 billion investment plan for AI infrastructure.

As of now, Microsoft shares are down 7.85% year-to-date and have dropped 6.96% over the past 12 months. Despite this, analysts remain optimistic, with an average price target of $502.57. Firms like BofA Securities, UBS, and Wells Fargo project an upside of over 26%