UPDATE: Microsoft has just announced its latest AI feature, “Click To Do,” designed exclusively for Copilot+ PCs. This innovative tool is set to revolutionize how users interact with AI on Windows, providing immediate access to contextual actions directly from their screens.
Users can activate Click To Do by holding down the Windows key and clicking with the left mouse button, or by simply pressing Windows key + Q for a keyboard shortcut. However, this feature is only available on Copilot+ PCs—if nothing happens, your device does not support it. Once activated, an outline appears around the screen, highlighting all text and images for easy selection and action.
Why This Matters: With Click To Do, Microsoft is shifting its focus from the criticized Windows Recall to a more user-friendly approach that prioritizes privacy. Unlike its predecessor, Click To Do functions on-demand, meaning it does not operate in the background, enhancing user control and security.
Click To Do utilizes advanced optical character recognition (OCR) technology to make text on the screen selectable. Users can perform various actions, such as “Summarize Text” or “Search the web,” directly from the highlighted content. While many actions are processed locally on the device’s neural processing unit, certain functions, including web searches, will send data to Microsoft servers only upon user request.
Key Features Include:
– **Text Actions:** Users can select text to create lists, summarize, or rewrite content in different tones, leveraging the Phi Silica language model.
– **Image Tools:** Clicking on images allows users to apply AI-powered actions, such as blurring backgrounds or erasing objects.
– **Ask Copilot:** This action enables users to send selected text or images to Microsoft’s Copilot AI for further assistance.
What’s Next? Microsoft is rapidly expanding the capabilities of Click To Do. Upcoming features will allow users to integrate prompts directly within the tool, enabling a more robust interaction with AI. Planned enhancements include the ability to detect tables for direct export to Microsoft Excel and improved integration with the Copilot AI chatbot.
Microsoft acknowledges that while Click To Do shows promise, some users, including tech journalist Chris Hoffman, still prefer traditional methods like copy-and-paste for efficiency.
Turning Off Click To Do: If users find the Click To Do shortcut disruptive, especially during gaming, it can be easily disabled through Settings > Privacy & Security.
As Microsoft continues to innovate, Click To Do represents a significant move toward seamless AI integration on Windows. With growing features and user-centered design, this tool aims to redefine how users engage with technology.
Stay tuned for more updates as Microsoft rolls out additional functionalities for Click To Do, solidifying its position as a leader in AI-driven computing.