Latest news with #WindowsInsiders
Tom's Guide
4 days ago
- Tom's Guide
Microsoft's Copilot Vision AI can now see your whole desktop — here's what it does
Microsoft is rolling out an update to its Copilot Vision AI on Windows 11 PCs, allowing it to see your whole desktop and talk to you in real time. Coming to Windows Insiders, the update will let users share their "whole desktop with Copilot," allowing it to see what's on screen and offer contextual help. This was previously only available to use in a couple of apps at a time, but now Copilot Vision can analyze content on everything shown on a PC. Through "Desktop Share," Copilot Vision can deliver insights, answer questions on everything you do and give you tips on tasks, similar to Google's Gemini Live and Apple Intelligence. According to Microsoft, it will be able to "get tips on making improvements to your creative project, help with improving your resume, or guidance while navigating a new game," the blog post states. This Copilot Vision "Desktop Share" feature works as it says on the tin, by sharing your desktop with Copilot in real time (unlike Microsoft Recall, which captures screenshots of your display). This means you can ask questions on anything that's seen on screen, like 'what does this error message mean?' or "how do I create a table in Excel?" To turn it on, simply click the glasses icon in the Copilot app and select the desktop screen you want to share. Of course, you can turn it off at any time by selecting "Stop" in the app. You'll also be able to activate Vision AI using your voice, as Microsoft is rolling out access to Vision from "Voice conversation." It also states you can add more context in conversations by selecting the glasses icon and typing in what's needed. Along with the recent Highlights feature, which automatically offers useful content based on the apps, documents or websites in browsers you're looking at, Microsoft is looking to give its Windows 11 PCs even more of an AI advantage. You can try out these 7 useful Copilot prompts to make the most of it. Get instant access to breaking news, the hottest reviews, great deals and helpful tips. The Copilot Vision update is now gradually rolling out to Windows Insider channels where Vision AI is available, so if you haven't received the update yet, it will be coming eventually. You can join the Windows Insiders program by heading to Settings > Windows Update > Windows Insider Program, and then clicking Get Started. Follow Tom's Guide on Google News to get our up-to-date news, how-tos, and reviews in your feeds. Make sure to click the Follow button.
&w=3840&q=100)
Business Standard
4 days ago
- Business Standard
Microsoft Copilot Vision now reads entire screen, offer real-time guidance
Microsoft is rolling out a major update to its Copilot Vision feature on Windows, expanding its real-time screening capabilities beyond just two apps at a time. With the new update, Copilot Vision can now scan your entire desktop or any specific browser or application window, offering real-time assistance, insights, and task guidance based on what's visible on your screen. Copilot Vision: Desktop Share According to Microsoft's official Windows blog, the feature now functions much like a live screen-sharing session in a video call. By clicking the glasses icon in the Copilot app, users can choose which part of their screen — be it the full desktop or an individual app window — to share with Copilot. Once enabled, the AI can see what's happening on-screen and offer relevant responses. Unlike Microsoft's Recall feature, which passively records screen activity in the background, Copilot Vision only activates when users explicitly choose to share their screen. This makes the feature more privacy-conscious and user-controlled. The update aims to make Copilot more helpful across a range of activities — whether you're editing a creative project, updating a resume, or trying to master a new game. With the shared screen view, Copilot can analyse the visible content and provide personalised suggestions, spoken tips, or step-by-step guidance. Microsoft explains: 'Get tips on making improvements to your creative project, help with improving your resume, or guidance while navigating a new game.' Copilot Vision: Voice integration Copilot Vision also integrates with voice input. If you're speaking with Copilot and want to add visual context, simply click the glasses icon to initiate screen sharing. This adds another layer of interactivity, building on earlier features where Copilot could analyse browser activity or input from a phone camera. Availability The new capabilities are available with Copilot app version 1.25071.125 and higher, being rolled out via the Microsoft Store. However, availability is currently limited to Windows Insiders who already have Windows Vision enabled. Microsoft notes that the rollout will be gradual and not all Insiders will receive the update right away, as the company continues to test and refine the experience.
The Verge
4 days ago
- The Verge
Now Microsoft's Copilot Vision AI can scan everything on your screen
Microsoft is rolling out an update to Copilot Vision for Windows Insiders that lets the AI tool see everything that's on your screen. Previously, the tool was able to look at two apps at a time and connect the dots between the two, but with this change, it can look at your whole desktop or 'any specific browser or app window,' Microsoft says. Unlike Recall, which can automatically take regular snapshots of what's on your computer screen, using Copilot Vision is more like screen sharing during a video call: you can activate the feature by clicking the glasses icon in the Copilot app and selecting the desktop you want it to see. Copilot Vision can 'help analyze content, provide insights, and answer your questions, coaching you through it aloud,' according to Microsoft. 'Get tips on making improvements to your creative project, help with improving your resume, or guidance while navigating a new game.' Microsoft initially started testing Copilot Vision last year as a feature that could see what you're looking at while browsing the web in Edge. Copilot Vision can also answer questions about what it sees through your mobile phone's camera.
The Verge
5 days ago
- The Verge
Microsoft tests a 'Describe Image' feature for Copilot Plus PCs.
Posted Jul 14, 2025 at 10:05 PM UTC Microsoft tests a 'Describe Image' feature for Copilot Plus PCs. The new option, which will appear in the 'Click to Do' menu, uses AI to generate a written description of an image, chart, or graph on your screen. The feature is rolling out now to Windows Insiders on Snapdragon-equipped Copilot Plus PCs, but Microsoft says support for Intel and AMD-powered devices is 'coming soon.'
The Verge
27-06-2025
- The Verge
Microsoft is testing tighter integration with 1Password's passkeys in Windows.
Posted Jun 27, 2025 at 7:44 PM UTC Microsoft is testing tighter integration with 1Password's passkeys in Windows. The idea is to make using passkeys a little more seamless. But this isn't available to everyone just yet: Microsoft is initially rolling it out to Windows Insiders in the Dev Channel and you need to install the 1Password beta.
