Latest news with #CopilotVision
&w=3840&q=100)
Business Standard
42 minutes ago
- Business Standard
Microsoft details on-device AI capabilities coming with Windows 11 update
Microsoft has announced a new Windows 11 update that will add a range of functional features for general users and Copilot+ PC owners. The update focuses on improving system interaction, accessibility, and everyday usability across key tools like Settings, Paint, Snipping Tool, and Photos. It also expands the role of on-device AI with features such as Click to Do, Copilot Vision, and a new agent for system settings. The update is available through this month's non-security preview release and Microsoft Store app updates, with gradual rollout expected over the next few weeks. How to get the update These features are rolling out gradually via controlled feature rollout (CFR) starting this month. To get early access: Make sure apps like Microsoft Paint, Photos, and Copilot are also updated through the Microsoft Store. What's new in the latest Windows 11 update AI Agent for Settings (Copilot+ PCs only) A new AI-powered settings assistant lets users search and change system settings using natural language. For example, typing 'turn on quiet hours' or 'connect Bluetooth' in the Settings search bar will now suggest one-click actions. This feature is initially available on Snapdragon-based Copilot+ PCs and will expand to Intel and AMD Copilot+ systems later. Click to Do: Expanded contextual actions The Click to Do preview has been updated with more AI-powered contextual tools. Users can now: Practice reading fluency with Reading Coach Read selected text in a focused format via Immersive Reader Generate document drafts with Draft with Copilot in Word Message or schedule meetings via Microsoft Teams directly from recognised email addresses Click to Do can be activated using Windows + click, Windows + Q, or gestures like swiping from the right on touch-enabled devices. Photos app: AI-based Relight The updated Photos app now includes a Relight feature, allowing users to apply up to three virtual light sources to images and adjust brightness, softness, color, and intensity—similar to professional editing tools. This feature is currently limited to Copilot+ PCs with Snapdragon X chips. Paint: AI sticker generator and object selection Two new tools are now available in the Paint app: Sticker generator: Create custom stickers using text prompts (e.g., 'a cat wearing sunglasses'). Object select: Use AI to isolate and edit specific elements within an image. These features build on previous Paint enhancements like Cocreator and generative erase. Snipping Tool: Perfect Screenshot and Color Picker Perfect Screenshot: Uses AI to intelligently crop screen captures to relevant content (Copilot+ PCs only). Color Picker: Lets users sample any color from the screen and view it in HEX, RGB, or HSL format. This feature is available on all Windows 11 devices. Copilot Vision and Highlights (US only) Copilot Vision enables real-time AI assistance based on what's visible on screen. It can offer help, analyse content, and show step-by-step instructions with visual cues. Users can activate it from the Copilot app and choose what to share. This is a fully opt-in experience. Edge game assist Microsoft Edge now integrates Game Assist, offering: Game guides and tips Quick access to Discord, Spotify, and Twitch Available via the Game Bar (Win + G) for Windows 11 users. Faster recovery from unexpected restarts Unexpected reboots will now use Quick Machine Recovery through Windows Recovery Environment (WinRE) to auto-detect and fix issues. Microsoft also claims to have reduced restart screen time from 40 seconds to just 2 seconds for most users, along with a simplified UI for clarity. Windows 10 support transition As support for Windows 10 ends on October 14, 2025, Microsoft is launching an Extended Security Updates (ESU) program. A new setup wizard will help users enroll directly from their Windows 10 PCs, ensuring continued protection during the transition.
The Verge
14 hours ago
- The Verge
Windows 11's new update will add a bunch of AI features
is a news writer who covers the streaming wars, consumer tech, crypto, social media, and much more. Previously, she was a writer and editor at MUO. Microsoft is releasing several new AI features for Windows 11, including its Copilot Vision tool that can scan everything on your screen. The features, which are gradually rolling out to everyone now, also include tools that are exclusive to Copilot Plus PCs. For starters, all Windows 11 users can now access Copilot Vision through the Copilot app, which uses AI to analyze the content on your screen. With the tool, you can ask questions aloud about what you're seeing across multiple apps and webpages that are open on your screen. You can also ask it how to complete specific tasks on your computer, like how to improve the lighting on a photo. Microsoft first began testing a more limited form of this feature last year. Additionally, users with Snapdragon-powered Copilot Plus PCs can access an AI-powered 'agent' within the Settings app. This allows you to search for a specific setting with natural language, such as 'I want to enable quiet hours' or 'connect Bluetooth device.' If the agent is capable of carrying out the task, it will offer to complete it on your behalf. Microsoft is making its AI-powered 'Click to Do' preview more useful on Copilot Plus PCs, too. This feature, which surfaces when users hold down the Windows key and left-click on an app, text, website, or other piece of content, is designed to help you quickly complete actions, like summarizing a highlighted paragraph. As part of its update, Microsoft is rolling out several new actions you can perform with Click to Do, including practicing reading fluency and pronunciation with its Reading Coach tool, drafting a document in Microsoft Word using Copilot, and scheduling a Teams meeting. Click to Do lets you quickly perform actions, like summarize text. Image: Microsoft Other features coming only to Copilot Plus PCs include a new AI-powered sticker generator in Paint and an object select tool in the app that lets you separate and edit specific parts of an image. There's also a new AI lighting option available in Photos for Snapdragon-equipped Copilot Plus PCs, along with a 'perfect screenshot' tool within the Snipping Tool that uses AI to 'precisely capture content on your screen.' Copilot Plus PC users will find a new. AI object select tool in their Paint toolbar. Image: Microsoft Microsoft is also releasing some features that aren't related to AI across all Windows 11 PCs, including a handy color picker within the Snipping Tool and a new mechanism that allows PCs to automatically fix issues causing unexpected restarts. Microsoft says it will roll out all of these features 'over the next month.' Some of them are already available in Windows' new non-security preview update and as updates that you can download in the Microsoft Store.
Mint
2 days ago
- Mint
Microsoft tests Copilot Vision desktop share in Windows 11 Insider Build: Here's what's new
Microsoft is testing a new Copilot feature in the latest Windows 11 Insider build called Copilot Vision. It allows Copilot to view your entire desktop or specific app windows and respond in real time based on what's visible. Earlier, it could only compare two apps side by side. Now it can work across your full screen to offer broader assistance. Copilot can answer questions, suggest improvements, and guide you through tasks based on what's on your screen. Microsoft says it may assist with things like editing your resume, offering feedback on creative projects, or helping you navigate a new game. The feature is similar to what Google's Gemini Live and Apple Intelligence are beginning to offer. Copilot Vision allows the assistance to access and interpret the visible content on your screen in real time. It helps you with what you are working on, reads that content and offers relevant suggestions, summaries or whatever you ask. For example, suppose you have a PDF document open on your computer screen, you can ask Copilot to summarise it or tell main points of the content. If you are working in an Excel sheet, Copilot might help you spot errors, generate new formulas, help you in solving your issues with quick formulas, and compare values in a table without needing to describe the sheet. When browsing the web, it could highlight product differences or summarise a long review page. All of this happens through screen context, reducing the need to switch apps or copy and paste information. Importantly, this feature uses screen capture permissions, and Microsoft says Copilot only accesses your screen after you give permission. You also have full control over what it sees and when it stops. Now these will help you understand better how Copilot Vision helps you in real life. Document review: Copilot can pick out key terms or show what's changed in a contract, so you don't have to scroll through the whole thing. Spreadsheets: It can look at your sales data and give quick insights, fix errors, or turn numbers into charts right on your screen. E-commerce: Compare specs of products side by side directly from your screen without searching again. Email writing: If you have a report or slide deck open, Copilot could help draft a quick summary to send to a colleague. Troubleshooting: If you are stuck on a system setting or error screen, Copilot could explain the issue or offer a fix based on what's visible. The new Desktop Share feature makes it possible for Copilot to view your screen in real time and respond to you based on what is on the screen. To enable this feature open the Copilot app and click the glasses icon. From there, choose which part of your desktop to share. Once active, you can ask questions like 'What does this error mean?' or 'How do I create a table in Excel?' and Copilot will respond based on what it sees. You can even stop sharing any time by selecting the "Stop" option in the same panel. You can also activate the Vision using your voice, thanks to its feature called Voice Conversation. You can verbally say your request and Copilot will respond using visual content on the screen. Copilot listens and responds based on what's on your screen, without needing to type or click. Microsoft has added a Highlights feature that shows helpful tips based on the apps, files or websites you are using without you having to ask. Copilot Vision stands out by removing the need to type long prompts. It sees what's on your screen and helps right away, making it feel more like a built-in assistant than a chatbot. Unlike screen sharing or remote tools, it works locally and is just for you. The feature is still in testing with no set release date, but Microsoft is clearly moving toward assistants that respond to both what you type and what you see on screen.
Hans India
6 days ago
- Hans India
Smarter Assistance Unlocked: Microsoft Copilot Now Scans Your Entire Desktop
Microsoft will soon be expanding Microsoft Copilot Vision AI Insiders by allowing the AI assistant to view your full screen, and not just two apps at a time. Windows 11 AI features can now take in whatever you have open – whether a browser or a whole app window – and can help with offering real-time coaching, suggestions, tips or help on any of the things you are viewing. One of the big tech giants to offer a Windows AI experience, Microsoft has upped its Copilot Vision, the AI tool that is available for Windows computers. The current functionality of Copilot Vision allows it to view and analyse two apps at a time. But this latest beta update for Windows Insiders will let it see not just two but any open app and browser, and even your whole desktop. Microsoft is taking a big leap with this Copilot screen scanning update by making Copilot Vision, an intelligent, intuitive, and responsive AI assistant that can help with viewing your full screen instead of just two apps or windows. How does it work? It's like screen sharing, but smarter. Microsoft's Recall feature automatically takes snapshots of your screen, but Copilot Vision is not automatic. Users will have to manually click the glasses icon on the Copilot app, and select what they want the AI to view. It works the same way as when you share your screen, but with a video call. Users have more control with Microsoft Copilot Vision use cases, since they can choose what they want to share with the AI. Microsoft Copilot Vision: Smarter assistance in real time Microsoft says Copilot Vision Edge will also be smarter with its real-time assistance. The AI will offer suggestions by analysing visual content and also be able to coach you aloud. Whether you are making changes to your resume, working on a Copilot full desktop access, or even learning a new game, the AI assistant will now be able to guide you with improvements, offer insights, and live feedback. Copilot Vision also first appeared in testing as an Edge browser assistant, which could see and respond to anything on the web.
Tom's Guide
7 days ago
- Tom's Guide
Microsoft's Copilot Vision AI can now see your whole desktop — here's what it does
Microsoft is rolling out an update to its Copilot Vision AI on Windows 11 PCs, allowing it to see your whole desktop and talk to you in real time. Coming to Windows Insiders, the update will let users share their "whole desktop with Copilot," allowing it to see what's on screen and offer contextual help. This was previously only available to use in a couple of apps at a time, but now Copilot Vision can analyze content on everything shown on a PC. Through "Desktop Share," Copilot Vision can deliver insights, answer questions on everything you do and give you tips on tasks, similar to Google's Gemini Live and Apple Intelligence. According to Microsoft, it will be able to "get tips on making improvements to your creative project, help with improving your resume, or guidance while navigating a new game," the blog post states. This Copilot Vision "Desktop Share" feature works as it says on the tin, by sharing your desktop with Copilot in real time (unlike Microsoft Recall, which captures screenshots of your display). This means you can ask questions on anything that's seen on screen, like 'what does this error message mean?' or "how do I create a table in Excel?" To turn it on, simply click the glasses icon in the Copilot app and select the desktop screen you want to share. Of course, you can turn it off at any time by selecting "Stop" in the app. You'll also be able to activate Vision AI using your voice, as Microsoft is rolling out access to Vision from "Voice conversation." It also states you can add more context in conversations by selecting the glasses icon and typing in what's needed. Along with the recent Highlights feature, which automatically offers useful content based on the apps, documents or websites in browsers you're looking at, Microsoft is looking to give its Windows 11 PCs even more of an AI advantage. You can try out these 7 useful Copilot prompts to make the most of it. Get instant access to breaking news, the hottest reviews, great deals and helpful tips. The Copilot Vision update is now gradually rolling out to Windows Insider channels where Vision AI is available, so if you haven't received the update yet, it will be coming eventually. You can join the Windows Insiders program by heading to Settings > Windows Update > Windows Insider Program, and then clicking Get Started. Follow Tom's Guide on Google News to get our up-to-date news, how-tos, and reviews in your feeds. Make sure to click the Follow button.
