logo
Microsoft's Copilot Vision AI can now see your whole desktop — here's what it does

Microsoft's Copilot Vision AI can now see your whole desktop — here's what it does

Tom's Guide4 days ago
Microsoft is rolling out an update to its Copilot Vision AI on Windows 11 PCs, allowing it to see your whole desktop and talk to you in real time.
Coming to Windows Insiders, the update will let users share their "whole desktop with Copilot," allowing it to see what's on screen and offer contextual help. This was previously only available to use in a couple of apps at a time, but now Copilot Vision can analyze content on everything shown on a PC.
Through "Desktop Share," Copilot Vision can deliver insights, answer questions on everything you do and give you tips on tasks, similar to Google's Gemini Live and Apple Intelligence. According to Microsoft, it will be able to "get tips on making improvements to your creative project, help with improving your resume, or guidance while navigating a new game," the blog post states.
This Copilot Vision "Desktop Share" feature works as it says on the tin, by sharing your desktop with Copilot in real time (unlike Microsoft Recall, which captures screenshots of your display). This means you can ask questions on anything that's seen on screen, like 'what does this error message mean?' or "how do I create a table in Excel?"
To turn it on, simply click the glasses icon in the Copilot app and select the desktop screen you want to share. Of course, you can turn it off at any time by selecting "Stop" in the app.
You'll also be able to activate Vision AI using your voice, as Microsoft is rolling out access to Vision from "Voice conversation." It also states you can add more context in conversations by selecting the glasses icon and typing in what's needed.
Along with the recent Highlights feature, which automatically offers useful content based on the apps, documents or websites in browsers you're looking at, Microsoft is looking to give its Windows 11 PCs even more of an AI advantage. You can try out these 7 useful Copilot prompts to make the most of it.
Get instant access to breaking news, the hottest reviews, great deals and helpful tips.
The Copilot Vision update is now gradually rolling out to Windows Insider channels where Vision AI is available, so if you haven't received the update yet, it will be coming eventually.
You can join the Windows Insiders program by heading to Settings > Windows Update > Windows Insider Program, and then clicking Get Started.
Follow Tom's Guide on Google News to get our up-to-date news, how-tos, and reviews in your feeds. Make sure to click the Follow button.
Orange background

Try Our AI Features

Explore what Daily8 AI can do for you:

Comments

No comments yet...

Related Articles

I used Google's Veo 3 to create AI ASMR food videos
I used Google's Veo 3 to create AI ASMR food videos

Tom's Guide

timean hour ago

  • Tom's Guide

I used Google's Veo 3 to create AI ASMR food videos

Google's Veo 3 AI video model is a league above any of its competitors for one key reason — sound. You can prompt not just what you see on screen, but also what you hear. Built by Google's DeepMind lab, the first Veo model debuted in May 2024, and each new generation has added more functionality. It has always excelled in motion accuracy and physics understanding compared to competitors, but the addition of sound was a game-changer. You can use it to prompt a short commercial, a scene from a movie you're writing, or even a music video. But there's one use I've seen more than any other — ASMR (autonomous sensory meridian response): those gentle tapping, whispering, and ambient sounds that trigger a tingling sensation for some people. To see just how far this could go, I created a series of ASMR food prompts — each designed to generate a matching video and sound around something culinary. Veo 3 is now available in the Gemini app. Just select the Video option when starting a new prompt, type what you want, and an 8-second clip is generated. While Gemini isn't necessarily the best way to access Veo 3 — I'd recommend Freepik, Fal, Higgsfield, or Google Flow — it's easy to use and gets the job done. A key advantage of using Gemini directly is that it automatically interprets and enhances your prompts. So if you ask for 'a cool ASMR video featuring lasagna,' that's what you'll get. Get instant access to breaking news, the hottest reviews, great deals and helpful tips. You can also be more specific using something called structured prompting — labeling each moment with timestamps and scene descriptions. But unless you need precise control, a simple paragraph (aka narrative prompting) is usually more effective. The first task in any AI project is thinking about your prompt. Models are getting better at interpreting intent, but it's still better to be specific if you know what you want. I knew I wanted ASMR food videos, so I started with a test: 'ASMR food video with sound.' The result? Decent. It essentially gave me the lasagna I had in mind. Then I refined it — outlining specific food types, adding sound descriptions, and even trying a structured prompt for a fizzy drink with ice. Most of the time, narrative prompts work best. Just describe what you want to see, the flow of the video, and how sound should come through. The first prompt, 'ASMR food video with sound,' produced a stunning clip of someone sliding a fork into a slice of lasagna. You hear the squish as the fork enters, then the clunk as it hits the plate. This is one case where I wish Veo 3 had an 'extend clip' button. There was no other prompting involved, so I had no way of identifying what the food would be, how the sound would come out or even if the sound would work. This is why it's important to be specific when prompting AI models, even ones in chatbots like Gemini. Next, I went more specific — a longer, narrative-style prompt asking Veo 3 to generate a close-up of a chef preparing and eating satisfying food in a well-lit kitchen. I asked for slow-motion visuals of ingredients being chopped, the sizzling sound of butter melting in a pan, and a crunch as the chef takes a bite. I also added this line: 'Emphasize audio quality: clean, layered ASMR soundscape without music' to direct not just the sound, but to the style of sound and what I don't want to hear. For the final prompt I started with an image. I used Midjourney v7 to create a picture of a woman looking at rainbow popcorn, then added the prompt 'ASMR food' in Gemini. Visually, the result was stunning — but for some reason, the woman says in a voiceover, 'This is delicious, this rainbow popcorn.' That's on me — I didn't specify whether she should speak, or what she should say. A simple fix: put any speech you want in quotes. For example, I could have prompted her to say 'I love to watch popcorn pop,' and emphasized the word pop. I also could've specified that she was speaking on camera — and Veo 3 would have synced the lip movement to match. Overall, Veo 3 delivers impressive results, especially when it comes to generating high-quality sound that accurately reflects the visuals. While there are a few quirks to navigate, like unintended voiceovers or slightly underbaked looking lasagna — these are easily addressed with more specific prompting.

This Week's Business Technology News: OpenAI Goes For Microsoft's Jugular
This Week's Business Technology News: OpenAI Goes For Microsoft's Jugular

Forbes

timean hour ago

  • Forbes

This Week's Business Technology News: OpenAI Goes For Microsoft's Jugular

TOPSHOT - Microsoft Chairman Bill Gates delivers a speech to unveil the new Microsoft Office System ... More during a presentation in New York 21 October 2003. Microsoft calls the new software one of the most important updates in the company's history. Gates said the new software combines familiar Office productivity programs with new business applications. AFP PHOTO Timothy A. CLARY (Photo by Timothy A. CLARY / AFP) (Photo by TIMOTHY A. CLARY/AFP via Getty Images) Here are five business technology news stories from this week and how they affect your business. Did you miss them? This Week in Business Tech News Business Technology News #1 – OpenAI goes for Microsoft's jugular – its Office productivity suite. OpenAI is reportedly developing its own AI-powered office productivity suite, directly challenging Microsoft 365 and Google Workspace. Features reportedly include collaborative document editing, meeting transcription, team chat, and tight integration with ChatGPT. Rather than replicating Microsoft's feature-rich apps or Google's collaboration tools, OpenAI may lean into generative AI to reinvent how documents are created and edited collaboratively. This move comes amid rising tensions between OpenAI and Microsoft, despite their deep partnership and Microsoft's $13 billion investment in the AI company. If successful, OpenAI's suite could reshape enterprise software by offering a more fluid, AI-native experience. (Source: Computerworld) Why this is important for your business: I've been to this rodeo before. Over the years I've been in the tech industry countless players from - Facebook to Google - have come and gone trying to replace Microsoft Office with their own solutions. Google has probably had the most success but even their market share pales when compared to Microsoft's. Maybe OpenAI has a better answer? I'm not hopeful. Business Technology News #2 – Instagram launches trial reels, letting creators test ideas with new audiences. Instagram has launched a new feature called Trial Reels, designed to help creators and small businesses experiment with content before sharing it with their full audience. Creators can share short videos with a randomized audience of non-followers to gauge reactions – allowing businesses to try new formats or ideas without risking backlash from loyal followers. After 24 hours, Instagram provides engagement metrics like views, likes, comments, and shares. If the reel performs well, creators can manually or automatically publish it to their followers. High-performing trial reels can be auto-published based on engagement within 72 hours. (Source: Small Business Trends) Why this is important for your business: It's a simple yet brilliant idea, and not one that's foreign to the tech world. It's a sandbox to build test systems and only allow certain users/customers to use it. I love it and I think if you're an Instagram creator it's a solid way to test out potential content. Business Technology News #3 – OpenAI quietly adds Shopify as a shopping search partner. OpenAI has quietly added Shopify as a third-party search partner for its ChatGPT shopping search feature, expanding its e-commerce capabilities without a formal announcement. SEO expert Aleyda Solís spotted the update in OpenAI's documentation on May 15, 2025, following the rollout of enhanced shopping features in April. Shopify joins Bing as a data provider for ChatGPT's shopping search, enabling richer product listings with images, prices, and reviews. ChatGPT now returns shopping results from various platforms, including Amazon and Turbify (formerly Yahoo Stores). Non-Shopify stores can apply to be included, provided they allow OpenAI's web crawler – OAI-SearchBot – to access their site. (Source: Search Engine Journal) Why this is important for your business: According to the post this move positions OpenAI to compete more directly in the AI-powered shopping space, offering users a seamless and visually rich shopping experience. It's certainly an easier way to search and buy products and it makes sense – as a consumer I often ask ChatGPT for buying advice so why not be delivered links to purchase their recommendations? If your business uses Shopify I'd learn more about this functionality. And if your business uses one of Shopify's competitors I'm sure we'll be seeing similar offering in the not too distant future. Business Technology News #4 – How one subcontractor worked 10X faster with Project Intelligence. North Texas subcontractor DFW Turf Solutions dramatically improved its efficiency –working 10x faster – by adopting a product called ConstructConnect® Project Intelligence (CCPI). The challenges DFW were dealing with included driving to job sites to find work and struggling to connect with decision-makers on projects. CCPI transformed their workflow with real-time project data that gave them access to updated public and private job listings. Smart search filters allowed them to quickly narrow down projects by bid date, stage, and location. The results showed significant growth in business with 5-30 new contacts per day, and they landed on over 140 bidder lists across Texas. This case study shows how digital tools like CCPI can revolutionize subcontractor operations. (Source: ConstructConnect) Why this is important for your business: I enjoy writing about actual uses of AI and technologies by actual companies, rather than conjecture, predictions and prognostications. CCPI is a good example for those in the construction industry. Business Technology News #5 – Here are 10 ways to use Grok 4 that feel like cheating: AI resources platform God of Prompt listed 10 creative ways to use Grok 4 – xAI's large language model – on its X feed. Example tips: Users can build apps and interactive tools without code by describing their idea to Grok and prompting it to design an interactive tool based on the idea. Infographics can be designed from plain text. Prompt: 'You are a world-class visual explainer and technical designer. Transform this concept into a visual graphic using a code-based design format.' Grok can also perform as a stand-in tutor on a chosen subject by entering a prompt: 'You are a world-class private tutor. Teach me [chosen topic] as if I'm a motivated beginner.' Next, users can list specific bullet points of subtopics they want to be included in the lesson. For the full list of Grok 4 capabilities, visit the link. (Source: God of Prompt) Why this is important for your business: Grok 4 has been recently released and well received as a strong alternative to ChatGPT, Copilot, Gemini and others. I've been using it while on X to provide context and explanations behind posts. But I like the idea of expanding its usage for my business and these examples give me good week I round up five business technology news stories and explain why they're important for your business. If you have any interesting stories, please post to my X account @genemarks

Microsoft Confirms Ongoing Mass SharePoint Attack — No Patch Available
Microsoft Confirms Ongoing Mass SharePoint Attack — No Patch Available

Forbes

timean hour ago

  • Forbes

Microsoft Confirms Ongoing Mass SharePoint Attack — No Patch Available

Microsoft SharePoint is under attack. Microsoft users are, once again, under attack. This time, the threat is not restricted to Outlook users, or involves a Windows browser-based security bypass, and unlike the recent Windows authentication relay attack vulnerability, there is no patch, no magic update, to remedy this one. Which is bad news for Microsoft SharePoint Server users, as CVE-2025-53770 is currently under confirmed 'mass attack' and on-premises servers across the world are being compromised. Here's what you need to know and do. Microsoft Confirms CVE-2025-53770 SharePoint Server Attacks It's been quite the few weeks for security warnings, what with Amazon informing 220 million customers of Prime account attacks, and claims of a mass hack of Ring doorbells going viral. The first of those can be mitigated by basic security hygiene, and the latter appears to be a false alarm. The same cannot be said for CVE-2025-53770, a newly uncovered and confirmed attack against users of SharePoint Server which is currently undergoing mass exploitation on a global level, according to the Eye Research experts who discovered it. Microsoft, meanwhile, has admitted that not only is it 'aware of active attacks' but, worryingly, 'a patch is currently not available for this vulnerability.' CVE-2025-53770, which is also being called ToolShell, is a critical vulnerability in on-premises SharePoint. The end result of which is the ability for attackers to gain access and control of said servers without authentication. If that sounds bad, it's because it is. Very bad indeed. 'The risk is not theoretical,' the researchers warned, 'attackers can execute code remotely, bypassing identity protections such as MFA or SSO.' Once they have, they can then 'access all SharePoint content, system files, and configurations and move laterally across the Windows Domain.' And then there's the theft of cryptographic keys. That can enable an attacker to 'impersonate users or services,' according to the report, 'even after the server is patched.' So, even when a patch is eventually released, and I would expect an emergency update to arrive fairly quickly for this one, the problem isn't solved. You will, it was explained, 'need to rotate the secrets allowing all future tokens that can be created by the malicious actor to become invalid.' And, of course, as SharePoint will often connect to other core services, including the likes of Outlook and Teams, oh and not forgetting OneDrive, the threat, if exploited, can and will lead to 'data theft, password harvesting, and lateral movement across the network,' the researchers warned. Mitigating The Microsoft SharePoint Server Attacks While the Microsoft Security Response Center has stated that it is 'actively working to release a security update,' and will 'provide additional details as they are available,' there is no patch at the time of writing. In the meantime, it advised that customers should apply the following mitigations:' Configure Antimalware Scan Interface integration in SharePoint and deploy Defender AV on all SharePoint servers. 'If you cannot enable AMSI,' Microsoft said, 'we recommend you consider disconnecting your server from the internet until a security update is available.' I have approached Microsoft for a statement and will update this story with any further developments.

DOWNLOAD THE APP

Get Started Now: Download the App

Ready to dive into a world of global content with local flavor? Download Daily8 app today from your preferred app store and start exploring.
app-storeplay-store