Microsoft Is Testing Letting Copilot AI Interact With Your Whole Desktop
The company said Tuesday that this expansion of Copilot's Vision capabilities has begun public testing. This update, now rolling out to the company's Windows Insider program testers, will allow the AI chatbot to view, process and react to all aspects of a user's desktop, where beforehand it was limited to specific apps or windows.
With this update in place, Copilot should be to process and react to multiple windows and apps at the same time. Microsoft touted the ability for it to assist with all aspects of a project you might be working on.
The Vision feature can be activated by selecting the "glasses" icon and selecting which desktop you'd like to share, and can be closed out by hitting "Stop" or "X" in the composer.
"When you share your desktop (or any specific browser or app window), Copilot can see what you see and talk to you about it in real time," Microsoft's blog post said. "It can help analyze content, provide insights, and answer your questions, coaching you through it aloud. Get tips on making improvements to your creative project, help with improving your resume, or guidance while navigating a new game."
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Forbes
24 minutes ago
- Forbes
Microsoft Reveals The Most And Least ‘AI-Safe' Jobs—Where Do You Rank?
Will AI take your job? New data from Microsoft offers a clear answer. As generative AI tools like ChatGPT, Claude and Microsoft Copilot become increasingly sophisticated, millions of workers are wondering whether their roles qualify as 'AI-safe jobs' or are at risk of disruption. Unlike previous studies that relied on expert predictions or theoretical models, Microsoft's research analyzed over 200,000 real user interactions with Bing Copilot to show exactly which roles are being impacted by generative AI today. Here's what the data reveals about AI-safe jobs and those at risk as artificial intelligence transforms the workplace. What Are 'AI-Safe' Jobs? AI-safe jobs are least likely to be replaced or fundamentally transformed by generative AI. These roles typically require physical presence, manual dexterity, human interaction or specialized skills that current AI tools can't replicate effectively. How Did Microsoft Measure AI Impact? Microsoft introduced an 'AI applicability score' for each occupation by matching user conversations with Copilot to measures of task success and scope of automation. This score reflects real-world usage rather than theoretical task analysis. How This Study Differs From Past Research Microsoft's approach differs from studies like OpenAI's 'GPTs are GPTs'. Instead of expert predictions, this research tracks actual AI usage in workplaces. While OpenAI estimated that 80% of the U.S. workforce could see at least 10% of tasks affected, Microsoft's data highlights clear winners and losers based on how workers really use artificial intelligence. Top 10 Jobs Facing The Highest AI Disruption Here are the top 10 occupations most impacted by generative AI today: Read on for all 40 roles facing significant AI disruption below. Why These Roles Are Vulnerable to AI Jobs on the high-impact list share these traits: Top 10 Jobs Safe From Generative AI At the opposite end of the spectrum, the research from Microsoft identifies jobs that remain largely insulated from AI disruption: Read on for the complete list of 40 AI-safe jobs below. Why These Roles Are Insulated From AI AI-safe jobs share these characteristics: 5 AI Trends Reshaping The Workplace High-education roles such as data scientists, management analysts and web developers rank among the most disrupted. Even highly skilled roles like financial advisors and business analysts are seeing significant impacts from AI. Only about 60% overlap exists between user expectations and AI capabilities according to the research. The study reveals that AI is augmenting work as much as it's automating it. For example, writers, advisors and service reps use AI for routine tasks while retaining creative or interpersonal work. Roles demanding hands-on skills and human connection stay largely insulated. How To Prepare For AI's Impact On Your Career AI's impact on jobs is more nuanced than many expected. Rather than eliminating roles, artificial intelligence is reshaping how tasks are performed across industries. As the workforce debates which positions qualify as AI-safe jobs and which are most at risk, the best strategy is to stay adaptable and invest in continuous learning. Professionals who thrive will combine in-demand technical skills with human qualities such as creativity, empathy and critical thinking—abilities that artificial intelligence still can't fully replicate. 40 Jobs Most at Risk from AI 40 Jobs Least Impacted by AI
Yahoo
an hour ago
- Yahoo
OpenAI Opens Up With New GPT-OSS Models
OpenAI, backed by Microsoft (MSFT), just stepped deeper into the open-source world with two new open-weight AI modelsgpt-oss-120b and gpt-oss-20btaking direct aim at Google's (NASDAQ:GOOG) Gemini CLI and DeepSeek's (DEEPSEEK) R1. The bigger model, 120b, is designed to run in data centers or on high-end hardware with Nvidia (NVDA) H100 GPUs, while the smaller 20b model works on most desktops and laptops. According to Amazon Web Services (NASDAQ:AMZN), the 120b model running on Bedrock is up to 3x more price-performant than Gemini, 5x better than DeepSeek-R1, and even 2x better than OpenAI's own o4 model. At this scale, giving developers open access is a game-changer, said Atul Deo from AWS, calling it a major step forward for enterprise AI. The models are released under the Apache 2.0 license, so developerseven commercial teamscan use them freely without worrying about copyright or patents. The training data and model code however are not publicly available, so these models are open-weight, but not available through Hugging Face, GitHub, and is signaling it's ready to compete openlynot just behind closed APIs. This article first appeared on GuruFocus. Sign in to access your portfolio
Tom's Guide
an hour ago
- Tom's Guide
Microsoft's agentic AI roadmap had a flaw that let hackers take over browsers — here's what to know and how to stay safe
Microsoft is quickly heading towards AI agentic browsing — that much is obvious with Edge's AI makeover and an open project called NLWeb that can be used to give any website AI power. But while this all sounds good on paper, it does open the door to a whole lot of security risks, and the company's agentic aspirations have already been hit by a flaw that is concerningly simple. Fortunately, it has been patched out, but it does start a bigger conversation we need to have about staying safe while agentic browsing. Let's get into it. NLWeb is envisioned as 'HTML for the Agentic Web.' Announced back at Build 2025, this is the framework for AI browsing on your behalf, but researchers Aonan Guan and Lei Wang found what is called a "path traversal vulnerability". This is a pretty standard security oversight that hackers can take advantage of by having an agentic AI visit a specially-made URL that can grant the attacker access to sensitive files like system configuration files and API keys. What can be done with this information is what can amount to stealing your agent's brain. Attackers at this point can get to the core functions of your AI agent and do a wide-ranging amount of things like look at/interact with emails on your behalf, or even get into your finances. The flaw was found and reported to Microsoft on May 28, 2025, and the company patched it out on July 1, 2025 by updating the open-source repository. It was a simple exposure that had huge problematic potential. Get instant access to breaking news, the hottest reviews, great deals and helpful tips. 'This issue was responsibly reported and we have updated the open-source repository,' Microsoft spokesperson Ben Hope told The Verge. 'Microsoft does not use the impacted code in any of our products. Customers using the repository are automatically protected.' We've seen a significant shift towards agentic browsing over the last 12 months — spearheaded by the likes of OpenAI Operator, Opera launching the world's first on-device agentic AI browser, and Rabbit R1's LAM Playground. This serious flaw may have already been patched out by Microsoft, but it's clear that this won't be the last security issue we come across. For example, there's the Model Context Protocol (MCP), which is an open standard launched by Anthropic to allow AI assistants to interact with tools and services on your behalf. Sounds good on paper, but researchers have already identified the risks of account takeover and token theft: when a hacker gains access to personal authentication tokens and essentially gets the keys to your kingdom. So it's clear you need to be extra careful in the agentic era. Here are some key steps you can take: If your AI agent is asking to connect to a service like Gmail or Google Drive, read the permissions carefully. Don't approve full access if only read access is needed, so avoid clicking 'allow all' without thinking about it. On top of that, if you want an additional layer of security, use a separate account. That way you can see what the agentic AI will be able to do without putting your sensitive information on the line. Think of any agent as a teenager you just gave the car keys to — effective most of the time, but not averse to mistakes (my battered Vauxhall Corsa can attest to this). By that, I mean check the agent you use is from a reputable company to start with. That means don't install any browser extensions that claim to 'autonomously browse the web.' And whatever you're using, don't let them auto-fill forms, send emails or make purchases unless you explicitly tell them to. For Chrome users, head over to Google Security Checkup and get rid of any third-party services that have access to your account. This will limit any potential exposures, as much as turning off autofill or password auto-saving will too. And for an additional layer of security, use agentic web tools in incognito/private windows to limit cookie or token leakage. Follow Tom's Guide on Google News to get our up-to-date news, how-tos, and reviews in your feeds. Make sure to click the Follow button.
