Microsoft tests Copilot Vision desktop share in Windows 11 Insider Build: Here's what's new
Copilot can answer questions, suggest improvements, and guide you through tasks based on what's on your screen. Microsoft says it may assist with things like editing your resume, offering feedback on creative projects, or helping you navigate a new game. The feature is similar to what Google's Gemini Live and Apple Intelligence are beginning to offer.
Copilot Vision allows the assistance to access and interpret the visible content on your screen in real time. It helps you with what you are working on, reads that content and offers relevant suggestions, summaries or whatever you ask.
For example, suppose you have a PDF document open on your computer screen, you can ask Copilot to summarise it or tell main points of the content. If you are working in an Excel sheet, Copilot might help you spot errors, generate new formulas, help you in solving your issues with quick formulas, and compare values in a table without needing to describe the sheet. When browsing the web, it could highlight product differences or summarise a long review page. All of this happens through screen context, reducing the need to switch apps or copy and paste information.
Importantly, this feature uses screen capture permissions, and Microsoft says Copilot only accesses your screen after you give permission. You also have full control over what it sees and when it stops.
Now these will help you understand better how Copilot Vision helps you in real life. Document review: Copilot can pick out key terms or show what's changed in a contract, so you don't have to scroll through the whole thing.
Spreadsheets: It can look at your sales data and give quick insights, fix errors, or turn numbers into charts right on your screen.
E-commerce: Compare specs of products side by side directly from your screen without searching again.
Email writing: If you have a report or slide deck open, Copilot could help draft a quick summary to send to a colleague.
Troubleshooting: If you are stuck on a system setting or error screen, Copilot could explain the issue or offer a fix based on what's visible.
The new Desktop Share feature makes it possible for Copilot to view your screen in real time and respond to you based on what is on the screen. To enable this feature open the Copilot app and click the glasses icon. From there, choose which part of your desktop to share. Once active, you can ask questions like 'What does this error mean?' or 'How do I create a table in Excel?' and Copilot will respond based on what it sees.
You can even stop sharing any time by selecting the "Stop" option in the same panel. You can also activate the Vision using your voice, thanks to its feature called Voice Conversation. You can verbally say your request and Copilot will respond using visual content on the screen. Copilot listens and responds based on what's on your screen, without needing to type or click.
Microsoft has added a Highlights feature that shows helpful tips based on the apps, files or websites you are using without you having to ask.
Copilot Vision stands out by removing the need to type long prompts. It sees what's on your screen and helps right away, making it feel more like a built-in assistant than a chatbot. Unlike screen sharing or remote tools, it works locally and is just for you.
The feature is still in testing with no set release date, but Microsoft is clearly moving toward assistants that respond to both what you type and what you see on screen.
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Business Standard
18 minutes ago
- Business Standard
Altizon Completes Strategic Migration to Microsoft Azure, Unlocking AI-Driven Productivity for Global Manufacturers
PRNewswire Princeton (New Jersey) [US], July 29: Altizon, the Digital Factory SaaS pioneer, today announced the successful migration of its entire product portfolio to Microsoft Azure. The move instantly brings hundreds of manufacturing plants across North and South America, Europe and Asia onto Azure's hyperscale cloud, empowering more than 10,000 business users who rely on Altizon's mission-critical applications around the clock. The transition positions Altizon as a premier 'Azure-native' solution for the Food & Beverage, Automotive and Industrial sectors. Microsoft's global channel partners can now resell a market-leading platform with a 12-year record of operational excellence, accelerating time-to-value for customers pursuing Industry 4.0 initiatives. By aligning with the latest Microsoft AI innovations--including Microsoft Fabric, Azure AI Studio, Azure IoT Operations, Azure Digital Twins, Azure Machine Learning, and Power Platform breakthroughs such as AI Builder and Copilot Studio--Altizon's Datonis Digital Factory Suite delivers a step-change in productivity. Manufacturers can harness plant-floor data to train predictive models, launch generative AI copilots for operators, and orchestrate multi-agent workflows that continuously optimize Overall Equipment Effectiveness (OEE), energy use and quality yields. Security and data sovereignty remain uncompromised. Altizon's micro-services can be deployed in each customer's dedicated Azure private cloud or in hybrid landscapes, ensuring that sensitive operational data never leaves the customer's control while still flowing seamlessly into AI models, Microsoft Fabric OneLake and Power BI real-time dashboards. The result is a unified 'shop-floor-to-boardroom' fabric where insights, alerts and recommendations surface in Microsoft Teams, Outlook and automated workflows built with Power Automate--propelling collaborative decision-making in minutes instead of hours. "Moving to Azure is a force multiplier," said Vinay Nathan, CEO and co-founder of Altizon. "Our customers gain instant access to Microsoft's AI stack, and our partners gain a proven platform they can trust to deliver measurable productivity gains on day one." About Altizon Altizon, a global industrial AI company, powers digital revolutions by helping enterprises leverage machine data to drive business decisions. Altizon's applies advanced analytics and machine learning algorithms to accelerate smart manufacturing initiatives, modernize asset performance management and pioneer new business models for service delivery.
Time of India
18 minutes ago
- Time of India
Six years of MG Hector: The connected car trend starter
Launched on June 27, 2019, the MG Hector marked a significant entry into India's mid-size SUV segment, bringing with it several firsts in design, technology, and ownership experience. Priced between ₹12.18 lakh and ₹16.88 lakh (ex-showroom) at launch, the Hector positioned itself as India's first internet SUV. It was introduced not just as a product but as a technology platform backed by a suite of global partners and a strong consumer-focused value proposition. The Hector was based on a global platform but underwent extensive re-engineering to suit Indian road conditions and consumer expectations. The name 'Hector' was chosen to symbolise strength, trust, and dependability—traits drawn from the mythological Trojan warrior Prince Hector of Troy. These values were reflected in the SUV's design, features, and technology integration. The company collaborated with technology players like Microsoft, Adobe, SAP, Cisco, TomTom, Gaana, Unlimit, and Nuance to build a connected mobility ecosystem. Its proprietary iSMART platform was a core part of this effort. AI-powered Voice Assist system One of the standout features of the Hector was its AI-powered Voice Assist system developed specifically for Indian users. With support for over 100 commands and the ability to function under poor network conditions, the voice system was built to understand Indian accents and preferences. Activated by the phrase 'Hello MG', it allowed users to control functions such as window operation, sunroof, navigation, and air conditioning. The SUV also offered what was then India's largest HD touchscreen display at 10.4 inches, integrated with both Android Auto and Apple CarPlay for seamless smartphone connectivity. Consumer response was swift and substantial. Within 23 days of pre-orders opening, the company received over 10,000 bookings. By the end of the first month, bookings had crossed the 21,000 mark, forcing the company to temporarily pause further orders. MG also backed the Hector with a five-year warranty with unlimited kilometres, five years of roadside assistance, and zero labour charges for the first five scheduled services—aiming to lower ownership anxiety for early adopters. Back then, the Hector was introduced in four variants with eleven combinations across three engine options: petrol, petrol-hybrid, and diesel. It was also the first in its segment to feature a 48-volt mild-hybrid system, which offered additional torque support of up to 20 Nm and enhanced fuel efficiency. According to ARAI figures, the petrol hybrid MT delivered 15.81 km per litre, while the diesel version offered 17.41 km per litre. Safety was also a priority, with 25 features provided as standard. In July 2020, MG expanded the Hector family with the launch of the Hector Plus—a six-seater SUV with added comfort features and a panoramic sunroof. Priced at ₹13.48 lakh (ex-showroom), the Hector Plus was built at MG's manufacturing facility in Halol, Gujarat. It was positioned as a more family-oriented alternative with a focus on space and in-cabin tech. Rollout of the 50,000th Hector Production milestones followed quickly. In February 2021, MG celebrated the rollout of the 50,000th Hector, manufactured by an all-women crew at the company's Halol plant. This initiative highlighted MG's emphasis on diversity and inclusive growth in its manufacturing workforce, with women leading production, welding, painting, and quality testing. In January 2023, MG introduced the next-generation Hector with significant feature upgrades. These included Level 2 Advanced Driver Assistance Systems (ADAS) such as Traffic Jam Assist and Intelligent Auto Turn Indicators. The SUV also featured a redesigned Argyle-inspired diamond mesh grille, a 14-inch vertical touchscreen infotainment system (the largest in the segment), a digital Bluetooth key with key-sharing capability, and an upgraded iSMART interface with over 75 connected features. Resale and ownership metrics have also played in Hector's favour. According to data from vehicle platform Droom, the Hector retains 70 to 75 per cent of its resale value, outperforming several competitors in the segment. This strong resale is complemented by low maintenance costs, estimated at around ₹500 per month on average. Fuel efficiency on the diesel variant has also been a key strength, with highway mileage reported at up to 21 km per litre. As it completes six years in the Indian market, the MG Hector has carved out a space for itself as a technology-forward SUV with an ownership experience aimed at long-term reliability and value. From being India's first internet car to adding new benchmarks in connected tech, it remains a noteworthy case study in how to localise and differentiate in an evolving auto landscape.
Time of India
26 minutes ago
- Time of India
Microsoft brings AI-powered CoPilot mode in Edge browser for free
Microsoft has introduced a new CoPilot mode in Edge web browser. The feature uses artificial intelligence (AI) to enhance the browsing experience. Announcing the new AI mode, the software giant said 'As AI begins to reshape nearly every facet of digital life, we're witnessing a turning point in how we interact with the web.' Tired of too many ads? go ad free now 'This is why today we're excited to launch Copilot Mode, a new experimental mode in Microsoft Edge, and our next step towards building a more powerful way to pilot the web,' it added. CoPilot mode in Edge browser: How to use Microsoft announced that Copilot Mode is available for free for a limited time in all Copilot-supported markets. The feature is accessible exclusively on Microsoft Edge for both Windows and Mac users. The company further added that Copilot Mode is optional and must be turned on manually. To get started, users can visit and enable Copilot Mode today. CoPilot mode comes to Edge browser: What is means for users As announced by the company, Copilot mode aims to make web browsing more useful and efficient, helping users stay focused, save time, and get more done with less effort. With Copilot Mode, users can let the AI see all open tabs—if they give permission—so it understands the full context of what they're researching online. This allows Copilot to deliver better suggestions and quicker comparisons. For instance, if someone is checking different vacation rentals across multiple websites, they can ask Copilot which one is closest to the beach and includes a full kitchen, helping them make faster and more informed decisions with less tab switching. The feature also supports voice navigation. Users can speak directly to Copilot to ask for help with tasks such as finding specific information on a page or opening tabs for side-by-side comparisons. Tired of too many ads? go ad free now This reduces the need for constant clicking and typing, speeding up everyday browsing tasks. Microsoft is also working on additional features that will let Copilot access more of the browser context—like search history and saved logins—only if the user agrees. This would allow Copilot to take actions on the user's behalf, such as making reservations, checking weather, and even suggesting related items like sunscreen or how-to videos. Copilot appears in a side pane, so users can interact with it without losing their place on the current webpage. It helps with quick actions like translating text or converting recipe measurements, all while keeping the main content visible. Soon, Copilot will be able to guide users through ongoing tasks by organising browsing history into topic-based journeys. For example, if someone has been reading about starting an online business, Copilot may suggest helpful next steps like watching a website-building tutorial. CoPilot mode in Edge browser works only with the user's permission and provides clear on-screen indicators when it's active. Users can turn Copilot Mode on or off at any time, and their data is protected under Microsoft's privacy standards.
