Microsoft rolls out Copilot Vision for Windows
Microsoft has launched Copilot Vision for Windows in the U.S. so users are able to analyse content, offer insights and direct them when required. An extension of the Copilot assistant, it helps users share their screen or apps so the AI assistant can guide them through features or webpages.
'With Highlights, you can go a step further and ask Copilot 'show me how' for a specific task and it will show you within the app where to click and what to do. Altogether, Copilot can be by your side giving you tips while playing a game, viewing your photo and showing you how to improve the lighting to make it perfect, or reviewing your travel itinerary to let you know if your packing list is sufficient based on your destination,' the Copilot team said in a blog.
Users will have to enable Copilot Vision via a glasses icon and then choose a browser window or app that you wish to share with the assistant.
Microsoft started testing the feature earlier this year. Copilot for Vision is now free for U.S. users on Windows 10 and 11.
Just yesterday, it was reported that a group of researchers found a flaw in Copilot which could have been exploited to extract user data drawing attention to the vulnerabilities around AI agents.
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Economic Times
an hour ago
- Economic Times
Meta's $14.8 billion Scale AI deal latest test of AI partnerships
Facebook owner Meta's $14.8 billion investment in Scale AI and hiring of the data-labeling startup's CEO will test how the Trump administration views so-called acquihire deals, which some have criticized as an attempt to evade regulatory scrutiny. The deal, announced on Thursday, was Meta's second-largest investment to date. It gives the owner of Facebook a 49% nonvoting stake in Scale AI, which uses gig workers to manually label data and includes among its customers Meta competitors Microsoft and ChatGPT creator OpenAI. Unlike an acquisition or a transaction that would give Meta a controlling stake, the deal does not require a review by US antitrust regulators. However, they could probe the deal if they believe it was structured to avoid those requirements or harm competition. The deal appeared to be structured to avoid potential pitfalls, such as cutting off competitors' access to Scale's services or giving Meta an inside view into rivals' operations - though Reuters exclusively reported on Friday that Alphabet's Google has decided to sever ties with Scale in light of Meta's stake, and other customers are looking at taking a step back. In a statement, a Scale AI spokesperson said its business, which spans work with major companies and governments, remains strong, as it is committed to protecting customer data. The company declined to comment on specifics with Google. Alexandr Wang, Scale's 28-year-old CEO who is coming to Meta as part of the deal, will remain on Scale's board but will have appropriate restrictions placed around his access to information, two sources familiar with the move confirmed. Large tech companies likely perceive the regulatory environment for AI partnerships as easier to navigate under President Donald Trump than under former President Joe Biden, said William Kovacic, director of the competition law center at George Washington University. Trump's antitrust enforcers have said they do not want to regulate how AI develops, but have also displayed a suspicion of large tech platforms, he added. "That would lead me to think they will keep looking carefully at what the firms do. It does not necessarily dictate that they will intervene in a way that would discourage the relationships," Kovacic said. Federal Trade Commission probes into past "aquihire" deals appear to be at a standstill. Under the Biden administration, the FTC opened inquiries into Amazon's deal to hire top executives and researchers from AI startup Adept, and Microsoft's $650 million deal with Inflection AI. The latter allowed Microsoft to use Inflection's models and hire most of the startup's staff, including its co-founders. Amazon's deal closed without further action from the regulator, a source familiar with the matter confirmed. And, more than a year after its initial inquiry, the FTC has so far taken no enforcement action against Microsoft over Inflection, though a larger probe over practices at the software giant is ongoing. A spokesperson for the FTC declined to comment on Friday. David Olson, a professor who teaches antitrust law at Boston College Law School, said it was smart of Meta to take a minority nonvoting stake. "I think that does give them a lot of protection if someone comes after them," he said, adding that it was still possible that the FTC would want to review the agreement. The Meta deal has its skeptics. US Senator Elizabeth Warren, a Democrat from Massachusetts who is probing AI partnerships involving Microsoft and Google, said Meta's investment should be scrutinized. "Meta can call this deal whatever it wants - but if it violates federal law because it unlawfully squashes competition or makes it easier for Meta to illegally dominate, antitrust enforcers should investigate and block it," she said in a statement on Friday. While Meta faces its own monopoly lawsuit by the FTC, it remains to be seen whether the agency will have any questions about its Scale investment. The US Department of Justice's antitrust division, led by former JD Vance adviser Gail Slater, recently started looking into whether Google's partnership with chatbot creator was designed to evade antitrust review, Bloomberg News reported. The DOJ is separately seeking to make Google give it advance notice of new AI investments as part of a proposal to curb the company's dominance in online search.
Economic Times
11 hours ago
- Economic Times
AI's success must be measured in economic impact, not benchmarks: Satya Nadella
The true metric of success of artificial intelligence (AI) must be measured in terms of its economic impact and real growth in global gross domestic product (GDP), said Satya Nadella, chief executive, Microsoft. '…the ultimate measure for me always is not some AI benchmark, it is the GDP growth in the real world that means it's the growth in a firm. And that's, I think, where we're seeing absolutely real evidence that this is scaling,' he said in a conversation with Ali Ghodsi, founder and chief executive, Databricks, at the company's annual conference in San Francisco on Thursday. When asked about drawing the line between AI hype versus real value add, Nadella outlined how AI should serve as an amplifier of existing enterprise investments.'If the new technology somehow builds on the investments they've already made and compounds the effects for them, then that is a true value-add.'Nadella reflected on the acceleration in AI development across pre-training, inference, and application maturity over the last two years. 'It's the compounding effects of all the S-curves, right? There is the pre-training S-curve, and then there is now the test time compute S-curve. There is just the application tier getting a more mature S-curve… It's that combination that's been pretty stunning to see,' he said. He also described how human-AI interaction is progressing beyond conversational AI toward operational automation.'We started by saying, wow, I can now have intelligence that I can chat with. Then we said, oh, we can assign tasks to the intelligence, and now we effectively can have digital coworkers.' Nadella emphasised the enterprise-wide usage of AI agents along with tools like GitHub Copilot and Databricks connectors. 'You are now getting to a place where it's become standard issue… every employee inside the enterprise is able to either manage agents, create agents, orchestrate agents in order to create that next level of automation around them.' The two companies announced a multi-year extension of their decade-long partnership for the Azure Databricks cloud platform. Parallelly, Databricks also announced a new product partnership with Google Cloud to make the latest Gemini models available within Databricks' platform to build, deploy, and scale AI agents. (The reporter was in San Francisco at the invitation of Databricks).
Time of India
11 hours ago
- Time of India
Microsoft's Copilot Vision brings Google's Circle to Search-like functionality to Windows users
Microsoft has launched Copilot Vision for Windows, bringing screen-reading AI capabilities, much similar to Google's Circle to Search feature. The new tool, available free to all US users on Windows 10 and 11, can analyze any app or window you share with it, offering real-time guidance and insights. Tired of too many ads? go ad free now Unlike previous versions that only worked within web browsers, Copilot Vision now works with any app, file, or window you choose to share. Users can share up to two apps simultaneously, letting the AI connect information between different programs. Whether you're stuck in a game, editing photos in Photoshop, or planning events from your calendar, Copilot Vision acts as your digital assistant. The standout feature called "Highlights" goes beyond basic screen reading. Ask Copilot "show me how" for any task, and it will literally highlight where to click and what steps to follow within your apps. Imagine having a personal tutor pointing out exactly which buttons to press in complex software. Microsoft learned from past controversies with features like Recall. Copilot Vision requires explicit permission for each app you want to share – it's completely opt-in. The AI can only see what you actively choose to show it, putting users firmly in control of their privacy. Getting started is simple: open the Copilot app, click the glasses icon, select which windows to share, and start asking questions. The AI can summarize documents, explain error messages, or even help draft email replies based on what's on your screen. The feature is currently limited to the US, with plans to expand to other non-European countries soon.
