Microsoft could soon let Copilot see your entire screen, but that’s not a bad thing
Microsoft
Microsoft is testing a new feature on Copilot, and this time, it’s coming to PC. Copilot Vision, recently made available on mobile, is now available for testing on PC, and the capabilities are both awe-inspiring and a little scary. Microsoft is also giving file search an AI boost.
Copilot Vision will allow the app to see everything on your screen — provided you’ll want it to. You can share browser windows, your entire desktop, or even a game to get real-time feedback from Copilot. Upon launch, you’ll choose which browser window or app you want to share with Copilot, and from then on, you’ll be able to speak to Copilot the way you would to a tech support agent. You can stop sharing at any given time.
Microsoft shared a screenshot of the feature, showing a Word file being shared with the app. You can talk to Copilot Vision by voice or by text, and the app is said to guide you through the process of whatever you’re trying to do.
The Verge showed off a demo of Copilot Vision that was made available for testing during Microsoft’s 50th anniversary party. You could see Copilot respond to questions during a game of Minecraft, giving the user advice on what to do with certain items. It also guided the user through video editing in Clipchamp, complete with highlighting something on their screen. That last part, the highlighting, isn’t coming in this beta build yet, but it will be available eventually.
Microsoft is also making file search more natural in Windows. The Copilot app will soon be able to help you find files on your PC. You can ask questions such as “Can you find my resume”, and Copilot will know what to look for. Fortunately, you can adjust the permissions for what Copilot is and isn’t allowed to see.
According to the announcement on Microsoft’s Windows blog, the features are rolling out to Windows Insiders in the United States. This means that we won’t all be able to try them out, and it might take a while for Copilot Vision to be rolled out to a broader audience.
Monica is a computing writer at Digital Trends, focusing on PC hardware. Since joining the team in 2021, Monica has written…
Microsoft Copilot is invading your favorite chat apps
It’s not just you — Microsoft is putting Copilot just about anywhere, and now it’s available on Telegram as a bot that’s part of its “copilot-for-social” project. Windows Latest reports that to use the bot, you’ll need to confirm your phone number by sending your contact in the chat. The company is expanding its AI integration into one of the most popular messaging apps, but it might not end there.
Microsoft claims that it won’t save your phone number for anything other than verification, but it’s needed because the service is currently unavailable for anyone in the EU, at least for now. If anyone in the EU tries to access it, they will be blocked.
Google Bard could soon become your new AI life coach
Generative artificial intelligence (AI) tools like ChatGPT have gotten a bad rep recently, but Google is apparently trying to serve up something more positive with its next project: an AI that can offer helpful life advice to people going through tough times.
If a fresh report from The New York Times is to be believed, Google has been testing its AI tech with at least 21 different assignments, including “life advice, ideas, planning instructions and tutoring tips.” The work spans both professional and personal scenarios that users might encounter.
The next Vision Pro could let you see invisible energy
Before it launched, there was concern that Apple’s Vision Pro headset could struggle to find a strong ‘killer app.’ Well, Apple might have found one, as a fresh patent from the company explains that future versions of the device could let you see the invisible energy that floats around you.
No, we’re not talking about some kind of New Age mysticism. Instead, Apple is apparently working on letting the Vision Pro visualize things like electrical currents, radio signals, Wi-Fi output, and more. This ability could help engineers diagnose problems in your home, for example — or let you fix them yourself.
