5 cool on-device AI features of Microsoft Copilot+ PCs

Microsoft Copilot+ PCs are fast enough to run generative AI features on-device, including near real-time image generation from prompts.
Microsoft on May 20 announced Copilot+ PC, its AI-first computers with a custom neural processing unit for speeding up AI tasks capable of performing 40 trillion operations per second. It’s powerful enough to run advanced on-device models and support some generative AI features without requiring the power of the cloud.
Microsoft’s press release frames Copilot+ PCs as the “fastest, most intelligent Windows PCs ever built.” They can do 15 hours of web browsing or 22 hours of local video playback, one-upping the MacBook Air in terms of video playback.
Apple’s laptop offers 18 hours of video time in the TV app (wireless web time is the same 15 hours as with Copilot+ PCs). The first Copilot+ PCs from Acer, Asus, Dell, HP, Lenovo, and Samsung will arrive on June 18, starting at $999.
Microsoft Copilot+ PC: 5 cool on-device AI features
1. Recall
This records a history of everything you do on your computer so you can easily find and remember what you have seen. This works in apps, your documents and on websites, and you can jump to any previous snapshot on the timeline.
2. Cocreator
This is a generative AI feature for generating images from prompts, and you can quickly adjust the art style by dragging a slider. Microsoft says image generation happens “in near real-time” and directly on the device.
3. Restyle Image
This enables you to make quick adjustments to the overall look and feel of your generated images with virtually no effort. Instead of interacting with sliders and layers, you just choose from various presets to apply different styles. You can then apply the selected style to just the foreground, just the background or the whole image.
4. Live Captions
This feature helps you bridge language barriers by translating audio from 40+ languages into English in real-time. This works in any app that produces audio, including live or pre-recorded audio that passes through the computer.
5. Quick Settings
Quick Settings in Windows Studio Effects lets you apply automatic video effects and filters during video calls to improve image quality, boost low-light scenes, etc.
Don’t confuse the Quick Settings feature with another AI-powered feature that lets you quickly change settings through prompts instead of scrolling and searching, as demonstrated on the video embedded below.
And here’s text summarization with Copilot+ in Windows 11.
The rumored AI features coming with iOS 18
Apple is rumored to adopt a mixed approach to AI in iOS 18. Some of the AI capabilities in iOS 18 will apparently run on-device, including Apple’s large language model and less-demanding generative AI features. For others, Apple will reportedly use OpenAI’s technology.
Apple is also rumored to use custom servers running M2 Ultra chips to better support the new features. Mark Gurman wrote in the latest edition of his Power On newsletter for Bloomberg that iOS 18’s AI will summarize iPhone notifications and news articles, transcribe voice memos, improve existing features that auto-populate your calendar, suggest apps and more.
“There will also be some enhancements to photos in the form of AI-based editing, but none of those features will impress people who have used AI in Adobe’s apps for the last several months,” he wrote.
Apple to preview iOS 18 and more at WWDC24
Apple will preview iOS 18 and other software at the upcoming Worldwide Developers Conference on June 10. The updates will be released to the public in the fall, probably ahead of the new iPhones in September.
Source link: https://www.idownloadblog.com/2024/05/21/microsoft-copilot-plus-on-device-ai-features-roundup/
Leave a Reply