Rumor: iOS 18 AI can generate basic on-device responses from prompts, documents, web pages and your chats
Apple’s AI and large language models in iOS 18 may enable Siri and Spotlight Search to produce responses from prompts even while offline.
Marko Zivkovic over at AppleInsider has learned that Apple’s large language models based on the Ajax web development techniques will allow iOS 18 to respond to many user prompts without connecting to the cloud, preserving your privacy.
GPT-like generative AI in iOS 18, such as text summarization and document analysis, will reportedly work not only in system features like Siri and Spotlight Search but also across preinstalled Apple apps such as Safari, Mail and Messages.
Rumor: iOS 18’s AI to boost Siri capabilities across apps
For example, iOS 18’s AI-enhanced Safari will be able to summarize web articles and documents with a new feature called Intelligent Browsing.
Apple’s built-in AI software can analyze the keywords and phrases within a webpage or document and generate a short summary containing only the most important information.
Siri, on the other hand, should bring a similar summarization feature to the Messages app and be able to generate responses on your behalf.
Siri is also due to receive a similar update, according to people familiar with Apple’s plans, as the company intends to integrate the digital assistant more closely with its built-in Messages application.
We’ve heard about Apple’s possible approach to the AI craze before—Bloomberg’s Mark Gurman said many AI features in iOS 18 “will work entirely on the device.”
Spotlight Search will benefit from AI, too
Spotlight Search will also be able to generate responses in apps like Contacts and Calendar. Zivkovic explains that iOS 18’s AI will help improve the Spotlight Search feature by producing higher-quality results and improving sorting.
Longer responses may require cloud-based processing
While iOS 18 can apparently generate “sentence-long responses” in milliseconds without cloud-based processing, longer replies and more complex summaries will require the power of the cloud, the report has it. Earlier reports said Apple might license cloud-based AI technology from OpenAI, Google and Baidu to help with that.
“As for generating text from a prompt, Apple reportedly explored ways of doing this entirely on-device, but it remains unclear whether it succeeded in accomplishing offline text generation,” Zivkovic writes.
Some AI features may require new hardware
Zivkovic writes that Ajax-driven generative AI in iOS 18 will be able to generate shorter responses entirely on-device, even when the device is offline. According to Bloomberg’s Mark Gurman, Apple’s developed a more powerful Neural Engine to support the above features, which should arrive in the next iPhone.
Neural Engine is a dedicated coprocessor embedded within Apple silicon that is designed to run AI tasks faster than the CPU or GPU can without taxing the batter.
Apple to let loose on May 7
A beefed-up Neural Engine may arrive as soon as this month. Apple is expected to unveil new iPads at its May 7 “Let Loose” event, including the next iPad Pro which might use the Apple M4 chip said to include a Neural Engine with many more cores.
All Apple silicon chips feature a Neural Engine section, and the M4 will be no exception. If the next iPad Pro really ends up being powered by the M4, the tablet will file as Apple’s first device that uses a much improved Neural Engine.
Source link: https://www.idownloadblog.com/2024/05/03/ios-18-ai-prompts-responses-on-device-rumor/
Leave a Reply