More Details About iOS 18's AI Features Revealed

Apple is planning to introduce new AI features including Smart Replies for messages and a generative retouch tool for photos in iOS 18, a new report claims.

Apple Silicon AI Optimized Feature Siri 1
A new article from AppleInsider today revealed some further detail about several of ‌iOS 18‌'s widely anticipated AI features. Siri is rumored to receive some major upgrades including:

  • Improved Responses: Significantly updated response generation capabilities with a new smart response framework that takes into account entities such as people, companies, calendar events, locations, dates, and more.
  • Enhanced Voices: "More natural" voices with better text-to-speech functionality.
  • Cross-Device Media Controls: Use ‌Siri‌ on one device to control playback on another, such as via the Apple Watch for the Apple TV. This feature is not expected to arrive until later in 2024.
  • Catch Up: Users can request an overview of their recent notifications via ‌Siri‌.

A range of other AI-powered features are also in the works for specific apps in ‌iOS 18‌:

  • Smart Replies: Allows users to reply to messages and emails with automatically generated text responses.
  • Transcription and Summarization: New AI tools for the Notes app allowing users to edit audio in the app, transcribe audio, and summarize text.
  • Math Notes: Support for proper mathematical notation in the Notes app with Calculator app integation. Math Notes will allow the Notes app to recognise mathematical equations and come up with solutions and generate graphs.
  • Keyboard Math Predictions: Input enhancements for mathematics enabling the completion of complex mathematical expressions when recognised as part of text input, similar to predictive text or inline text completion.
  • Clean Up: Remove objects from photos using generative AI. This tool will replace Apple's current "Retouch" feature.
  • Generative Playground: Application that uses generative AI to create and edit images with an iMessage app extension. It is currently designed for Apple's internal test environments only, but indicates that there are plans to allow users to generate images and then share them via iMessage. This could be related to rumored plans to allow users to generate custom emojis.

visionOS 2 will also apparently gain an improved predictive text model thanks to integration with Apple's Transformer LM, as well as a redesigned Voice Commands UI. Updates to the Calendar and Freeform apps, as well as System Settings for macOS, are also said to be planned. Apple's selection of new AI features are expected to be previewed during the company's WWDC keynote on June 10.

Related Roundups: iOS 18, iPadOS 18
Related Forums: iOS 18, iPadOS 18

Popular Stories

iOS 18

Apple Says iOS 18.4 Will Be Released in April With These New Features

Wednesday February 26, 2025 7:15 am PST by
In a recent press release, Apple confirmed that iOS 18.4 will be released in April. From the Apple News+ Food announcement:Coming with iOS 18.4 and iPadOS 18.4 in April, Apple News+ subscribers will have access to Apple News+ Food, a new section that will feature tens of thousands of recipes — as well as stories about restaurants, healthy eating, kitchen essentials, and more — from the...
Generic iPhone 17 Feature With Full Width Dynamic Island

Latest iPhone 17 Series CAD Images in Line With Redesign Rumors

Friday February 28, 2025 2:51 am PST by
Apple is expected to embrace a new camera system design for some models in its upcoming iPhone 17 series, and the latest purported CAD images don't deviate from what we have been hearing lately about Apple's new lineup. If you do not like the sound of an iPhone with a Google Pixel-style camera bar, look away now. Seasoned leaker Sonny Dickson shared the following images in a post on X...
iphone 16e usb c feature

Apple Provides Reason for iPhone 16e's Lack of MagSafe

Friday February 28, 2025 4:39 am PST by
Apple has offered a reason why the iPhone 16e doesn't include MagSafe, one of the more notable omissions from its latest entry-level smartphone. According to Apple representatives who spoke to Daring Fireball's John Gruber, MagSafe is not included in the iPhone 16e because "most people in the iPhone 16e's target audience exclusively charge their phones by plugging them into a charging...
apple intelligence black

These New Apple Intelligence Features Are Coming in iOS 18.4

Friday February 28, 2025 3:17 pm PST by
iOS 18.4 was supposed to bring new Apple Intelligence Siri features, but Apple ended up needing to pull those capabilities from the update to continue testing. There are fewer new Apple Intelligence additions now, but there are still some new features that will make the update worth installing when it comes out in April. Priority Notifications Apple introduced Priority Notifications back at ...
cook trump

Trump Responds to Apple Keeping Diversity Policies

Wednesday February 26, 2025 6:32 am PST by
In an all-caps post on Truth Social today, U.S. President Donald Trump said Apple should fully end its diversity, equity, and inclusion (DEI) policies. Tim Cook meeting with President Trump in 2017 "APPLE SHOULD GET RID OF DEI RULES, NOT JUST MAKE ADJUSTMENTS TO THEM," he wrote. Trump's post comes one day after Apple held its annual shareholders meeting, during which a majority of...
apple watch ultra snow

6 Features Coming to the Apple Watch Ultra 3

Tuesday February 25, 2025 9:00 am PST by
The Apple Watch Ultra 3 is expected to launch later this year, arriving two years after the previous model with a series of improvements. While no noticeable design changes are expected for the third generation since the company tends to stick with the same Apple Watch design through three generations before changing it, there are a series of internal upgrades on the way. By the time the ...
airpods pro purple

Here's When AirPods Pro 3 Are Rumored to Launch

Monday February 24, 2025 9:14 am PST by
According to a post on X today from a leaker known as Kosutami, Apple plans to launch AirPods Pro 3 in May or June this year. The leaker also claimed that an AirTag 2 will launch around the same time. Kosutami is best known as a collector of prototype Apple hardware, but they have occasionally shared accurate information about Apple's future product plans. For example, they accurately...
apple c1

How Fast is Apple's First-Ever 5G Modem? The Results Are Surprising

Friday February 28, 2025 10:08 am PST by
iPhone 16e reviews are now out, and Apple's custom-designed C1 modem has been put to the test. The results so far are quite surprising, as the C1's speeds are not as slow compared to Qualcomm modems as originally expected. While the C1 does not support ultra-fast mmWave 5G in the U.S., it appears to offer comparable 5G performance to Qualcomm's Snapdragon X71 modem found in the iPhone 16,...

Top Rated Comments

tomtad Avatar
10 months ago
Adding in features Google have had for years. Apple is really struggling here with years of underinvestment in this area
Score: 12 Votes (Like | Disagree)
GrayFlannel Avatar
10 months ago
None of these features would be possible if not for AI? ?
It would be nice if someone would start to provide the benefit features would receive from “AI” with specificity.
Score: 11 Votes (Like | Disagree)
BanjoDudeAhoy Avatar
10 months ago

None of these features would be possible if not for AI? ?
It would be nice if someone would start to provide the benefit features would receive from “AI” with specificity.
Kinda what I was thinking, too.
I feel like this is more in line with everyone else slapping a new label on an existing product that reads, “now with 100% more AI” with a logo that insinuates magic to tick buzzword boxes.
Score: 9 Votes (Like | Disagree)
abatabia Avatar
10 months ago
Cautiously optimistic is how I feel about all of this.
Score: 8 Votes (Like | Disagree)
WWPD Avatar
10 months ago
Does this mean that AI will learn to send a text to my boss Monday morning that I will be out "sick"? Hopefully it's smart enough to leave out the quotes.
Score: 8 Votes (Like | Disagree)
Foxglove9 Avatar
10 months ago
None of these features are something I would find useful. Curious to see what else will develop. Also possible iPadOS enhancements?
Score: 8 Votes (Like | Disagree)