iOS 18.1 and Beyond: Siri's Apple Intelligence Features

With Apple Intelligence, Apple is aiming to make Siri smarter than ever before. The personal assistant is going to be able to learn more about you, do more in apps, and hand over the reins to a smarter virtual assistant when needed.

Apple Intelligence General Feature
Some new ‌Siri‌ features are available now, while some won't be coming until 2025. This guide highlights everything that's new with ‌Siri‌ thanks to ‌Apple Intelligence‌.

Updated Siri Design

‌Siri‌ has a refreshed design on devices that support ‌Apple Intelligence‌. Rather than the small wavelength that used to show when activating ‌Siri‌, there's now a pink/purple/blue/orange variegated glow that wraps around the entire iPhone, with the colors shifting as ‌Siri‌ listens to a command.

ios 18 new siri design

Better Language Understanding

‌Siri‌ can better understand conversational language and requests, so if you stumble over your words or change your mind mid-sentence, ‌Siri‌ can still follow what you're saying.

ios 18 siri context follow up
‌Siri‌ is also able to maintain context between requests, so you can refer to something in a previous request, and ‌Siri‌ will understand what you're talking about. So if you use ‌Siri‌ to create a calendar event, you can then just ask "What will the weather be like there?" and ‌Siri‌ knows where "there" is.

Improved Voice

‌Siri‌ has a new, more natural sounding voice.

Type to Siri

There is a built-in Type to ‌Siri‌ feature so you don't need to speak to ‌Siri‌ to interact with the personal assistant. To use it, double tap on the bottom of the ‌iPhone‌ or iPad to bring up a text bar, and then from there, just type in your request.

type to siri 1
Type to ‌Siri‌ can be used in the same way as speaking to ‌Siri‌, and ‌Siri‌ is able to provide information without speaking aloud. It is a useful feature for public situations where you're not able to speak and do not want to have ‌Siri‌ speaking back to you.

Siri on the Mac

While this guide focuses on the ‌iPhone‌ and the ‌iPad‌, the new, smarter ‌Siri‌ is also available on the Mac. Type to ‌Siri‌ can be enabled in the Settings app, and it can be assigned to a shortcut, such as pressing the Command button twice.

Apple Product Knowledge

Apple taught ‌Siri‌ about all of its products, so if you want to know how to use a feature or how to complete a task, you can ask ‌Siri‌ for help. ‌Siri‌ can provide step-by-step directions on using ‌iPhone‌, ‌iPad‌, and Mac features.

ios 18 siri product knowledge

ChatGPT Integration (iOS 18.2)

In iOS 18.2, ChatGPT integration is available with ‌Siri‌. If a user asks something that ‌Siri‌ is not capable of handling, ChatGPT can provide a response instead, so long as the user gives permission.

ios 18 2 trivia chatgpt
‌Siri‌ can tap into ChatGPT, and then relay ChatGPT's response with no need to switch apps or use other tools.

The ‌Siri‌ ChatGPT integration can essentially be used to do anything you can do with the ChatGPT app or ChatGPT on the web, it's simply an easier way to get to ChatGPT.

Object Identification

For anything on your screen, such as an image, you can ask ‌Siri‌ a question about it. If you have a photo of a plant, for example, asking "What is this?" will prompt ‌Siri‌ to send a screenshot over to ChatGPT, and ChatGPT will attempt to provide context.

chatgpt what is this
This works with images on the web, your photos, the something you're viewing through the Camera app, text, and more.

ChatGPT can be used to describe a scene, which is useful for people who might have issues with sight. Opening the Camera app, activating ‌Siri‌, and asking "What is this?" will provide a detailed description of whatever is in front of you.

chatgpt siri image identification
The option to send images to ChatGPT from screenshots is distinct from the ‌Siri‌ onscreen awareness feature that Apple plans to implement in the future.

Info From Documents

For emails, documents, PDFs, and more, ChatGPT can provide a summary. When you ask "Can you summarize this?" ‌Siri‌ will send a screenshot or the entire document, which includes full PDFs. It's a useful feature for getting a quick overview of the content of a long document.

chatgpt summarize pdf
For long PDFs or documents, you'll want to tap on the arrows to make sure the full document is sent to ChatGPT rather than just a screenshot.

Rather than asking for a summary, you can instead ask a specific question about a document. If you're looking at an insurance policy, you can ask "What are the limits of this policy?" or "What are the exclusions?" to get more tailored information.

Checking Spelling and Grammar

If you've written an email, rather than selecting it and using Writing Tools to check it for spelling and grammar errors, you can ask ‌Siri‌ to take a look, and ‌Siri‌ will send a screenshot to ChatGPT. "Can you look this over for errors?" works as a command for this feature.

chatgpt check grammar
ChatGPT can also be used for rewriting and refining what you've written, but note that this is not the same as Apple's own Writing Tools.

Generating Text and Images

ChatGPT can generate text from scratch based on prompts that it is given. You can, for example, ask ‌Siri‌ to ask ChatGPT to write a poem or compose a polite letter to a friend, and ChatGPT will create something from scratch.

chatgpt apple haiku
Some sample requests you can use:

  • Write me a poem about Apple
  • Create a song about Google
  • Help me write a letter to my friend
  • Write three paragraphs about orange cats
  • Write me a social media post about Thanksgiving
  • Rewrite this to be more concise
  • Create a bedtime story about a dragon

If you have ChatGPT write something for you, you can tap on the copy icon to copy it to the clipboard to paste it into Notes, Messages, a document, or an email.

You can also create images. Using the Dall-E 3 engine, ChatGPT can make realistic AI-generated images, something that can't be done with ‌Apple Intelligence‌. For image requests, it's easiest to tell ‌Siri‌ to "Tell ChatGPT to make an image of [thing you want an image of]," because if you just ask ‌Siri‌ to make an image or generate an image, it will often bring up web images.

ios 18 2 chatgpt image generation

Answering Questions

One of the best use cases for ChatGPT through ‌Siri‌ is getting answers for queries that are just a bit too complex for ‌Siri‌. Questions that ‌Siri‌ can't handle will be handed over to ChatGPT with your permission, but you can also force ‌Siri‌ to use ChatGPT instead of the internal ‌Siri‌ engine by amending questions with "Ask ChatGPT."

ask chatgpt siri ios 18 2
For example, a question about what battery an Xbox controller uses will source Wikipedia and not ChatGPT, but specifically "Ask ChatGPT what battery an Xbox controller uses" will prompt ‌Siri‌ to present the question to ChatGPT.

ios 18 2 chatgpt siri integration question
ChatGPT's answers can sometimes be more informative. Asking ‌Siri‌ how to replace eggs in a recipe just gives you alternatives, but ChatGPT's answer for the same question provides the amount of an ingredient you might want to add to equate to an egg.

Some example queries that ‌Siri‌ will automatically consult ChatGPT on:

  • What are five types of edible mushrooms in North Carolina?
  • What should I pack for a beach trip in winter?
  • What are must see places in Paris?
  • What should I do this weekend?
  • I want a recipe for banana bread
  • Give me instructions on cutting a mango
  • When is avocado season?
  • Suggest good songs for a quiet Friday night
  • What's a good indoor activity to do when it's raining?

Other Things You Can Ask ChatGPT To Do

  • Write code
  • Debug code
  • Get help with homework
  • Do calculations, translations, conversions, and more
  • Generate gift ideas
  • Come up with names for businesses, pets, characters, and more
  • Create trivia questions or riddles
  • Plan trips
  • Create meal plans
  • Get recipes for ingredients you have
  • Generate jokes
  • Suggest movies, TV shows, and books based on specific parameters
  • Summarize TV shows and movies
  • Generate drawing/writing prompts

While ‌Siri‌ can do all of these things with ChatGPT's help, the lack of continuity with the ‌Siri‌ version of ChatGPT makes it difficult to complete tasks that are not one-off requests. Creating a meal plan, for example, works better with the actual ChatGPT interface because you can have more of a conversation rather than relying on a single request.

ChatGPT Settings and Privacy

ChatGPT integration has to be turned on, and after that, each request requires user permission. There is an option to turn off the extra permission by toggling off the "Confirm ChatGPT Requests" option.

The toggle can be accessed by opening up the Settings app, choosing ‌Apple Intelligence‌, and then tapping on ChatGPT. With the feature disabled, ‌Siri‌ will not ask each time before sending information to ChatGPT.

‌Siri‌ will, however, always ask permission before sending a file to ChatGPT even with the confirm requests feature turned off.

As for privacy, no login is required to use ChatGPT, and neither Apple nor OpenAI log your requests. But if you sign in with a paid account, ChatGPT can keep a copy of requests.

ChatGPT - Free vs. Paid

ChatGPT integration includes a limited number of requests that use ChatGPT-4o, the latest version of ChatGPT, for free. After those are used up, ChatGPT integration uses 4o Mini, which is less advanced and takes up less resources.

chatgpt plus integration ios 18 2
ChatGPT Plus subscribers get more ChatGPT-4o requests. ChatGPT Plus is priced at $20 per month, and ‌iPhone‌ users who don't already have ChatGPT Plus can sign up right from the ‌Apple Intelligence‌ section of the Settings app.

Apple users essentially have access to ChatGPT's basic plan, so requests that use advanced capabilities reset every 24 hours. With this plan, two images per day can be generated.

ChatGPT vs. Apple Intelligence

There is overlap between what's possible with ‌Apple Intelligence‌ and what you can do with ChatGPT integration, but there are some distinctions. ‌Apple Intelligence‌ has Writing Tools for rewriting and editing what you've already written, but ChatGPT can write content from scratch.

Image Playground, Image Wand, and Genmoji allow you to generate images, but ‌Apple Intelligence‌ won't generate realistic looking images. Instead, styles are limited to those that look animated or sketched. ChatGPT will generate lifelike images, though.

‌Apple Intelligence‌ can be used to summarize documents, but only when you select text and select the Summarize option from Writing Tools. ‌Apple Intelligence‌ can't answer more specific questions about PDFs and documents, so ChatGPT does have an edge for that kind of query.

ChatGPT Limitations

When you ask ChatGPT a question through ‌Siri‌, you need to make sure to read the answer right away because it doesn't stay on the screen long. Apple does not keep a record of it, either.

If you're logged into ChatGPT, there is a history in your OpenAI account, but if you're not logged in, there's no way to save information that you've received from ChatGPT, and there's no log.

Other Chatbots

Apple has only added ChatGPT integration right now, but support for Google Gemini is planned in the future.

Siri Apple Intelligence Features Coming Next Year

There are several ‌Siri‌ features that are still in development, with Apple planning to add these capabilities to ‌Siri‌ next year. Timing isn't concrete yet, but rumors suggest we'll see them in iOS 18.4 in the spring.

Personal Context

‌Siri‌ will be able to keep track of your emails, messages, files, photos, and more, learning more about you to help you complete tasks and keep track of what you've been sent.

  • Show me the files Eric sent me last week.
  • Find the email where Eric mentioned ice skating.
  • Find the books that Eric recommended to me.
  • Where's the recipe that Eric sent me?
  • What's my passport number?

Onscreen Awareness

‌Siri‌ will be able to tell what's on your screen and complete actions involving whatever you're looking at. If someone texts you an address, for example, you can tell ‌Siri‌ to add it to their contact card. Or if you're looking at a photo and want to send it to someone, you can ask ‌Siri‌ to do it for you.

Deeper App Integration

‌Siri‌ will be able to do more in and across apps, performing actions and completing tasks that are just not possible with the personal assistant right now. We don't have a full picture of what ‌Siri‌ will be capable of, but Apple has provided a few examples of what to expect.

  • Moving files from one app to another.
  • Editing a photo and then sending it to someone.
  • Get directions home and share the ETA with Eric.
  • Send the email I drafted to Eric.

The Next Siri Phase

After all of the ‌Siri‌ ‌Apple Intelligence‌ features have been implemented in iOS 18, Apple plans to unveil the next-generation ‌Siri‌, which will rely on large language models. An LLM version of ‌Siri‌ is already in development, and it will be able to better compete with chatbots like ChatGPT.

LLM ‌Siri‌ will be able to hold ongoing conversations, and it will be more like speaking with a human. Large language model integration will let ‌Siri‌ perform more complex tasks, and in the future, ‌Siri‌ likely won't need to rely on ChatGPT.

The updated version of ‌Siri‌ will replace the current version of ‌Siri‌ in the future. Apple is expected to announce LLM ‌Siri‌ in 2025 alongside the introduction of iOS 19, but the update likely won't launch until spring 2026.

Apple Intelligence Privacy

‌Apple Intelligence‌ was designed with privacy in mind, and many requests are handled on-device. All personal context learning, for example, is done with on-device intelligence and nothing leaves your ‌iPhone‌ or ‌iPad‌.

For requests that need the processing power of a cloud server, Apple is using Private Cloud Compute on Apple silicon machines to handle complex tasks while preserving user privacy. Apple promises that data is not stored and is used only for user requests.

Apple Intelligence Compatible Devices

‌Apple Intelligence‌ is available on the iPhone 15 Pro, the ‌iPhone 15‌ Pro Max, all iPhone 16 models, the iPad mini with A17 Pro chip, all iPads with an Apple silicon chip, and all Macs with an Apple silicon chip.

Read More

We've shared detailed guides on ‌Genmoji‌ and ‌Image Playground‌ already, plus we have an overall guide on the full set of ‌Apple Intelligence‌ features and a guide for the general features coming in iOS 18.2.

Release Date

iOS 18.2 and iPadOS 18.2 with ‌Image Wand‌ integration will be coming in December, with Apple likely planning for a December 9 software release.

Related Roundups: iOS 18, iPadOS 18
Related Forums: iOS 18, iPadOS 18

Popular Stories

iphone 16 pro models 1

First iPhone 17 Pro Design Leak Claims Surprising Return to Aluminum, Rectangular Camera Bump, and More

Monday November 25, 2024 8:07 am PST by
Apple's iPhone 17 Pro and iPhone 17 Pro Max will offer "significant design changes," The Information's Wayne Ma reports. The two flagship iPhone 17 models will be the first high-end iPhones to feature an aluminum frame since the delineation of the iPhone lineup into Pro and non-Pro models. In recent years, lower-end iPhone models such as the iPhone SE and iPhone 16 have featured aluminum...
Generic iPhone 17 Feature With Full Width Dynamic Island single camera

'iPhone 17 Air' Features Revealed in New Report: As Thin as 5mm, Single Speaker, and More

Monday November 25, 2024 8:40 am PST by
The Information's Wayne Ma and Qianer Liu today published an in-depth report about the "iPhone 17 Air," revealing several new details about the device. The report said prototypes of the device have a thickness of between 5mm and 6mm, which would make it the thinnest iPhone ever. In comparison, iPhone 16 models are 7.8mm thick and iPhone 16 Pro models are 8.25mm thick. Due to this...
airpods pro bulbs

Apple Black Friday Deals Available Now: AirPods, iPads, and More

Friday November 22, 2024 5:28 am PST by
Black Friday 2024 is just a few days away, and as always this will be the best time of the year to shop for great deals. Right now, this includes big savings on popular Apple products like AirPods, Apple Watch, MacBook Air, iPad, and more. Note: MacRumors is an affiliate partner with some of these vendors. When you click a link and make a purchase, we may receive a small payment, which helps...
ipads early bf deals

7 Best Black Friday iPad Deals for 2024

Saturday November 23, 2024 1:44 pm PST by
We're less than one week away from Black Friday on November 29, and Best Buy and Amazon currently have all-time low prices across Apple's entire iPad lineup. This includes Apple's 9th and 10th generation iPad, iPad mini 7, iPad Air, and iPad Pro. Note: MacRumors is an affiliate partner with some of these vendors. When you click a link and make a purchase, we may receive a small payment, which...
new streaming black friday

Black Friday Streaming Deals Include Big Savings on Disney+, Hulu, Paramount+, and Peacock

Wednesday November 27, 2024 7:30 am PST by
We've been focusing on deals on physical products over the past few weeks, but Black Friday is also a great time of year to purchase a streaming membership. Some of the biggest services have great discounts for new and select returning members this week, including Disney+, Hulu, Paramount+, and Peacock. Note: MacRumors is an affiliate partner with some of these vendors. When you click a link...
M4 M4 Pro vs M4 Max Feature

When to Expect New M4 MacBook Air, Mac Studio, and Mac Pro Models

Tuesday November 26, 2024 4:08 am PST by
Apple's fall 2024 Mac announcements have included new iMac, Mac mini, and MacBook Pro models, all of which debuted with variants of Apple's M4 chip. Apple intends to update the rest of its Mac lineup with M4 series processors over the next 12 months, which will make it the first time that Apple has used the same chip generation across all of its Macs. This means we can expect new M4...
iPhone 17 Pro Dual Tone Rectangle Feature 1

iPhone 17 Pro Already Rumored to Have These 8 New Features

Wednesday November 27, 2024 12:19 pm PST by
While the iPhone 17 Pro and iPhone 17 Pro Max are not expected to launch for 10 more months, there are already plenty of rumors about the devices. An imaginative iPhone 17 Pro concept based on rumors Below, we recap key changes rumored for the iPhone 17 Pro models so far: Aluminum frame: iPhone 17 Pro models are rumored to have an aluminum frame, whereas the iPhone 15 Pro and iPhone 16 Pro ...

Top Rated Comments

ZipZilla Avatar
2 hours ago at 04:17 pm
Siri sucks as much in 18.1 as it did the day it came out. Brutal.
Score: 2 Votes (Like | Disagree)
HiVolt Avatar
2 hours ago at 04:54 pm
Honestly they should have just kept Apple Intelligence release for iOS 19. This silly staggered release is dumb.
Score: 2 Votes (Like | Disagree)
Unity451 Avatar
3 hours ago at 03:54 pm
I use chatGPT daily. I've tried to use Apple Intelligence on Mac OS, and have found that it's not actually very helpful compared to using chatGPT natively. Maybe I'm missing something.
Score: 2 Votes (Like | Disagree)
Kaos22 Avatar
2 hours ago at 04:53 pm

Siri sucks as much in 18.1 as it did the day it came out. Brutal.
One of the truly more amazing recent discoveries in tech is just how far behind and flat footed Apple has been exposed on personal AI. A personal tech Jobs left them with a huge advantage. We will see how it all plays out, but this is, or should be, truly embarrassing for Timmy and Apple exec management.
Score: 1 Votes (Like | Disagree)
antiprotest Avatar
2 hours ago at 04:06 pm
Apple is not doomed, but just as many big companies eventually fell behind in certain categories -- Microsoft, HP, Sony, Panasonic, Polaroid, Motorola, Blackberry, etc., etc. -- Apple has been showing signs of losing in some categories to other companies, including some newcomers. I hope Apple does not become -- or stop being -- complacent, or trip itself up due to bureaucracies, or whatever reasons big companies fall behind. Because we do see the signs, and it's been going on for a number of years now. No, Apple is not doomed, but it's showing cracks in places where there do not have to be.
Score: 1 Votes (Like | Disagree)