Skip to Content

Here's What's New With Visual Intelligence in iOS 27

Visual Intelligence is getting a big upgrade in iOS 27. It's now easier to find than it was before, and there are new ‌Visual Intelligence‌ capabilities. Apple also expanded it to the iPad and the Mac, so you can use the same features across devices.

iOS 27 visual intelligence feature

Camera App

Apple moved ‌Visual Intelligence‌ to the Camera app in ‌iOS 27‌, and it's accessible through a new Siri Mode that lives with the Photo, Video, and other camera mode options. You can swipe over to ‌Siri‌ Mode and take a picture so ‌Siri‌ can see what you see.

ios 27 siri mode camera
‌Siri‌ will give you details about whatever you're looking at when you swipe down, and you can ask follow-up questions.

‌Siri‌ Mode replaces Camera Control as the primary method for accessing ‌Visual Intelligence‌, but you can still get to it by holding down the Camera Control button.

Smart Suggestions

‌Siri‌ Mode will suggest relevant actions based on what you're taking a photo of. If you take a photo of a plant, ‌Siri‌ will offer to identify it. If you take a photo of a plate of food, ‌Siri‌ can give you the nutritional information.

Siri Integration

‌Visual Intelligence‌ is integrated with ‌Siri‌ AI, and ‌Siri‌ can answer questions about what you're looking at. Complex questions were previously handed off to ChatGPT, but that's no longer necessary.

ios 27 visual intelligence nutrition
The smarter, more capable version of ‌Siri‌ can do much of what ChatGPT can do, pulling information from the web to answer questions.

New iOS 27 Visual Intelligence Features

  • Nutritional Insights - You can take a picture of a meal or a food item to check its nutritional value. ‌Siri‌ doesn't tell you specific calories in an item, but it can tell you if what you're eating has nutritional value and what's good or bad about it.
  • Bill Splitting (U.S. only) - If you take a photo of a restaurant bill, you can split out what you ate and then send money via Apple Cash. Or calculate what everyone owes and request money.
  • Import Multiple Events - You can import multiple events into the Calendar or Reminders app at one time from a schedule or list.
  • Import Contacts - You can import contacts from a photo of a business card.
  • Wallet Passes - You can turn a photo of a barcode from a membership or pass into a Wallet pass.

‌Visual Intelligence‌ is much more powerful than before because of ‌Siri‌'s ability to search the web for answers. It can read laundry labels and give you clear instructions, look up items and find reviews on the web, identify odd devices or cables and tell you what they're for, scale recipes, read ingredient lists for you to check for allergens, transcribe messy written notes or lists into text, decipher confusing parking signs, offer plant care advice, solve math problems on a worksheet, and whatever else you can think to ask AI to do.

Other Visual Intelligence Capabilities

‌Visual Intelligence‌ has a long list of things it can be used for, and these options have been available in earlier versions of iOS.

  • Identify plants, animals, insects, landmarks, art, sculptures, books, and more.
  • Add items to your calendar from a piece of paper like an event poster or flyer.
  • Use Google Image Search to find similar images.
  • Search Etsy, Amazon, Anthropologie, and other apps for an item that you capture with the camera.
  • Provide details about a business in front of you, like hours of operation.
  • Translate, summarize, and read text aloud.

Siri App Integration

All of your ‌Visual Intelligence‌ ‌Siri‌ requests are saved in the ‌Siri‌ app so you can revisit them later. The ‌Siri‌ app can be set to retain conversations for a month, a year, or forever.

Visual Intelligence on Other Platforms

Apple expanded ‌Visual Intelligence‌ to iPadOS 27, macOS Golden Gate, and visionOS 27. On Mac, you can use a Command-Shift-Space keyboard shortcut to access ‌Visual Intelligence‌ and select a part of your display to ask a question about. On ‌iPad‌, you can access ‌Visual Intelligence‌ by taking a screenshot or swiping up from the lower left corner with Apple Pencil.

On Vision Pro, you can use ‌Visual Intelligence‌ just by looking at something, including physical items around you.

Device Requirements

‌Visual Intelligence‌ in ‌iOS 27‌ requires an iPhone 15 Pro or later. For Mac, you need an Apple silicon chip, and on the ‌iPad‌, you need an Apple silicon chip or the A17 Pro iPad mini.

Availability

‌iOS 27‌ is available to developers and public beta testers, so you can try it out now ahead of its September launch.

Related Roundups: iOS 27, iPadOS 27
Related Forum: iOS 27

Popular Stories

iphone duo yellow hand

Apple Adds Facial Unlock Option on iPhone Duo in iOS 27.3

Monday November 16, 2026 10:17 am PST by
Apple today added a new option for unlocking the iPhone Duo using the front-facing camera, giving device users multiple ways to access their content. The feature is available in the second iOS 27.3 beta. The option to unlock with facial recognition is only available on the Lock Screen, and authentication via Touch ID is still needed for Apple Pay purchases, adding passwords and logins, and...
iOS 27

iOS 27.2 Features: Everything New in iOS 27.2

Monday October 26, 2026 3:56 pm PDT by
Apple released iOS 27.2, uniting the iPhone Duo and other iPhone models on the same version of iOS. iOS 27.2 is the first major iOS 27 update, and it adds several useful new features. Siri AI Improvements Siri AI can recall past conversations you had with it, so you can ask Siri about something it told you before, like a restaurant it previously recommended. It's also able to draw on more...
bug security vulnerability issue fix larry

Here's What Apple Fixed in iOS 27.2.1 and macOS 27.2.1

Monday November 9, 2026 3:07 pm PST by
The iOS 27.2.1, iPadOS 27.2.1, and macOS 27.2.1 updates Apple released today fix a handful of security vulnerabilities. With the security fixes implemented, it's a good idea to update as soon as you can. A bug with iMessage could let a remote attacker join a group chat to receive its messages, and another could let users see messages sent before they joined a group chat. Most of the...

Top Rated Comments

M4irmidnight Avatar
23 weeks ago
Can Siri be removed from the camera wheel ?
Score: 8 Votes (Like | Disagree)
fatTribble Avatar
23 weeks ago

Can Siri be removed from the camera wheel ?
I’m hoping we’ll at least be able to reorder items so that if you won’t use Siri often you can put it at the end.
Score: 7 Votes (Like | Disagree)
chars1ub0w Avatar
23 weeks ago
Which parts of visual intelligence are on-device and which parts require an internet connection to Apple servers?
Score: 6 Votes (Like | Disagree)
23 weeks ago
* Nutritional Insights - You can take a picture of a meal or a food item to check its nutritional value. ‌Siri‌ doesn't tell you specific calories in an item, but it can tell you if what you're eating has nutritional value and what's good or bad about it.

This sounds like exactly the kind of brain-dead thing that people who use AI think will actually work and help them.
Score: 5 Votes (Like | Disagree)
22 weeks ago

Right? Nutrition is complex. Whilst I accept the at least trying to check the nutritional value of food is better than nothing, it can't be reduced to a basic traffic-light system or simple sliding scale. Everyone's needs are different and whilst there are some broadly good and broadly bad food stuffs for everyone, you need to properly understand what you are consuming and why. A quick -"AI says it's good" is not going to do it.
Not only is nutrition complex, it's beyond absurd to think that a photograph can tell you anything about how healthy a meal of even moderate complexity is — whether it was made with whole grains, how much fat or sodium is in it, what kind of fat, how much protein, whether sugar was added, what all the ingredients are if they were blended. These things just aren't visible. Anyone who has thought about nutrition for more than a minute can understand this. People who keep thinking AI is finally going to work reliably, like magic, are probably the biggest dupes in world history. It's right up there with the monarchy convincing people they ruled by divine right. I feel stupider already just thinking about having to live in a world with this kind of thing.
Score: 3 Votes (Like | Disagree)
Taq'aix Avatar
23 weeks ago
This IS totally not going to cause cognitive atrophy.
Score: 3 Votes (Like | Disagree)
Latest Stories
Apple Black Friday Deals Available Now: AirPods, Apple Watches, MacBooks, and More
Apple Black Friday Deals Available Now: AirPods, Apple Watches, MacBooks, and More
7 hours ago
Apple Store in UK Permanently Closing Today
Apple Store in UK Permanently Closing Today
7 hours ago
Siri AI Settlement: Here's How Much Apple Will Pay You
Siri AI Settlement: Here's How Much Apple Will Pay You
7 hours ago
RIP, Apple Support Community
RIP, Apple Support Community
7 hours ago
Top Stories: iPhone Duo Face Unlock, HomeView Tidbits, and More
Top Stories: iPhone Duo Face Unlock, HomeView Tidbits, and More
10 hours ago
Amazon Takes $120 Off 46mm GPS Apple Watch Series 12 With New Record Low Price [Update: Gone]
Amazon Takes $120 Off 46mm GPS Apple Watch Series 12 With New Record Low Price [Update: Gone]
10 hours ago
Siri Recap Hands-On: Private, But Not Very Useful
Siri Recap Hands-On: Private, But Not Very Useful
1 day ago
Save on Headphones This Black Friday With Major Deals on Beats, Sony, Soundcore, and More
Save on Headphones This Black Friday With Major Deals on Beats, Sony, Soundcore, and More
1 day ago
MacRumors Giveaway: Win a 512GB OLED iPad Mini and a Year of Astropad Workbench
MacRumors Giveaway: Win a 512GB OLED iPad Mini and a Year of Astropad Workbench
1 day ago
The MacRumors Show: What's Next for iPhone Duo?
The MacRumors Show: What's Next for iPhone Duo?
1 day ago
Anker's Black Friday Steals: The Lowest Prices Yet on MagSafe Favorites
Anker's Black Friday Steals: The Lowest Prices Yet on MagSafe Favorites
1 day ago
Microsoft to Retire 'To Do' Apps Next Year
Microsoft to Retire 'To Do' Apps Next Year
1 day ago
First Look at iPhone Air 2 and iPhone 18 Revealed By Dummy Models
First Look at iPhone Air 2 and iPhone 18 Revealed By Dummy Models
1 day ago
WhatsApp Raises Group Chat Limit to 1,500 Members
WhatsApp Raises Group Chat Limit to 1,500 Members
1 day ago
MacBook Pro Black Friday Deals Are Here: Get Up to $250 Off M6 and PROLED XDR
MacBook Pro Black Friday Deals Are Here: Get Up to $250 Off M6 and PROLED XDR
2 days ago
Apple is Building an AI Agent That Can Use Apps and Code
Apple is Building an AI Agent That Can Use Apps and Code
2 days ago
Black Friday Deal: Apple TV Streaming Service for $6.99/Month
Black Friday Deal: Apple TV Streaming Service for $6.99/Month
2 days ago
AirPods Black Friday Deals Hit Pro 3 at $179 and Max 2 at $429
AirPods Black Friday Deals Hit Pro 3 at $179 and Max 2 at $429
2 days ago
Second iOS 27.3 and macOS Golden Gate 27.3 Public Betas Now Available
Second iOS 27.3 and macOS Golden Gate 27.3 Public Betas Now Available
2 days ago
Google's Gemini Can Now Control Apps on Your Mac
Google's Gemini Can Now Control Apps on Your Mac
2 days ago
iPhone Duo vs. Samsung Galaxy Z Fold8: Which is Better?
iPhone Duo vs. Samsung Galaxy Z Fold8: Which is Better?
2 days ago
Apple Executive in Charge of iPhone's Camera App Reportedly Retires
Apple Executive in Charge of iPhone's Camera App Reportedly Retires
2 days ago
Apple Announces 2026 Black Friday Event, Here's What You Can Get
Apple Announces 2026 Black Friday Event, Here's What You Can Get
2 days ago
Sonos Black Friday Sale Takes Up to 25% Off Speakers, Soundbars, and More
Sonos Black Friday Sale Takes Up to 25% Off Speakers, Soundbars, and More
2 days ago
Apple TV to Stream Female 'F1 Academy' Races in U.S. Starting in 2027
Apple TV to Stream Female 'F1 Academy' Races in U.S. Starting in 2027
2 days ago
Tomorrow Marks the End of a 28-Year Era at Apple
Tomorrow Marks the End of a 28-Year Era at Apple
2 days ago
Amazon Takes $200 Off Every Apple Studio Display for Black Friday
Amazon Takes $200 Off Every Apple Studio Display for Black Friday
2 days ago
UK Loses Secrecy Fight Over Apple 'Backdoor' Order
UK Loses Secrecy Fight Over Apple 'Backdoor' Order
2 days ago
Beats 360 Black Friday Deal Arrives With Massive $100 Discount on Amazon
Beats 360 Black Friday Deal Arrives With Massive $100 Discount on Amazon
2 days ago
Apple Music Radio Now Reaches Over 50 Million Monthly Listeners
Apple Music Radio Now Reaches Over 50 Million Monthly Listeners
2 days ago