Apple Explains How the Photos People Recognition Feature Has Improved in iOS 15

Apple's iOS 15 website lists "improved recognition for individuals" as one of the new Photos features, and in a machine learning blog post shared this week, Apple gave more information on what exactly that means.

ios 15 improved people recognition
Apple says that on-device machine learning improvements have led to significantly better person recognition. The iOS 15 ‌Photos‌ app is able to detect people in extreme poses, people wearing accessories, and people with occluded faces.

To do this, Apple uses a combination of face and upper body to match people whose faces are not visible. Apple's machine learning blog says that the new functionality improves the ‌Photos‌ experience by identifying people in situations where it was previously impossible.

Apple's blog post on recognizing people in photos through on-device machine learning goes into much greater detail on how Apple uses machine learning to identify people while still protecting user privacy, and it's well worth a read for those who are interested in the inner workings of ML features.

Related Forum: iOS 15

Popular Stories

iPhone 17 Slim Feature

'iPhone 17 Air' With 'Major' Design Changes and 19-Inch MacBook Detailed in New Report

Sunday December 15, 2024 9:47 am PST by
Apple is planning a series of "major design" and "format changes" for iPhones over the next few years, according to The Wall Street Journal's Aaron Tilley and Yang Jie. The paywalled report published today corroborated the widely-rumored "iPhone 17 Air" with an "ultrathin" design that is thinner than current iPhone models. The report did not mention a specific measurement, but previous...
iphone 17 pro concept render cameras

Major iPhone 17 Pro Redesign Backed by Supply Chain Info, Claims Leaker

Thursday December 12, 2024 4:36 am PST by
Next year's iPhone 17 Pro models will reportedly feature a major redesign, specifically centering around changes to the rear camera module, and now new supply chain information appears to confirm the striking change, according to a Chinese leaker. iPhone 17 Pro concept render Late last month, The Information's Wayne Ma claimed that the rear of the ‌iPhone 17‌ Pro and ‌iPhone 17‌ Pro...
Generic iOS 18

Apple Releases First Betas of iOS 18.3 and iPadOS 18.3

Monday December 16, 2024 10:06 am PST by
Apple today seeded the first betas of upcoming iOS 18.3 and iPadOS 18.3 updates to developers for testing purposes, with the software coming a week after Apple released iOS 18.2 and iPadOS 18.2. iOS 18.3 and iPadOS 18.3 can be downloaded from the Settings app on a compatible device by going to General > Software update. There's no word yet on what's included in iOS 18.3 and iPadOS 18.3, ...
Magic Mouse Next to Keyboard

Apple 'Working' on Redesigned Magic Mouse With a Long-Awaited 'Fix'

Sunday December 15, 2024 8:43 am PST by
Apple is working on a redesigned Magic Mouse that will address some "longstanding complaints," according to Bloomberg's Mark Gurman. In his Power On newsletter today, Gurman said Apple in recent months has been working on a "full overhaul" of the Magic Mouse with a design that "better fits the modern era." However, he does not expect the new Magic Mouse to be released in the "next 12 to 18...
AirTag 2 Mock Feature

AirTag 2 Expected to Launch Next Year With 'Considerable' Upgrade to Item Tracking

Sunday December 15, 2024 2:57 pm PST by
Apple plans to release a second-generation AirTag next year with "considerably" longer range for item tracking, according to Bloomberg's Mark Gurman. In his Power On newsletter today, Gurman said the new AirTag will use Apple's second-generation Ultra Wideband chip, or equivalent technology. The chip debuted last year in the iPhone 15 and the Apple Watch Ultra 2, and Apple said it offers up...

Top Rated Comments

Kkspire Avatar
45 months ago
Y’all giving your photos to google. Good luck with that. iPhone is using incredible tech on device. Google is going to data centers for processing. No thanks.
Score: 19 Votes (Like | Disagree)
jmh600cbr Avatar
45 months ago
can confirm, it works insanely well compared to prior versions. even knows what i looked like as a baby.
Score: 10 Votes (Like | Disagree)
Think|Different Avatar
45 months ago
This feature has impressed me, time and time again! You just train it a bit by confirming a face or two and it does the rest. I've been shocked at how it has accurately matched my baby niece as she and her face has changed month to month, year after year, and now she's 3! The little movies with music iOS 15 makes are actually impressive, always dismissed those before.
Score: 9 Votes (Like | Disagree)
_Spinn_ Avatar
45 months ago
I love that they do all this locally on device.
Score: 9 Votes (Like | Disagree)
wigby Avatar
45 months ago

On device processing is meaningless to me. Google's offerings are server-side therefore doesn't need custom hardware, which is great for equity of access. There are billions of people around the world who can't afford the latest and greatest, at least someone is giving them new features.
You might speak for billions of users shopping for price but you don't speak for their need for privacy and security. Some things are more important than retail price, even to those that cannot afford it.
Score: 8 Votes (Like | Disagree)
gaximus Avatar
45 months ago

Still farrrr behind Google
Does Google's Face recognition work on device? or does it get send to a server for processing?
Score: 8 Votes (Like | Disagree)