Deep Neural Networks for Face Detection Explained on Apple's Machine Learning Journal - MacRumors
Skip to Content

Deep Neural Networks for Face Detection Explained on Apple's Machine Learning Journal

by

Apple today published a new entry in its online Machine Learning Journal, this time covering an on-device deep neural network for face detection, aka the technology that's used to power the facial recognition feature used in Photos and other apps.

Facial detection features were first introduced as part of iOS 10 in the Core Image framework, and it was used on-device to detect faces in photos so people could view their images by person in the Photos app.

apple machine learning journal
Implementing this technology was no small feat, says Apple, as it required "orders of magnitude more memory, much more disk storage, and more computational resources."

Apple's iCloud Photo Library is a cloud-based solution for photo and video storage. However, due to Apple's strong commitment to user privacy, we couldn't use iCloud servers for computer vision computations. Every photo and video sent to iCloud Photo Library is encrypted on the device before it is sent to cloud storage, and can only be decrypted by devices that are registered with the iCloud account. Therefore, to bring deep learning based computer vision solutions to our customers, we had to address directly the challenges of getting deep learning algorithms running on iPhone.

Apple's Machine Learning Journal entry describes how Apple overcame these challenges by leveraging GPU and CPU in iOS devices, developing memory optimizations for network interference, image loading, and caching, and implementing the network in a way that did not interfere with other tasks expected on iPhone.

The new entry is well worth reading if you're interested in the specific details behind how Apple overcame these challenges to successfully implemented the feature. The technical details are dense, but understandable, and it provides some interesting insight into how facial recognition works.

With its Machine Learning Journal, Apple aims to share the complex concepts behind its technology so the users of its products can get a look behind the curtain. It also serves as a way for Apple's engineers to participate in the AI community.

Apple has previously shared several articles on Siri, including how "Hey Siri," works, and a piece on using machine learning and neural networks for refining synthetic images.

Top Rated Comments

69Mustang Avatar
117 months ago
But bahgawd, the technology Apple is pulling off really is falling squarely into the realm of magical.
The entire AI community is working on some voodoo. If you couple it with advances in robotics... we are about 2 hours and 23 minutes away from the uprising. This mofo is untethered.
Score: 1 Votes (Like | Disagree)
H3LL5P4WN Avatar
118 months ago
Do I enjoy paying over $1000 for a phone (as I have for what, 3 straight years now?)? No. Will I continue to do so? Until they make me a 512gb phone south of that mark, yes. Yes I will.

But bahgawd, the technology Apple is pulling off really is falling squarely into the realm of magical.
Score: 1 Votes (Like | Disagree)
spacemnspiff Avatar
118 months ago
Anyone else just wowed by the amount of technology embedded into this new iPhone? Our phones are learning more about us then we ever knew Before.
Yet people keep complaining about price, because all it has is the same hardware as the iPhone 8, make childish comments by attributing extra cost to the OLED screen and claiming that no innovation in the smartphone industry is to be had. These high school minded kids have got to grow up.
Score: 1 Votes (Like | Disagree)
118 months ago
Anyone else just wowed by the amount of technology embedded into this new iPhone? Our phones are learning more about us then we ever knew Before.
Score: 1 Votes (Like | Disagree)

Popular Stories

apple pro tell logo

Apple Launches Two Products Today

Friday November 13, 2026 2:37 am PST by
Apple is releasing two new products today, Friday, November 13: the all-new Apple HomeView and the fourth-generation Apple TV 4K, both of which have been available to pre-order since mid-October. Apple HomeView: Apple's new smart home display, powered by Apple Intelligence with Siri AI, for entertainment and managing the home. Available in tabletop and wall-mounted models, it can recognize up...
iPhone Duo Outer Display Hand

Apple Aiming to Upgrade the iPhone Duo in Four Ways

Sunday November 15, 2026 8:42 am PST by
Bloomberg's Mark Gurman today said Apple has four goals for future iPhone Duo models: Face ID, an Action button, a telephoto camera, and a thinner-and-lighter design. Gurman said Apple has already developed iPhone Duo 2 prototypes with Face ID on the outer display, but it is "running out of time" to finalize the feature for that model, so it might not arrive until the iPhone Duo...
Black Friday Deals 26 3

Apple Black Friday Starts Early: Save on Apple Watch, MacBook Air, and More

Saturday November 14, 2026 7:25 am PST by
Black Friday is now less than two weeks away, taking place on Friday, November 27 in 2026. As always, this will be the best time of the year to shop for great deals, including popular Apple products like AirPods, iPad, Apple Watch, and more. Note: MacRumors is an affiliate partner with some of these vendors. When you click a link and make a purchase, we may receive a small payment, which helps ...
Latest Stories
Apple TV App to Get Video Podcasts Section
Apple TV App to Get Video Podcasts Section
21 minutes ago
Early Apple Watch Black Friday Deals Arrive With Series 12 Hitting New Record Lows
Early Apple Watch Black Friday Deals Arrive With Series 12 Hitting New Record Lows
17 hours ago
Apple's Smart Glasses Strategy Hinges on Siri and iPhone Apps
Apple's Smart Glasses Strategy Hinges on Siri and iPhone Apps
17 hours ago
AirPods Pro 3 Discounted to $179.99 in Early Black Friday Sale
AirPods Pro 3 Discounted to $179.99 in Early Black Friday Sale
17 hours ago
Apple Aiming to Upgrade the iPhone Duo in Four Ways
Apple Aiming to Upgrade the iPhone Duo in Four Ways
18 hours ago
Apple Black Friday Starts Early: Save on Apple Watch, MacBook Air, and More
Apple Black Friday Starts Early: Save on Apple Watch, MacBook Air, and More
17 hours ago
Top Stories: Apple's New Software Approach, iPhone Duo-Optimized Apps, and More
Top Stories: Apple's New Software Approach, iPhone Duo-Optimized Apps, and More
2 days ago
HomeView Tidbits: Mirror, Sleep Timer, and Other Details
HomeView Tidbits: Mirror, Sleep Timer, and Other Details
3 days ago
Siri AI Still Not Enabled on HomePod Mini 2 With Latest Software Update
Siri AI Still Not Enabled on HomePod Mini 2 With Latest Software Update
3 days ago
Apple Releases tvOS 27.2.1 With Siri AI for Older Apple TVs
Apple Releases tvOS 27.2.1 With Siri AI for Older Apple TVs
3 days ago
Microsoft 365 Outage Resolving After Nearly 24 Hours
Microsoft 365 Outage Resolving After Nearly 24 Hours
3 days ago
iPhone Duo Survives 450,000 Folds, but Hinge is Weakening
iPhone Duo Survives 450,000 Folds, but Hinge is Weakening
3 days ago
Apple TV 4K Launch Day Deal Arrives at Amazon
Apple TV 4K Launch Day Deal Arrives at Amazon
3 days ago
The MacRumors Show: HomeView and Apple TV 4K First Impressions
The MacRumors Show: HomeView and Apple TV 4K First Impressions
3 days ago
YouTube App Not Working on Your New Apple TV? Here's the Fix
YouTube App Not Working on Your New Apple TV? Here's the Fix
3 days ago
Apple Meets Thai Officials Over iPhone Spyware Warnings
Apple Meets Thai Officials Over iPhone Spyware Warnings
3 days ago
Apple Shares HomeView 27.2 Release Notes With List of Features
Apple Shares HomeView 27.2 Release Notes With List of Features
3 days ago
HomeView in Québec: Apple Says Canadian French Support to Arrive in Software Update
HomeView in Québec: Apple Says Canadian French Support to Arrive in Software Update
3 days ago
Apple Watch Ultra 3 Gets Big $250 Discounts Ahead of Black Friday
Apple Watch Ultra 3 Gets Big $250 Discounts Ahead of Black Friday
3 days ago
Apple Says HomeView Sets New Record in Design-Focused Interview
Apple Says HomeView Sets New Record in Design-Focused Interview
3 days ago
Best Apple Deals of the Week: AirTag 2 Hits Record Low Price, Plus Early Black Friday Sales
Best Apple Deals of the Week: AirTag 2 Hits Record Low Price, Plus Early Black Friday Sales
3 days ago
iPhone 18 and 18e Coming in Spring 2027 With A20 Chip
iPhone 18 and 18e Coming in Spring 2027 With A20 Chip
3 days ago
King Charles to Join Elton John's Apple Music Radio Show
King Charles to Join Elton John's Apple Music Radio Show
3 days ago
Select 'Apple Home Collection' Accessories Now Available to Order
Select 'Apple Home Collection' Accessories Now Available to Order
3 days ago
Major Microsoft 365 Outage Continues
Major Microsoft 365 Outage Continues
3 days ago
Apple Launches Two Products Today
Apple Launches Two Products Today
3 days ago
Hands-On With the New Apple TV 4K and Siri AI
Hands-On With the New Apple TV 4K and Siri AI
3 days ago
Siri AI Coming to Older Apple TV 4K Models in tvOS 27.2.1
Siri AI Coming to Older Apple TV 4K Models in tvOS 27.2.1
3 days ago
HomeView Launch Kicks Off as First Orders Reach Customers
HomeView Launch Kicks Off as First Orders Reach Customers
4 days ago
Apple Continues to Move Up iPhone Duo Delivery Dates
Apple Continues to Move Up iPhone Duo Delivery Dates
4 days ago