Apple was awarded a patent today that details a method of detecting faces in a digital video feed through the use of depth information.

Published by the U.S. Patent and Trademark Office, the document describes how face detection algorithms could identify the presence of faces in a live video when people in the scene are located at different distances from the camera.

Screen Shot 4 e1488886008905
To reduce processing overhead and minimize error rates, the system applies depth information to existing face detection algorithms used in photography and intelligently scales the face window sizes according to their depth coordinates – i.e., the further away a face is from the lens, the smaller the capture frame around it.

The method utilizes a special infrared light to project an optical radiation pattern onto the scene, which is then converted into a depth map. As noted by AppleInsider, the depth mapping system referenced in the patent is based on motion tracking technology developed by Israeli motion capture firm PrimeSense, which Apple acquired in 2013.

Screen Shot 3 1
While the system is able to recognize faces in general, it lacks the ability to identify individual differences between faces, so this isn't a bio-recognition solution in itself, but it could become a crucial enabling step in a wider authentication system.

Apple is said to be developing a "revolutionary" front-facing camera system for the upcoming "iPhone 8". The technology is rumored to consist of three modules to enable fully-featured 3D sensing capabilities. While there's no way to know for sure if this particular patent describes one of those modules, the upgraded camera system is said to be fueled by PrimeSense algorithms.

Tag: Patent
Related Forum: iPhone

Top Rated Comments

newyorksole Avatar
102 months ago
Selling my stock just befor iPhone 8, not because it will be poor, in fact I expect it to be excellent... still, it won't have the usb-c, full glass, oled with intergrated fingerprint scanner, with revolutionary front camera, full wireless charging, multi day battamerylife, quick charge, liquid metal and touch bar. These high expectations are going to make a great phone seem ordinary and people need to understand that.
I think you may be underestimating how big of a release this will be.

iPhone is Apple's cash cow. This is the 10 year anniversary and also will probably be the first event at Steve Jobs Theater.

It may not have all of THOSE features you listed, but whatever they release is going to be damn good. They wouldn't waste this release with mediocre features.
Score: 4 Votes (Like | Disagree)
69Mustang Avatar
102 months ago
As @djcerla stipulated in one thread, unlocking with face recognition would likely be a backup/secondary solution for Touch ID. So you can use either or. :)
Every phone that's offering facial/retina/iris unlock is offering it as an option. There's no reason for anyone to think Apple would offer it as the only solution. People work themselves into a lather over nothing.
Score: 4 Votes (Like | Disagree)
keysofanxiety Avatar
102 months ago
So I can't unlock the phone down low if I need to be discreet about messaging someone or checking something?
As @djcerla stipulated in one thread, unlocking with face recognition would likely be a backup/secondary solution for Touch ID. So you can use either or. :)
Score: 3 Votes (Like | Disagree)
benadd Avatar
102 months ago
PrimeSense was an Israeli company, not Italian.

('https://www.macrumors.com/2017/03/07/apple-face-detection-patent-iphone-8/')


Apple was awarded a patent today that details a method of detecting faces in a digital video feed through the use of depth information.

Published by the U.S. Patent and Trademark Office, the document ('http://patft.uspto.gov/netacgi/nph-Parser?Sect1=PTO2&Sect2=HITOFF&u=%2Fnetahtml%2FPTO%2Fsearch-adv.htm&r=2593&f=G&l=50&d=PTXT&s1=(1%2F1.CCLS.+AND+20170307.PD.)&p=52&OS=ccl/1/1+and+isd/3/7/2017&RS=(CCL/1/1+AND+ISD/20170307)') describes how face detection algorithms could identify the presence of faces in a live video when people in the scene are located at different distances from the camera.



To reduce processing overhead and minimize error rates, the system applies depth information to existing face detection algorithms used in photography and intelligently scales the face window sizes according to their depth coordinates - i.e., the further away a face is from the lens, the smaller the capture frame around it.

The method utilizes a special infrared light to project an optical radiation pattern onto the scene, which is then converted into a depth map. As noted by AppleInsider ('http://appleinsider.com/articles/17/03/07/apple-patents-method-of-detecting-faces-using-depth-information-bolsters-iphone-8-rumors'), the depth mapping system referenced in the patent is based on motion tracking technology developed by Italian motion capture firm PrimeSense, which Apple acquired in 2013 ('https://www.macrumors.com/2013/11/24/apple-confirms-acquisition-of-israeli-3d-body-sensing-firm-primesense/').



While the system is able to recognize faces in general, it lacks the ability to identify differences between individual faces, so this isn't a bio-recognition solution in itself, but it could become a crucial enabling step in a wider authentication system.

Apple is said to be developing a "revolutionary" front-facing camera system ('https://www.macrumors.com/2017/02/21/upcoming-oled-iphone-camera/') for the upcoming "iPhone 8". The technology is rumored to consist of three modules to enable fully-featured 3D sensing capabilities. While there's no way to know for sure if this particular patent describes one of those modules, the upgraded camera system is said to be fueled by PrimeSense algorithms.

Article Link: Apple Face Detection Patent Hints at Possible PrimeSense Tech Headed For 'iPhone 8' ('https://www.macrumors.com/2017/03/07/apple-face-detection-patent-iphone-8/')
Score: 2 Votes (Like | Disagree)
thisisnotmyname Avatar
102 months ago
As @djcerla stipulated in one thread, unlocking with face recognition would likely be a backup/secondary solution for Touch ID. So you can use either or. :)
I really do hope they make facial recognition as an authentication mechanism optional via configuration. I don't want someone being able to unlock my phone by forcing it in front of my face.
Score: 1 Votes (Like | Disagree)
69Mustang Avatar
102 months ago
That picture just looks (descriptively sounds) like the version 1 of the Kinect.
Score: 1 Votes (Like | Disagree)

Popular Stories

New Things Your iPhone Can Do in iOS 18

20 New Things Your iPhone Can Do in iOS 18.2

Monday December 16, 2024 8:55 am PST by
Apple released iOS 18.2 in the second week of December, bringing the second round of Apple Intelligence features to iPhone 15 Pro and iPhone 16 models. This update brings several major advancements to Apple's AI integration, including completely new image generation tools and a range of Visual Intelligence-based enhancements. Apple has added a handful of new non-AI related feature controls as...
iphone 16 apple intelligence

Apple Drops Plans for iPhone Hardware Subscription Service

Wednesday December 18, 2024 11:39 am PST by
Apple is no longer planning to launch a hardware subscription service that would let customers "subscribe" to get a new iPhone each year, reports Bloomberg's Mark Gurman. Gurman first shared rumors about Apple's work on a hardware subscription service back in 2022, and at the time, he said that Apple wanted to develop a simple system that would allow customers to pay a monthly fee to gain...
iPhone 17 Pro Dual Tone Feature 1

iPhone 17 Pro Rumored to Stick With 'Triangular' Camera Design

Wednesday December 18, 2024 2:36 am PST by
Contrary to recent reports, the iPhone 17 Pro will not feature a horizontal camera layout, according to the leaker known as "Instant Digital." In a new post on Weibo, the leaker said that a source has confirmed that while the appearance of the back of the iPhone 17 Pro has indeed changed, the layout of the three cameras is "still triangular," rather than the "horizontal bar spread on the...
elevation lab airtag battery

Your AirTag's Battery Will Last for Up to 10 Years With Elevation Lab's New TimeCapsule Enclosure

Wednesday December 18, 2024 10:05 am PST by
Elevation Lab today announced the launch of TimeCapsule, an innovative and simple solution for increasing the battery life of Apple's AirTag. Priced at $20, TimeCapsule is an AirTag enclosure that houses two AA batteries that offer 14x more battery capacity than the CR2032 battery that the AirTag runs on. It works by attaching the AirTag's upper housing to the built-in custom contact in the...
apple tv 4k yellow bg feature

New Apple TV Rumored to Launch Next Year With These Features

Tuesday December 17, 2024 9:02 am PST by
The current Apple TV 4K was released more than two years ago, so the streaming device is becoming due for a hardware upgrade soon. Fortunately, it was recently rumored that a new Apple TV will launch at some point next year. Below, we recap rumors about the next-generation Apple TV. Bloomberg's Mark Gurman last week reported that Apple has been working on its own combined Wi-Fi and...
blackmagic vision pro

Blackmagic Debuts $30K 3D Camera for Capturing Video for Vision Pro

Monday December 16, 2024 4:17 pm PST by
Blackmagic today announced that its URSA Cine Immersive camera is now available for pre-order, with deliveries set to start late in the first quarter of 2025. Blackmagic says that this is the world's first commercial camera system designed to capture 3D content for the Vision Pro. The URSA Cine Immersive camera was first introduced in June, but it has not been available for purchase until...
mac pro creativity

Apple Launched the Controversial 'Trashcan' Mac Pro 11 Years Ago Today

Thursday December 19, 2024 7:00 pm PST by
Apple launched the controversial "trashcan" Mac Pro eleven years ago today, introducing one of its most criticized designs that persisted through a period of widespread discontentment with the Mac lineup. The redesign took the Mac Pro in an entirely new direction, spearheaded by a polished aluminum cylindrical design that became unofficially dubbed the "trashcan" in the Mac community. All of ...
iPhone 17 Slim Feature

'iPhone 17 Air' With 'Major' Design Changes and 19-Inch MacBook Detailed in New Report

Sunday December 15, 2024 9:47 am PST by
Apple is planning a series of "major design" and "format changes" for iPhones over the next few years, according to The Wall Street Journal's Aaron Tilley and Yang Jie. The paywalled report published today corroborated the widely-rumored "iPhone 17 Air" with an "ultrathin" design that is thinner than current iPhone models. The report did not mention a specific measurement, but previous...