Kuo: Apple AR Headset to Feature Advanced Hand Gesture Controls and Object Detection

Apple's long rumored AR headset is predicted to include multiple highly sensitive 3D sensing modules in order to offer an innovative hand gesture and object detecting user interface, according to Apple analyst Ming-Chi Kuo in a new research note obtained by MacRumors.

apple view concept right corner

Antonio De Rosa concept render

We predict that the structured light of the AR/MR headset can detect not only the position change of the user or other people’s hand and object in front of the user's eyes but also the dynamic detail change of the hand (just like the iPhone's Face ID/structured light/Animoji can detect user's dynamic expression change). Capturing the details of hand movement can provide a more intuitive and vivid human-machine UI (for example, detecting the user's hand from a clenched fist to open and the balloon [image] in hand flying away).

Kuo describes the ability for the headset to detect both hand gestures and movements to provide the user with an immersive experience where the user could open their hand to let go of a virtual balloon.

In order to accomplish this impressive feat, Apple is expected to incorporate four sets of 3D sensors which are of higher quality and specifications than the current iPhones. Kuo sees the quality of this human-machine user interface as the key to the success of Apple's upcoming AR headset. According to Kuo, these interface abilities include gesture control, object detection, as well as eye tracking, iris recognition, voice control, skin detection, expression detection, and spatial detection.

Earlier this year, Patently Apple pointed out a patent application from Apple titled "Devices, Methods, and Graphical User Interfaces for Interacting with Three-Dimensional Environments," which details this same concept.

Different movements and locations of the micro-gestures and various movement parameters are used to determine the operations that are performed in the three-dimensional environment. Using the cameras to capture the micro-gestures to interact with the three-dimensional environment allow the user to freely move about the physical environment without be encumbered by physical input equipment, which allows the user to explore the three-dimensional environment more naturally and efficiently.

Apple is widely expected to launch its first-generation AR-focused device in 2022.

Related Roundup: Apple Vision Pro
Buyer's Guide: Vision Pro (Buy Now)
Related Forum: Apple Vision Pro

Popular Stories

General Black Friday Deals 24 Green Tinsel

Apple Black Friday Deals Available Now: AirPods, iPads, and More

Friday November 22, 2024 5:28 am PST by
Black Friday 2024 is less than one week away, and as always the next few days will be the best time of the year to shop for great deals. Right now, this includes big savings on popular Apple products like AirPods, Apple Watch, MacBook Air, iPad, and more. Note: MacRumors is an affiliate partner with some of these vendors. When you click a link and make a purchase, we may receive a small...
anker new xmas 1

Anker Kicks Off Massive Black Friday Sale With Up to 50% Off Sitewide, Free Gifts With Purchase, Mystery Boxes, and More

Thursday November 21, 2024 7:53 am PST by
Anker today kicked off its big Black Friday sale, which is set to run through December 9. This sale includes notable discounts on portable chargers, USB-C hubs, cables, and more. Note: MacRumors is an affiliate partner with Anker. When you click a link and make a purchase, we may receive a small payment, which helps us keep the site running. There are a few bonus offers during this event as ...
iPhone SE 4 Thumb 1

iPhone SE 4 With Apple's Own 5G Modem 'Confirmed' to Launch in March

Tuesday November 19, 2024 12:12 pm PST by
Barclays analyst Tom O'Malley and his colleagues recently traveled to Asia to meet with various electronics manufacturers and suppliers. In a research note this week, outlining key takeaways from the trip, the analysts said they have "confirmed" that a fourth-generation iPhone SE with an Apple-designed 5G modem is slated to launch towards the end of the first quarter next year. In line with previo...
Apple 2024 Black Friday Shopping Event feature

Apple Announces 2024 Black Friday Event, Offering Up to $200 Gift Card

Thursday November 21, 2024 5:10 am PST by
Apple's annual four-day Black Friday through Cyber Monday shopping event is returning on Friday, November 29 through Monday, December 2 in many countries, including the U.S., Canada, Australia, France, Germany, Italy, Spain, the U.K., and others. During the event, customers can get an Apple gift card with the purchase of an eligible product. In the U.S., for instance, Apple is including gift ...
silo tv show apple tv plus

Apple TV+ Releasing Next Week's 'Silo' Episode Early

Friday November 22, 2024 7:25 am PST by
The next episode of Apple TV+'s award-winning sci-fi series "Silo" will be released early. Apple previously announced that new "Silo" episodes would be released on Fridays, but the third episode of the second season will instead be released on Wednesday, November 27. Apple has likely bumped up the date so that people can watch the episode during the U.S. Thanksgiving holiday on Thursday,...
ipads early bf deals

7 Best Black Friday iPad Deals for 2024

Saturday November 23, 2024 1:44 pm PST by
We're less than one week away from Black Friday on November 29, and Best Buy and Amazon currently have all-time low prices across Apple's entire iPad lineup. This includes Apple's 9th and 10th generation iPad, iPad mini 7, iPad Air, and iPad Pro. Note: MacRumors is an affiliate partner with some of these vendors. When you click a link and make a purchase, we may receive a small payment, which...
at t turbo indicator iphone 16 pro max v0 8hrh7w5f3w1e1

AT&T Turbo Indicator Showing Up in iPhone Status Bar for Subscribers

Wednesday November 20, 2024 3:42 am PST by
AT&T has begun displaying "Turbo" in the iPhone carrier label for customers subscribed to its premium network prioritization service, according to reports on Reddit. The new indicator seems to have started appearing after users updated to iOS 18.1.1, but that could be just coincidence. Image credit: Reddit user No_Highlight7476 The Turbo feature provides enhanced network performance through ...
Generic iOS 19 Feature Mock

iOS 19's First New Feature Has Leaked

Friday November 22, 2024 6:22 am PST by
iOS 19 is not expected to be announced until June 2025, but the software update's first major new feature has already leaked. Bloomberg's Mark Gurman this week reported that iOS 19 will introduce a "more conversational Siri" powered by "more advanced large language models." He said this upgrade will make Siri more like OpenAI's ChatGPT, allowing the assistant to "handle more sophisticated...
beats snow

Black Friday Deals Hit Beats Headphones With Up to 52% Off

Thursday November 21, 2024 12:05 pm PST by
Beats is joining in on the Black Friday discount frenzy, with up to 52 percent off select headphones, earbuds, and speakers on Amazon. You'll find many of the same prices at other retailers like Best Buy as well. Note: MacRumors is an affiliate partner with Amazon. When you click a link and make a purchase, we may receive a small payment, which helps us keep the site running. This sale...

Top Rated Comments

arn Avatar
39 months ago

Sounds like iron man stuff.
I was thinking Minority Report, but maybe that just shows my age. :)

Score: 16 Votes (Like | Disagree)
TheYayAreaLiving ?️ Avatar
39 months ago

I was thinking Minority Report, but maybe that just shows my age. :)


Pretty much sums it up. At least the concept is the same.

[MEDIA=giphy]SLBr5yLzocSYw[/MEDIA]

[MEDIA=giphy]hHxTQkcjmHUTC[/MEDIA]
Score: 10 Votes (Like | Disagree)
boss.king Avatar
39 months ago
Did someone say advanced object recognition?



Attachment Image
Score: 8 Votes (Like | Disagree)
TheYayAreaLiving ?️ Avatar
39 months ago
Sounds like iron man stuff. True inspiration comes from this.



After having Apple AR glasses on...



Attachment Image

Attachment Image
Score: 7 Votes (Like | Disagree)
topdrawer Avatar
39 months ago
omg, i love making hand gestures.
Score: 5 Votes (Like | Disagree)
MayaUser Avatar
39 months ago

omg, i love making hand gestures.
making hand gestures in your car or on the street...the other people will love this
Score: 3 Votes (Like | Disagree)