Apple Glasses Patent Suggests Any Surface Could Become a Virtual Touch Interface - MacRumors
Skip to Content

Apple Glasses Patent Suggests Any Surface Could Become a Virtual Touch Interface

It's been increasingly clear that Apple has been working on an AR/VR Headset for the consumer market. Originally expected as early as 2020, the most recent rumors place its release in 2021 or 2022.

apple touch patent maps
But what's been less clear is the exact feature set a pair of AR/VR Apple Glasses will provide. Rumors have been scattered over the functionality with some internal debate about the direction of the unreleased headset -- ranging from an ultra-powerful wearable product to a more limited accessory for the iPhone.

A newly revealed patent application from Apple uncovered by AppleInsider shows some intriguing research that Apple has been doing into the field as far back as 2016.

In the patent, Apple addresses the question of how someone wearing a pair of Apple Glasses would be able to interact with the mixed virtual/real environment they are looking at. When using an iPhone or iPad as an AR viewfinder, the user would typically tap on the screen to interact with objects shown on the screen. But when wearing an AR headset, the same task would be cumbersome. Previous attempts at directly interacting with an AR environment required additional hardware such as a glove or finger sensors. Meanwhile, trying to visually detect finger-to-surface contact is not accurate enough to be useful.

Apple describes how it can more elegantly accomplish this task by using infrared heat sensing to detect when a user touches a real-world object.

The present disclosure is related to a method and device for detecting a touch between at least part of a first object and at least part of a second object, wherein the at least part of the first object has a different temperature than the at least part of the second object. The method includes providing at least one thermal image of a portion of the second object, determining in at least part of the at least one thermal image a pattern which is indicative of a particular value or range of temperature or a particular value or range of temperature change, and using the determined pattern for detecting a touch between the at least part of the first object and the at least part of the second object.

The method could then allow Apple Glasses to visually project controls onto real-world objects and react when they are touched by the user by sensing the heat transfer when touching the object.

As with all patent applications, we can't be certain Apple will incorporate this technology into its future products. But we do believe Apple is planning on releasing an Apple AR/VR headset. Full details can be found in our Apple Glasses roundup.

Related Roundup: Apple Vision Pro
Tag: Patent
Buyer's Guide: Vision Pro (Buy Now)
Related Forum: Apple Vision Pro

Popular Stories

General visionOS watchOS and tvOS Betas Feature Redux

Apple Releases First watchOS 26.5, tvOS 26.5 and visionOS 26.5 Betas

Monday March 30, 2026 10:38 am PDT by
Apple today provided developers with the first betas of upcoming watchOS 26.5, tvOS 26.5, and visionOS 26.5 betas for testing purposes. The software comes a week after Apple launched the 26.4 versions of each platform. The software updates are available through the Settings app on each device, and because these are developer betas, a free developer account is required. There's no word on...
General visionOS watchOS and tvOS Betas Feature Redux

Apple Releases Second watchOS 26.5, tvOS 26.5 and visionOS 26.5 Betas

Monday April 13, 2026 10:06 am PDT by
Apple today provided developers with the second betas of upcoming watchOS 26.5, tvOS 26.5, and visionOS 26.5 betas for testing purposes. The software comes two weeks after Apple released the first betas for each platform. The software updates are available through the Settings app on each device, and because these are developer betas, a free developer account is required. There's no word ...
Apple Vision Pro with battery Feature Blue Magenta

New Book Details Vision Pro's Troubled Launch in Apple Stores

Tuesday April 7, 2026 5:57 am PDT by
A new book by New York Times labor reporter Noam Scheiber argues that Apple's decade-long erosion of its retail workforce directly contributed to the disappointing launch of the Apple Vision Pro in early 2024 (via WIRED). The book, Mutiny: The Rise and Revolt of the College-Educated Working Class, draws on interviews with Apple Store employees to document how staffing cuts, reduced training, ...

Top Rated Comments

AngerDanger Avatar
75 months ago
Apple's explanation is a little verbose, so to simplify, it seems they could use IR to detect hotpots left by finger taps, and use that as touch input.



If it works out, this is AWESOME!

Attachment Image
Score: 22 Votes (Like | Disagree)
75 months ago
These will go nowhere until they can shoot lasers whenever I give someone a withering stare.
Score: 11 Votes (Like | Disagree)
velocityg4 Avatar
75 months ago
This reminds me of this Dilbert comic from 1994.
('https://dilbert.com/strip/1994-10-12')
Score: 7 Votes (Like | Disagree)
Sharewaredemon Avatar
75 months ago

Apple's explanation is a little verbose, so to simplify, it seems that Apple could use IR to detect hotpots left by finger taps, and use that as touch input.
Bless you for taking the time to sum up for us all.

Attachment Image
Score: 7 Votes (Like | Disagree)
Gorms Avatar
75 months ago

Apple's explanation is a little verbose, so to simplify, it seems they could use IR to detect hotpots left by finger taps, and use that as touch input.

If it works out, this is AWESOME!
The patent is old. It’ll use LIDAR. This is why LIDAR is on iPad Pro
Score: 5 Votes (Like | Disagree)
alexandr Avatar
75 months ago

These will go nowhere until they can shoot lasers whenever I give someone a withering stare.
and they will need to come with a little vacuum cleaner to pick up the ashes.
Score: 5 Votes (Like | Disagree)