Apple's Mixed Reality Headset to Feature iOS-Like Interface, Advanced Hand Tracking, and Will Work as Second Display for Mac

The AR/VR headset that Apple has been working on for years now is set to launch in 2023, which means rumors about the device are picking up. Bloomberg today shared some information on the headset's interface, the apps it will feature, and how it will work.

apple ar headset concept 1Concept render based on purported leaked information by Ian Zelbo

Apple's mixed reality headset will have an "iOS-like" interface that will include "many functions" available on the iPhone and iPad, with the headset also able to serve as an external display for a connected Mac. Users will be able to see their Mac's display in VR, controlling the Mac with a physical keyboard and trackpad/mouse.

Using the headset will "feel familiar to Apple users," with an interface that is close to identical to the look of an ‌iPhone‌ or an ‌iPad‌. There will be a Home screen with app icons that can be rearranged, as well as customizable widgets.

Eye and hand-tracking will be a "major selling point" for the headset, with Apple using external cameras that can analyze a user's hands and eyes. According to Bloomberg, the wearer will be able to control the headset by looking at an on-screen item to select it, then using gestures to activate the on-screen item. Unlike other headset options, Apple will not rely on a physical controller.

Likely to be named "Reality Pro," the headset will be able to switch between augmented reality and virtual reality. Augmented reality will overlay virtual objects on the real world, while virtual reality is an entirely virtual environment that shuts out the wearer's surroundings. Augmented reality functions will work through a pass-through mode that will use the exterior cameras on the headset, and swapping between AR and VR will be done with a Digital Crown-like control knob.

Video conferencing will be a focus, with Apple adding FaceTime-based video chatting capabilities and meeting rooms. A user's actual face and full body will be rendered in virtual reality for interactive meetings, with the realistic avatars available for one-to-one chats. FaceTime with multiple participants will use less detailed icons like Memoji.

Apple is working on VR content with media partners like Disney and Dolby, as well as updating Apple TV+ shows and movies to work with the headset. Apple's aim is to provide viewers with the experience of looking at a giant screen in an environment like a desert or outer space.

Apps will include Safari, Photos, Mail, Messages, ‌Apple TV‌+, Apple Music, Podcasts, and Calendar, and the headset will have a dedicated App Store for third-party content. Siri will be able to be used for text input, as will an ‌iPhone‌, ‌iPad‌, or Mac keyboard. Apple is working on an air typing feature, but it is not expected to be ready for launch.

For those who wear glasses, Apple will provide custom lenses that are able to sit within the enclosure, and Apple is expecting users to wear AirPods to get an audio experience on par with the visual experience that the headset provides, though it will have built-in speakers.

As previously rumored, the headset will have an external battery pack to prevent it from overheating on a user's face due to the high-end Mac chips used for the device. The battery is approximately the size of two iPhone 14 Pro Max models stacked on top of one another, and it will power the headset for around two hours. An external battery will allow users to swap one battery and charge another to use the device for a longer period of time.

Other AR/VR rumored headset features include 4K microOLED displays, more than a dozen cameras, iris tracking, facial expression detection, and more, with details available in our roundup. The headset is expected later in 2023, perhaps as soon as the spring, and it will sell for somewhere around $3,000.

To get people interested in the headset, Apple Store locations will have a dedicated area where it can be demonstrated and tested after launch.

Popular Stories

iPhone 17 Slim Feature Single Camera 1 Redux

'iPhone 17 Air' Launching Later This Year With These 10 New Features

Wednesday January 15, 2025 7:16 am PST by
While the so-called "iPhone 17 Air" is not expected to launch until September, there are already plenty of rumors about the "ultra-thin" device. Overall, the "iPhone 17 Air" is shaping up to be a mixed bag. Due to its thinness, the device is expected to have some limited specifications compared to the iPhone 17 Pro models, including only a single rear camera, only a single speaker, no SIM...
2024 iPhone Boxes Feature

Apple Changes Trade-In Values for iPhones, iPads, Macs, and More

Thursday January 16, 2025 6:45 am PST by
Apple today adjusted estimated trade-in values for select iPhone, iPad, Mac, and Apple Watch models in the U.S., according to its website. Some values increased, while others decreased. The changes were not too significant, with most values rising or dropping by $5 to $50. We have outlined some examples below: Device New Value Old Value iPhone 15 Pro Max Up to $630 U ...
Generic iOS 18

Everything New in iOS 18.3 Beta 3

Thursday January 16, 2025 12:39 pm PST by
Apple provided the third beta of iOS 18.3 to developers today, and while the betas have so far been light on new features, the third beta makes some major changes to Notification Summaries and also tweaks a few other features. Notification Summary Changes Apple made multiple changes to Notification Summaries in response to complaints about inaccurate summaries of news headlines. For...
new magsafe charger

Apple Releases Updated MagSafe Charger Firmware

Tuesday January 14, 2025 11:30 am PST by
Apple today released new firmware designed for the 25W MagSafe Charger that is compatible with the iPhone 12 and later and the latest AirPods and Apple Watch models. The updated firmware is version 2A143, up from the 2A138 firmware that the accessory shipped with. In the Settings app, you'll see a different version number than the internal firmware number. The 2024 MagSafe charger was...
iPhone 17 Pro Dual Tone Feature 1

iPhone 17 Pro Launching Later This Year With These 8 New Features

Thursday January 9, 2025 5:45 am PST by
While the iPhone 17 Pro and iPhone 17 Pro Max are not expected to launch until September, there are already plenty of rumors about the devices. iPhone 17 Pro concept based on rumors Below, we recap key changes rumored for the iPhone 17 Pro models as of January 2025: More aluminum: iPhone 17 Pro models are rumored to have an aluminum frame, whereas the iPhone 15 Pro and iPhone 16 Pro models ...
MacBook Air 15 Inch Feature Blue

MacBook Air Likely Apple's First Product Update of 2025: What to Expect

Wednesday January 15, 2025 8:49 am PST by
There is a good chance that Apple's first product announcement of 2025 will be updated 13-inch and 15-inch MacBook Air models with the M4 chip. Last month, Apple released macOS Sequoia 15.2, and in doing so it accidentally confirmed new MacBook Air models are coming this year (unsurprisingly). Bloomberg's Mark Gurman said the new MacBook Air models will be announced "earlier" than some...
Apple Card iPhone 16 Pro Feature

Three Companies Are Now in the Running to Take Over the Apple Card

Thursday January 16, 2025 8:18 am PST by
Apple is in talks with Barclays and Synchrony about becoming its new financial partner for the Apple Card, according to Reuters sources. The report today added that Apple has also been holding discussions with Chase Bank owner JPMorgan since last year, so there are at least three potential companies in the running to take over the Apple Card from current partner Goldman Sachs. Goldman...
Generic iOS 18

iOS 18.3 Coming Soon: Here's What's New

Monday January 13, 2025 5:33 am PST by
iOS 18.3 is currently in beta for developers and public beta testers. So far, the upcoming iPhone software update is very minor in scope. Below, we outline what is new in iOS 18.3 so far. The only potential new feature coming to iPhones with iOS 18.3 so far is robot vacuum support in the Home app, but this functionality is not yet live. Apple is laying the groundwork for the feature,...
apple power beats pro 2

Powerbeats Pro 2 Filed in Regulatory Databases Ahead of 2025 Launch

Wednesday January 15, 2025 6:02 am PST by
In September, Apple said that it would be launching Powerbeats Pro 2 in 2025, and now further evidence of the wireless earbuds has surfaced. Powerbeats Pro 2 images found in iOS 18 code Apple submitted Powerbeats Pro 2 regulatory documents to the U.S. Federal Communications Commission (FCC) in mid-December. The documents were made available to the public this week, and they were spotted by 91M...

Top Rated Comments

dypeterc Avatar
26 months ago
What if Apple were to be leaking AR/VR goggle rumors just to keep Meta in the AR/VR game wasting money and resources?
Score: 50 Votes (Like | Disagree)
randolorian Avatar
26 months ago
I look forward to the day that we don’t have to look at this same mock-up with every Apple VR post.
Score: 23 Votes (Like | Disagree)
TheYayAreaLiving ?️ Avatar
26 months ago
For $3000.00 including tax, It's overly expensive.

I'm not sure if this world is even ready for this Apple AR/VR headset. Siri connecting with Apple AR/VR headset??? Yeah... I don't know about this one.
Score: 21 Votes (Like | Disagree)
KaliYoni Avatar
26 months ago

the headset will be able to switch between augmented reality and virtual reality.
And we thought sidewalk iPhone users made it hard to walk around without bumping into distracted, oblivious people...
Score: 15 Votes (Like | Disagree)
DelayedGratificationGene Avatar
26 months ago
These comments are almost as funny as the ones ridiculing the iPhone rumors. Almost as funny.
Score: 12 Votes (Like | Disagree)
trvs Avatar
26 months ago
What (who) is this product for? I just don’t get it.
Score: 11 Votes (Like | Disagree)