Apple's Mixed Reality Headset to Feature iOS-Like Interface, Advanced Hand Tracking, and Will Work as Second Display for Mac

The AR/VR headset that Apple has been working on for years now is set to launch in 2023, which means rumors about the device are picking up. Bloomberg today shared some information on the headset's interface, the apps it will feature, and how it will work.

apple ar headset concept 1Concept render based on purported leaked information by Ian Zelbo

Apple's mixed reality headset will have an "iOS-like" interface that will include "many functions" available on the iPhone and iPad, with the headset also able to serve as an external display for a connected Mac. Users will be able to see their Mac's display in VR, controlling the Mac with a physical keyboard and trackpad/mouse.

Using the headset will "feel familiar to Apple users," with an interface that is close to identical to the look of an ‌iPhone‌ or an ‌iPad‌. There will be a Home screen with app icons that can be rearranged, as well as customizable widgets.

Eye and hand-tracking will be a "major selling point" for the headset, with Apple using external cameras that can analyze a user's hands and eyes. According to Bloomberg, the wearer will be able to control the headset by looking at an on-screen item to select it, then using gestures to activate the on-screen item. Unlike other headset options, Apple will not rely on a physical controller.

Likely to be named "Reality Pro," the headset will be able to switch between augmented reality and virtual reality. Augmented reality will overlay virtual objects on the real world, while virtual reality is an entirely virtual environment that shuts out the wearer's surroundings. Augmented reality functions will work through a pass-through mode that will use the exterior cameras on the headset, and swapping between AR and VR will be done with a Digital Crown-like control knob.

Video conferencing will be a focus, with Apple adding FaceTime-based video chatting capabilities and meeting rooms. A user's actual face and full body will be rendered in virtual reality for interactive meetings, with the realistic avatars available for one-to-one chats. FaceTime with multiple participants will use less detailed icons like Memoji.

Apple is working on VR content with media partners like Disney and Dolby, as well as updating Apple TV+ shows and movies to work with the headset. Apple's aim is to provide viewers with the experience of looking at a giant screen in an environment like a desert or outer space.

Apps will include Safari, Photos, Mail, Messages, ‌Apple TV‌+, Apple Music, Podcasts, and Calendar, and the headset will have a dedicated App Store for third-party content. Siri will be able to be used for text input, as will an ‌iPhone‌, ‌iPad‌, or Mac keyboard. Apple is working on an air typing feature, but it is not expected to be ready for launch.

For those who wear glasses, Apple will provide custom lenses that are able to sit within the enclosure, and Apple is expecting users to wear AirPods to get an audio experience on par with the visual experience that the headset provides, though it will have built-in speakers.

As previously rumored, the headset will have an external battery pack to prevent it from overheating on a user's face due to the high-end Mac chips used for the device. The battery is approximately the size of two iPhone 14 Pro Max models stacked on top of one another, and it will power the headset for around two hours. An external battery will allow users to swap one battery and charge another to use the device for a longer period of time.

Other AR/VR rumored headset features include 4K microOLED displays, more than a dozen cameras, iris tracking, facial expression detection, and more, with details available in our roundup. The headset is expected later in 2023, perhaps as soon as the spring, and it will sell for somewhere around $3,000.

To get people interested in the headset, Apple Store locations will have a dedicated area where it can be demonstrated and tested after launch.

Popular Stories

iPhone 17 Slim Feature

'iPhone 17 Air' With 'Major' Design Changes and 19-Inch MacBook Detailed in New Report

Sunday December 15, 2024 9:47 am PST by
Apple is planning a series of "major design" and "format changes" for iPhones over the next few years, according to The Wall Street Journal's Aaron Tilley and Yang Jie. The paywalled report published today corroborated the widely-rumored "iPhone 17 Air" with an "ultrathin" design that is thinner than current iPhone models. The report did not mention a specific measurement, but previous...
Generic iOS 18

Apple Releases First Betas of iOS 18.3 and iPadOS 18.3

Monday December 16, 2024 10:06 am PST by
Apple today seeded the first betas of upcoming iOS 18.3 and iPadOS 18.3 updates to developers for testing purposes, with the software coming a week after Apple released iOS 18.2 and iPadOS 18.2. iOS 18.3 and iPadOS 18.3 can be downloaded from the Settings app on a compatible device by going to General > Software update. There's no word yet on what's included in iOS 18.3 and iPadOS 18.3, ...
Magic Mouse Next to Keyboard

Apple 'Working' on Redesigned Magic Mouse With a Long-Awaited 'Fix'

Sunday December 15, 2024 8:43 am PST by
Apple is working on a redesigned Magic Mouse that will address some "longstanding complaints," according to Bloomberg's Mark Gurman. In his Power On newsletter today, Gurman said Apple in recent months has been working on a "full overhaul" of the Magic Mouse with a design that "better fits the modern era." However, he does not expect the new Magic Mouse to be released in the "next 12 to 18...
AirTag 2 Mock Feature

AirTag 2 Expected to Launch Next Year With 'Considerable' Upgrade to Item Tracking

Sunday December 15, 2024 2:57 pm PST by
Apple plans to release a second-generation AirTag next year with "considerably" longer range for item tracking, according to Bloomberg's Mark Gurman. In his Power On newsletter today, Gurman said the new AirTag will use Apple's second-generation Ultra Wideband chip, or equivalent technology. The chip debuted last year in the iPhone 15 and the Apple Watch Ultra 2, and Apple said it offers up...
apple tv 4k yellow bg feature

New Apple TV Rumored to Launch Next Year With These Features

Tuesday December 17, 2024 9:02 am PST by
The current Apple TV 4K was released more than two years ago, so the streaming device is becoming due for a hardware upgrade soon. Fortunately, it was recently rumored that a new Apple TV will launch at some point next year. Below, we recap rumors about the next-generation Apple TV. Bloomberg's Mark Gurman last week reported that Apple has been working on its own combined Wi-Fi and...
Apple TV 4K hero 221018 feature

Here is Everything New for the Apple TV in the tvOS 18.3 Update So Far

Tuesday December 17, 2024 6:25 am PST by
Apple on Monday seeded the first tvOS 18.3 beta to developers for testing. The update will likely be released in January. So far, there are only minor changes for the Apple TV, with one new feature and a few code changes discovered. Below, we outline what is new in tvOS 18.3 so far. Robot Vacuum Support in Home App First, tvOS 18.3 will add robot vacuum support to the Home app on the...
iphone 17 pro concept render cameras

Major iPhone 17 Pro Redesign Backed by Supply Chain Info, Claims Leaker

Thursday December 12, 2024 4:36 am PST by
Next year's iPhone 17 Pro models will reportedly feature a major redesign, specifically centering around changes to the rear camera module, and now new supply chain information appears to confirm the striking change, according to a Chinese leaker. iPhone 17 Pro concept render Late last month, The Information's Wayne Ma claimed that the rear of the ‌iPhone 17‌ Pro and ‌iPhone 17‌ Pro...

Top Rated Comments

dypeterc Avatar
25 months ago
What if Apple were to be leaking AR/VR goggle rumors just to keep Meta in the AR/VR game wasting money and resources?
Score: 50 Votes (Like | Disagree)
randolorian Avatar
25 months ago
I look forward to the day that we don’t have to look at this same mock-up with every Apple VR post.
Score: 23 Votes (Like | Disagree)
TheYayAreaLiving ?️ Avatar
25 months ago
For $3000.00 including tax, It's overly expensive.

I'm not sure if this world is even ready for this Apple AR/VR headset. Siri connecting with Apple AR/VR headset??? Yeah... I don't know about this one.
Score: 21 Votes (Like | Disagree)
KaliYoni Avatar
25 months ago

the headset will be able to switch between augmented reality and virtual reality.
And we thought sidewalk iPhone users made it hard to walk around without bumping into distracted, oblivious people...
Score: 15 Votes (Like | Disagree)
DelayedGratificationGene Avatar
25 months ago
These comments are almost as funny as the ones ridiculing the iPhone rumors. Almost as funny.
Score: 12 Votes (Like | Disagree)
trvs Avatar
25 months ago
What (who) is this product for? I just don’t get it.
Score: 11 Votes (Like | Disagree)