Apple's Headset Will Reportedly Let Customers Create AR Apps via Siri

Apple is working on new software tools that will allow both developers and customers to create augmented reality apps for its widely-rumored AR/VR headset, according to a paywalled report today from The Information's Wayne Ma.

Apple AR Icon
Interestingly, the report claims that customers will be able to create and release AR apps for the headset via Siri, even if they do not have the ability to code:

With the software tools, Apple hopes that even people who don't know computer code could tell the headset, via the Siri voice assistant, to build an AR app that could then be made available via Apple's App Store for others to download. The tool, for example, could allow users to build an app with virtual animals moving around a room and over or around real-life objects without the need to design the animal from scratch, program its animations and calculate its movement in a 3D space with obstacles.

The report likens Apple's tool to Minecraft and Roblox, which allow anyone to easily create 3D tools and worlds. Apple is said to be utilizing technology that it acquired from Montreal-based startup Fabric Software in 2017, and customers would be able to distribute the AR apps they create on the App Store alongside developers.

Apple already offers some AR creation tools like Reality Composer on the iPhone and iPad that could be expanded to the headset.

It's worth noting that the report cites sources who last saw demonstrations of the tool in 2021, so the report is based on older information and it's possible that Apple's plans have changed at least slightly in the time that has passed since.

Apple is also working on AR content for the headset, according to the report:

People familiar with Apple's content strategy for the headset say Apple executives are emphasizing health and wellness including proposals for AR apps that assist with meditation and exercise. One early AR demo allowed users to sit inside a Zen garden, the four people said.

Apple's headset is expected to be released later this year and will reportedly have an iOS-like interface with a grid of apps, advanced eye and hand tracking, and the ability to function as an external display for a Mac. The software tools for the headset could be revealed at Apple's annual developers conference WWDC in June, giving developers time to create AR and VR apps for the headset before it launches to customers later in the year.

Related Roundup: Apple Vision Pro
Buyer's Guide: Vision Pro (Buy Now)
Related Forum: Apple Vision Pro

Popular Stories

Generic iOS 18

Apple Announces iOS 18.2 Launching Today With These New Features

Wednesday December 11, 2024 5:23 am PST by
Apple has announced that iOS 18.2, iPadOS 18.2, and macOS Sequoia 15.2 will be released today following more than six weeks of beta testing. For the iPhone 15 Pro and iPhone 16 models, the update introduces additional Apple Intelligence features, including Genmoji for creating custom emoji, Image Playground and Image Wand for generating images, and ChatGPT integration for Siri. There is also ...
Generic iOS 18

Apple Seeds Second Release Candidate Versions of iOS 18.2 and More With Genmoji, Image Playground and ChatGPT Integration

Monday December 9, 2024 10:06 am PST by
Apple today seeded the second release candidate versions of upcoming iOS 18.2, iPadOS 18.2, and macOS 15.2 updates to developers and public beta testers for testing purposes, a week after releasing the first RCs. The first iOS 18.2 RC had a build number of 22C150, while the second RC's build number is 22C151. Release candidates represent the final version of beta software that's expected to see a ...
iPhone SE 4 Single Camera Thumb 3

iPhone SE 4 Said to Feature 48MP Rear Lens, 12MP TrueDepth Camera

Monday December 9, 2024 4:48 am PST by
Apple's forthcoming iPhone SE 4 will feature a single 48-megapixel rear camera and a 12-megapixel TrueDepth camera on the front, according to details revealed in a new Korean supply chain report. ET News reports that Korea-based LG Innotek is the main supplier of the front and rear camera modules for the more budget-friendly ~$400 device, which is expected to launch in the first quarter of...
Apple MacBook Pro M4 hero

MacBook Pros With OLED Displays Won't Have a Notch, Roadmap Shows

Monday December 9, 2024 7:36 am PST by
Apple plans to remove the notch from the MacBook Pro in a few years from now, according to a roadmap shared by research firm Omdia. The roadmap shows that 14-inch and 16-inch MacBook Pro models released in 2026 will have a hole-punch camera at the top of the display, instead of a notch. It is unclear if there would simply be a pinhole in the display, or if Apple would expand the iPhone's...
vipps nfc tap to pay iphone

World's First Apple Pay Alternative for iPhone Launches in Norway

Monday December 9, 2024 1:28 am PST by
Norwegian payment service Vipps has become the world's first company to launch a competing tap-to-pay solution to Apple Pay on iPhone, following Apple's agreement with European regulators to open up its NFC technology to third parties. Starting December 9, Vipps users in Norway can make contactless payments in stores using their iPhones. The service initially supports customers of SpareBank...
New Things Your iPhone Can Do in iOS 18

20 New Things Your iPhone Can Do in iOS 18.2

Friday December 6, 2024 4:42 am PST by
Apple is set to release iOS 18.2 in the second week of December, bringing the second round of Apple Intelligence features to iPhone 15 Pro and iPhone 16 models. This update brings several major advancements to Apple's AI integration, including completely new image generation tools and a range of Visual Intelligence-based enhancements. There are a handful of new non-AI related feature controls...
Apple Watch Series 10 lineup 240909 feature

Apple Watch Could Get Blood Pressure Monitoring in 2025

Tuesday December 10, 2024 11:51 am PST by
Apple is ramping up work on a blood pressure monitoring feature for the Apple Watch and it could be ready as soon as 2025, reports Bloomberg's Mark Gurman. Blood pressure monitoring is a health addition that Apple has been working on for the last several years, and based on rumors, Apple wanted to debut it in 2024. The feature would not provide exact systolic and diastolic blood pressure...
macOS Sequoia Night Feature

Apple Releases macOS Sequoia 15.2 With New Apple Intelligence Features

Wednesday December 11, 2024 10:02 am PST by
Apple today released macOS Sequoia 15.2, the second update to the macOS Sequoia operating system that was released in September. macOS Sequoia 15.2 comes over a month after the release of macOS Sequoia 15.1. Mac users can download the ‌macOS Sequoia‌ update through the Software Update section of System Settings. macOS Sequoia 15.2 adds Image Playground, an app that lets you create...

Top Rated Comments

mgollaher92 Avatar
25 months ago
Yeah, lets have Siri develop apps when it can barely handle turning my lights on and off.
Score: 65 Votes (Like | Disagree)
HobeSoundDarryl Avatar
25 months ago

It's all fun and games until Siri runs into a compiler error.
"I don't know what you mean by compiler error. Here's what I found on the web for compiler error." ;)
Score: 19 Votes (Like | Disagree)
TheYayAreaLiving ?️ Avatar
25 months ago
The problem is Siri doesn't really like to listen to my commands. Apple really needs to work on fixing and improving Siri first. Will be seeing this error message alot.

Score: 15 Votes (Like | Disagree)
Akrapovic Avatar
25 months ago
This feels like someone heard a rumour and misunderstood it. Like when the iPhone 14 Pro camera cutout was said to have notification indicators in it, and it turned out it was the dynamic island. Or when the Watch S7 was meant to have a flat screen, and it turned out it was an early rumour for the AW Ultra.

This feels more like it'd be a mini sandbox style enviroment where can be like "Hey Siri, add a chair" and it'll drop in objects. Creating entire apps through voice is fantasy. We still can't even do that well with codeless drop n drag systems, never mind trying to explain an app to a voice assistant that struggles with timers.
Score: 14 Votes (Like | Disagree)
nwcs Avatar
25 months ago
That sounds fun for like 5 minutes. Like watching an old 1990s After Dark screen saver.
Score: 11 Votes (Like | Disagree)
4nNtt Avatar
25 months ago
I hope it doesn't go this way, but with how Siri has been acting lately...

Hey Siri, Create a reality scene
Siri - I'm having trouble connecting, try again in a few minutes
Hey Siri, Create a reality scene
Siri - I'm having trouble connecting, try again in a few minutes
Hey Siri, Create a reality scene
Siri - Here is your AR scene, would you like to add content?
Hey Siri, Add a cat to the scene
Siri - I'm having trouble connecting, try again in a few minutes
Hey Siri, Add a cat to the scene
Siri - I'm having trouble connecting, try again in a few minutes
Hey Siri, Add a cat to the scene
Siri - Here is a cat
Score: 9 Votes (Like | Disagree)