Developers Share First Augmented Reality Creations Using Apple's ARKit

Apple only announced its augmented reality developer platform ARKit last week at the Worldwide Developers Conference, but some video clips have already been posted online by developers eager to showcase the impressive potential of the software.

ARKit enables iPhones and iPads running iOS 11 to superimpose computer-generated graphics over the real world, allowing developers to take their apps beyond the screen and into the user's environment.

Apple ARKit running Unity and Overwatch Widowmaker, by Cody Brown

By using the built-in camera, processors, and motion sensors found in iOS devices, virtual content appears on top of real-world scenes, and users don't need any special equipment to enjoy them because ARKit does the heavy lifting.

One developer who spoke to Motherboard said Apple had improved upon existing AR solutions like Hololens and Google Tango by making the ARKit framework elegant and simple to use.

"The most impressive aspect of ARKit is that it tends to just work," said Cody Brown, founder of virtual reality production studio IRL, in an online interview with Motherboard. "Other AR software often requires some sort of physical tracking mechanism (like a QR code), which inevitably becomes a major piece of friction if you are trying to get anyone to use this stuff.

"Another incredible aspect of ARKit is how it handles lighting adjustments in real time, continued Brown. "I can only imagine the math and magic underneath this tech to make it work."

During its keynote at WWDC, Apple demoed a range of effects that ARKit is capable of. One demo by Wingnut Studios wowed the audience with a tabletop sci-fi raider assault. Another showed a user placing a steaming digital coffee mug and a lamp on a table and moving the objects around to show off the tracking and shadow effects.

Several other ARKit developer demos have since appeared online, including a virtual "iPhone 8", roving StarWars character BB-8, dog-stalking zombies, office floor naval battles, dancing Candy rock stars, and more.

Rainforest garage by 8ninths

Apple has invested heavily in augmented reality in recent years, making several VR/AR company acquisitions including PrimeSense, FaceShift, and Metaio. Apple's much-anticipated "iPhone 8", which is expected to be announced in September, is rumored to have 3D sensing capabilities, with augmented reality being one possible use for the technology.

ARKit will come to compatible devices as part of iOS 11, which Apple is set to release in the fall.

Related Roundup: Apple Vision Pro
Tag: ARKit
Buyer's Guide: Vision Pro (Neutral)
Related Forums: Apple Vision Pro, iOS 11

Popular Stories

iOS 18 Siri Personal Context

Report Reveals Internal Chaos Behind Apple's Siri Failure

Thursday April 10, 2025 7:15 am PDT by
A new report from The Information today reveals much of the internal turmoil behind Apple Intelligence's revamped version of Siri. Apple apparently weighed up multiple options for the backend of Apple Intelligence. One initial idea was to build both small and large language models, dubbed "Mini Mouse" and "Mighty Mouse," to run locally on iPhones and in the cloud, respectively. Siri's...
Apple 2025 Thumb 1

10 Products Still Coming From Apple in 2025

Friday April 11, 2025 4:14 pm PDT by
Apple may have updated several iPads and Macs late last year and early this year, but there are still multiple new devices that we're looking forward to seeing in 2025. Most will come in September or October, but there could be a few surprises before then. We've rounded up a list of everything that we're still waiting to see from Apple in 2025. iPhone 17, 17 Air, and 17 Pro - We get...
M6 MacBook Pro Feature 1

Waiting for the Perfect MacBook Pro? 2026 Might Be the Year

Thursday April 10, 2025 4:19 am PDT by
Apple in October 2024 overhauled its 14-inch and 16-inch MacBook Pro models, adding M4, M4 Pro, and M4 Max chips, Thunderbolt 5 ports on higher-end models, display changes, and more. That's quite a lot of updates in one go, but if you think this means a further major refresh for the MacBook Pro is now several years away, think again. Bloomberg's Mark Gurman has said he expects only a small...
maxresdefault

The MacRumors Show: New iOS 19, iPhone 17, and Apple Watch Ultra 3 Leaks

Friday April 11, 2025 7:13 am PDT by
On this week's episode of The MacRumors Show, we catch up on the latest iOS 19 and watchOS 12 rumors, upcoming devices, and more. Subscribe to The MacRumors Show YouTube channel for more videos Detailed new renders from leaker Jon Prosser claim to provide the best look yet at the complete redesign rumored to arrive in iOS 19, showing more rounded elements, lighting effects, translucency, and...
Alleged iOS 19 Icons Front Page Tech

iOS 19 Leak Reveals Alleged New Design With Rounder App Icons, Floating Tab Bar, and More

Monday April 7, 2025 3:13 pm PDT by
YouTube channel Front Page Tech is back today with another video that provides a closer look at iOS 19's alleged design changes. The video contains re-created renders of iOS 19, which are allegedly based on real footage of the software update, provided by sources within Apple. Overall, iOS 19 is expected to have a more glass-like, visionOS-inspired design, with added translucency for user...
iPhone 17 Pro 3 4ths Perspective Aluminum Camera Module 1

iPhone 17 Pro Launching Later This Year With These 12 New Features

Sunday April 13, 2025 7:52 am PDT by
While the iPhone 17 Pro and iPhone 17 Pro Max are not expected to launch until September, there are already plenty of rumors about the devices. Below, we recap key changes rumored for the iPhone 17 Pro models as of April 2025: Aluminum frame: iPhone 17 Pro models are rumored to have an aluminum frame, whereas the iPhone 15 Pro and iPhone 16 Pro models have a titanium frame, and the iPhone ...
Apple Northbrook

Apple Store in Chicago Area Permanently Closing Later This Month

Wednesday April 9, 2025 9:56 am PDT by
Apple will be permanently closing its store at the Northbrook Court shopping mall in the Chicago suburb of Northbrook on April 26, the company has announced. Apple has added the following notice to the store's web page:Thank you Northbook. Apple Northbrook is closing on April 26 at 7pm. We're still here for you. Please visit apple.com/retail to find your nearest store.Apple Northbrook opened ...
iOS 18

iOS 18.5 Includes Two Changes So Far

Wednesday April 9, 2025 9:09 am PDT by
Apple released the first beta of iOS 18.5 last week, and so far the software update includes only two minor changes. The changes are in the Mail and Settings apps. In the Mail app, you can now easily turn off contact photos directly within the app, by tapping on the circle with three dots in the top-right corner. In the Settings app, there is some new AppleCare+ information. For ...
apple intelligence black

NYT: Apple's AI Struggles Began with 2023 Chip Budget Dispute

Friday April 11, 2025 4:33 am PDT by
Apple's current struggles with Apple Intelligence and Siri began in early 2023 when AI head John Giannandrea sought approval from CEO Tim Cook to purchase more AI chips for development, according to a new report from The New York Times. Cook initially approved doubling the team's chip budget, but CFO Luca Maestri reportedly reduced the increase to less than half that amount, and instead...

Top Rated Comments

Telos101 Avatar
102 months ago
Ummm,..this video looks no different to every other AR app I own, am i missing something? This is what Apple has been working on,..a technology that has been used by IKEA for years...unimpressed.

I would have thought a pair of AR/ VR glasses would have been a priority for 2017.
I'm not sure you realize how difficult it was to build AR into iOS apps before ARKit entered the scene. The framework has only been out for a week and already indie devs are creating stuff that previously would have taken entire teams weeks or even months to produce. This is a game changer for sure, not only for games but for education apps too (anatomy, history, geography etc). The possibilities are endless.

Apple just shifted the goalposts.
Score: 35 Votes (Like | Disagree)
djcerla Avatar
102 months ago
After just a few days, and a developers-only release, iOS is already the dominant platform for AR. This is a market Apple will pioneer and dominate.

Who can miniaturize an AR device to the point it's actually desirable to wear? Only Apple. It's like all their work in chips and sensors of these last years is converging to make that single device possible.
Score: 15 Votes (Like | Disagree)
shly0718 Avatar
102 months ago
Im not super into these AR VR stuffs, but this is impressive, especially its on mobile hardware with minimum weight and no cords
Score: 13 Votes (Like | Disagree)
adnbek Avatar
102 months ago
Feels like 2013 again. Better late than never.

Fast forward to 6:54
I don't think you get it. AR has existed on iOS for years too, since 2010 at least. There are quite a few AR apps on the App Store already as well. What ARKit does is give developers access to new frameworks making developing these apps a lot easier and more powerful than the ones are currently possible.

But of course you knew that already and you're just trolling, so carry on.
Score: 12 Votes (Like | Disagree)
Kaibelf Avatar
102 months ago
Okay THAT is cool, and has a lot of potential.
Score: 12 Votes (Like | Disagree)
TallManNY Avatar
102 months ago
After just a few days, and a developers-only release, iOS is already the dominant platform for AR. This is a market Apple will pioneer and dominate.

Who can miniaturize an AR device to the point it's actually desirable to wear? Only Apple. It's like all their work in chips and sensors of these last years is converging to make that single device possible.
That is exactly what I've been thinking. The problem with the AR/VR glasses is that they are heavy and uncomfortable to wear. But Apple has the most powerful and most energy efficient chips. It also has great cameras. So they can make the best set of goggles. For now it will just be your phone (an $750 device, so pricey) sitting in a container similar to Samsung VR gear. But Apple can make something better and more powerful and still have it run on a battery that won't be that heavy. And all of Apple phones will have two cameras. Having two cameras will be key to AR. That is another happy coincidence.

Side note. Once again, Apple publicly announces dominance in a new field and the stock market doesn't get it.
Score: 11 Votes (Like | Disagree)