Developers Share First Augmented Reality Creations Using Apple's ARKit

Apple only announced its augmented reality developer platform ARKit last week at the Worldwide Developers Conference, but some video clips have already been posted online by developers eager to showcase the impressive potential of the software.

ARKit enables iPhones and iPads running iOS 11 to superimpose computer-generated graphics over the real world, allowing developers to take their apps beyond the screen and into the user's environment.

Apple ARKit running Unity and Overwatch Widowmaker, by Cody Brown

By using the built-in camera, processors, and motion sensors found in iOS devices, virtual content appears on top of real-world scenes, and users don't need any special equipment to enjoy them because ARKit does the heavy lifting.

One developer who spoke to Motherboard said Apple had improved upon existing AR solutions like Hololens and Google Tango by making the ARKit framework elegant and simple to use.

"The most impressive aspect of ARKit is that it tends to just work," said Cody Brown, founder of virtual reality production studio IRL, in an online interview with Motherboard. "Other AR software often requires some sort of physical tracking mechanism (like a QR code), which inevitably becomes a major piece of friction if you are trying to get anyone to use this stuff.

"Another incredible aspect of ARKit is how it handles lighting adjustments in real time, continued Brown. "I can only imagine the math and magic underneath this tech to make it work."

During its keynote at WWDC, Apple demoed a range of effects that ARKit is capable of. One demo by Wingnut Studios wowed the audience with a tabletop sci-fi raider assault. Another showed a user placing a steaming digital coffee mug and a lamp on a table and moving the objects around to show off the tracking and shadow effects.

Several other ARKit developer demos have since appeared online, including a virtual "iPhone 8", roving StarWars character BB-8, dog-stalking zombies, office floor naval battles, dancing Candy rock stars, and more.

Rainforest garage by 8ninths

Apple has invested heavily in augmented reality in recent years, making several VR/AR company acquisitions including PrimeSense, FaceShift, and Metaio. Apple's much-anticipated "iPhone 8", which is expected to be announced in September, is rumored to have 3D sensing capabilities, with augmented reality being one possible use for the technology.

ARKit will come to compatible devices as part of iOS 11, which Apple is set to release in the fall.

Related Roundup: Apple Vision Pro
Tag: ARKit
Buyer's Guide: Vision Pro (Buy Now)
Related Forums: Apple Vision Pro, iOS 11

Popular Stories

iPhone 17 Slim Feature Single Camera 1 Redux

'iPhone 17 Air' Launching Later This Year With These 10 New Features

Wednesday January 15, 2025 7:16 am PST by
While the so-called "iPhone 17 Air" is not expected to launch until September, there are already plenty of rumors about the "ultra-thin" device. Overall, the "iPhone 17 Air" is shaping up to be a mixed bag. Due to its thinness, the device is expected to have some limited specifications compared to the iPhone 17 Pro models, including only a single rear camera, only a single speaker, no SIM...
2024 iPhone Boxes Feature

Apple Changes Trade-In Values for iPhones, iPads, Macs, and More

Thursday January 16, 2025 6:45 am PST by
Apple today adjusted estimated trade-in values for select iPhone, iPad, Mac, and Apple Watch models in the U.S., according to its website. Some values increased, while others decreased. The changes were not too significant, with most values rising or dropping by $5 to $50. We have outlined some examples below: Device New Value Old Value iPhone 15 Pro Max Up to $630 U ...
Generic iOS 18

Everything New in iOS 18.3 Beta 3

Thursday January 16, 2025 12:39 pm PST by
Apple provided the third beta of iOS 18.3 to developers today, and while the betas have so far been light on new features, the third beta makes some major changes to Notification Summaries and also tweaks a few other features. Notification Summary Changes Apple made multiple changes to Notification Summaries in response to complaints about inaccurate summaries of news headlines. For...
new magsafe charger

Apple Releases Updated MagSafe Charger Firmware

Tuesday January 14, 2025 11:30 am PST by
Apple today released new firmware designed for the 25W MagSafe Charger that is compatible with the iPhone 12 and later and the latest AirPods and Apple Watch models. The updated firmware is version 2A143, up from the 2A138 firmware that the accessory shipped with. In the Settings app, you'll see a different version number than the internal firmware number. The 2024 MagSafe charger was...
iPhone 17 Pro Dual Tone Feature 1

iPhone 17 Pro Launching Later This Year With These 8 New Features

Thursday January 9, 2025 5:45 am PST by
While the iPhone 17 Pro and iPhone 17 Pro Max are not expected to launch until September, there are already plenty of rumors about the devices. iPhone 17 Pro concept based on rumors Below, we recap key changes rumored for the iPhone 17 Pro models as of January 2025: More aluminum: iPhone 17 Pro models are rumored to have an aluminum frame, whereas the iPhone 15 Pro and iPhone 16 Pro models ...
MacBook Air 15 Inch Feature Blue

MacBook Air Likely Apple's First Product Update of 2025: What to Expect

Wednesday January 15, 2025 8:49 am PST by
There is a good chance that Apple's first product announcement of 2025 will be updated 13-inch and 15-inch MacBook Air models with the M4 chip. Last month, Apple released macOS Sequoia 15.2, and in doing so it accidentally confirmed new MacBook Air models are coming this year (unsurprisingly). Bloomberg's Mark Gurman said the new MacBook Air models will be announced "earlier" than some...
Apple Card iPhone 16 Pro Feature

Three Companies Are Now in the Running to Take Over the Apple Card

Thursday January 16, 2025 8:18 am PST by
Apple is in talks with Barclays and Synchrony about becoming its new financial partner for the Apple Card, according to Reuters sources. The report today added that Apple has also been holding discussions with Chase Bank owner JPMorgan since last year, so there are at least three potential companies in the running to take over the Apple Card from current partner Goldman Sachs. Goldman...
Generic iOS 18

iOS 18.3 Coming Soon: Here's What's New

Monday January 13, 2025 5:33 am PST by
iOS 18.3 is currently in beta for developers and public beta testers. So far, the upcoming iPhone software update is very minor in scope. Below, we outline what is new in iOS 18.3 so far. The only potential new feature coming to iPhones with iOS 18.3 so far is robot vacuum support in the Home app, but this functionality is not yet live. Apple is laying the groundwork for the feature,...
apple power beats pro 2

Powerbeats Pro 2 Filed in Regulatory Databases Ahead of 2025 Launch

Wednesday January 15, 2025 6:02 am PST by
In September, Apple said that it would be launching Powerbeats Pro 2 in 2025, and now further evidence of the wireless earbuds has surfaced. Powerbeats Pro 2 images found in iOS 18 code Apple submitted Powerbeats Pro 2 regulatory documents to the U.S. Federal Communications Commission (FCC) in mid-December. The documents were made available to the public this week, and they were spotted by 91M...

Top Rated Comments

Telos101 Avatar
99 months ago
Ummm,..this video looks no different to every other AR app I own, am i missing something? This is what Apple has been working on,..a technology that has been used by IKEA for years...unimpressed.

I would have thought a pair of AR/ VR glasses would have been a priority for 2017.
I'm not sure you realize how difficult it was to build AR into iOS apps before ARKit entered the scene. The framework has only been out for a week and already indie devs are creating stuff that previously would have taken entire teams weeks or even months to produce. This is a game changer for sure, not only for games but for education apps too (anatomy, history, geography etc). The possibilities are endless.

Apple just shifted the goalposts.
Score: 35 Votes (Like | Disagree)
djcerla Avatar
99 months ago
After just a few days, and a developers-only release, iOS is already the dominant platform for AR. This is a market Apple will pioneer and dominate.

Who can miniaturize an AR device to the point it's actually desirable to wear? Only Apple. It's like all their work in chips and sensors of these last years is converging to make that single device possible.
Score: 15 Votes (Like | Disagree)
shly0718 Avatar
99 months ago
Im not super into these AR VR stuffs, but this is impressive, especially its on mobile hardware with minimum weight and no cords
Score: 13 Votes (Like | Disagree)
adnbek Avatar
99 months ago
Feels like 2013 again. Better late than never.

Fast forward to 6:54
I don't think you get it. AR has existed on iOS for years too, since 2010 at least. There are quite a few AR apps on the App Store already as well. What ARKit does is give developers access to new frameworks making developing these apps a lot easier and more powerful than the ones are currently possible.

But of course you knew that already and you're just trolling, so carry on.
Score: 12 Votes (Like | Disagree)
Kaibelf Avatar
99 months ago
Okay THAT is cool, and has a lot of potential.
Score: 12 Votes (Like | Disagree)
TallManNY Avatar
99 months ago
After just a few days, and a developers-only release, iOS is already the dominant platform for AR. This is a market Apple will pioneer and dominate.

Who can miniaturize an AR device to the point it's actually desirable to wear? Only Apple. It's like all their work in chips and sensors of these last years is converging to make that single device possible.
That is exactly what I've been thinking. The problem with the AR/VR glasses is that they are heavy and uncomfortable to wear. But Apple has the most powerful and most energy efficient chips. It also has great cameras. So they can make the best set of goggles. For now it will just be your phone (an $750 device, so pricey) sitting in a container similar to Samsung VR gear. But Apple can make something better and more powerful and still have it run on a battery that won't be that heavy. And all of Apple phones will have two cameras. Having two cameras will be key to AR. That is another happy coincidence.

Side note. Once again, Apple publicly announces dominance in a new field and the stock market doesn't get it.
Score: 11 Votes (Like | Disagree)