Craig Federighi today announced ARKit 2 at WWDC 2018, which will give developers access to improved face tracking, realistic rendering, 3D object detection, persistent experiences, and shared experiences. The company gave a demo of two users sharing a virtual environment using ARKit 2, playing on a table with wooden toys and trying to knock down the other player's objects.

Apple says that ARKit 2 is a more powerful platform than the original ARKit, since it can allow multiple users to play a game or collaborate on projects together. There is also support for a "spectator mode" so that friends and family can see AR gameplay from another iOS device without participating.

arkit 2 lego
With "persistent AR," you'll be able to leave virtual objects in the real world and come back to them later. For example, you can start a puzzle on a table and come back to it another day and discover it in the same state that you left it.

ARKit 2 also extends support for image detection and tracking, making it possible to detect 3D objects like toys or sculptures, and adds the ability to automatically apply reflections of the real world onto AR objects. This makes the AR experience an even more realistic mix of the virtual and real world.

One of the notable demos at WWDC this year saw Apple bring Martin Sanders, Director of Innovation at LEGO, on stage to demonstrate a new LEGO AR iOS app that will integrate with ARKit 2 features and connect to physical LEGO sets. An entire LEGO city was shown off in the demo, allowing users to build objects, place characters, go on quests, open sets to see inside, and play with friends in the same world.

Up to four friends can play in the same set on four different iOS devices, and notably all of the virtual aspects of the LEGO AR app will be connected to physical LEGO sets. "We can save our entire world back into our physical set, and pick up where we left off later," Sanders said.

In other augmented reality news, Apple has created its own measuring app called "Measure," which can provide the dimensions of objects automatically. The company also collaborated with Pixar to create a new open file format called usdz, which enables AR experiences in many apps, like Messages and Mail.

All of these advanced ARKit 2 features will be available when iOS 12 launches this fall.

Top Rated Comments

DJTaurus Avatar
89 months ago
Is it just me or was the physical part of that Lego game completely useless?
Completely useless, gimicky and waste of time.
Score: 2 Votes (Like | Disagree)

Popular Stories

iCloud General Feature Redux

iPhone Users Who Pay for iCloud Storage Receive a New Perk

Thursday March 20, 2025 12:01 am PDT by
If you pay for iCloud storage on your iPhone, Apple has a new perk for you, at no additional cost. The new perk is the ability to create invitations in the Apple Invites app for the iPhone, which launched in the App Store last month. In the Apple Invites app, iCloud+ subscribers can create invitations for any occasion, such as birthday parties, graduations, baby showers, and more. Anyone ...
Generic iOS 19 Feature Mock

iOS 19 Coming in June With These New Features

Thursday March 20, 2025 2:04 pm PDT by
While the first iOS 19 beta is still more than two months away, there are already plenty of rumors about the upcoming software update. Below, we recap the key iOS 19 rumors so far. visionOS-Like Design In January, the YouTube channel Front Page Tech revealed a redesigned Camera app that is allegedly planned for iOS 19. According to Front Page Tech host Jon Prosser, the Camera app...
iPhone 17 Pro Render Front Page Tech

iPhone 17 Pro Launching Later This Year With These 10 New Features

Sunday March 23, 2025 10:00 am PDT by
While the iPhone 17 Pro and iPhone 17 Pro Max are not expected to launch until September, there are already plenty of rumors about the devices. iPhone 17 Pro's alleged design via Front Page Tech Below, we recap key changes rumored for the iPhone 17 Pro models as of March 2025: Aluminum frame: iPhone 17 Pro models are rumored to have an aluminum frame, whereas the iPhone 15 Pro and iPhone...
iOS 18

Top 5 New Features Coming in iOS 18.4

Friday March 21, 2025 3:26 pm PDT by
We're not getting new Siri Apple Intelligence features in iOS 18.4 as expected, but the upcoming update does have quite a few new additions that will be worth upgrading for. We've rounded up the five best features to look forward to, and if you're not running the beta, you can expect to get access to these in early April. Priority Notifications If you have an iPhone or iPad that supports...
Windows Vista

Apple Might Be Having Its Windows Vista Moment, Says Analyst

Thursday March 20, 2025 6:52 am PDT by
Is Apple experiencing a "Vista-like drift into systemically poor execution?" That was a question posed by well-known technology analyst Benedict Evans, in a recent blog post covering Apple's innovation and execution, or seemingly lack thereof as of late. He is referring to Microsoft's Windows Vista operating system, which was widely criticized when it launched in 2007 due to software bugs,...
apple wallet drivers license feature iPhone 15 pro teal 1

Apple Says iPhone Driver's Licenses Coming to These 8 U.S. States, But Rollout Remains Slow

Wednesday March 19, 2025 6:55 am PDT by
In select U.S. states, residents can add their driver's license or state ID to the Wallet app on the iPhone and Apple Watch, providing a convenient and contactless way to display proof of identity or age at select airports and businesses, and in select apps. Unfortunately, this feature continues to roll out very slowly. It has been three and a half years since Apple first announced the...
iPhone 17 Pro Render Front Page Tech

Latest iPhone 17 Pro Dummies Highlight Apple's New Part-Glass Design

Thursday March 20, 2025 5:27 am PDT by
Seasoned leaker Sonny Dickson has shared more dummy models of Apple's upcoming iPhone 17 series, with the latest lot revealing a noticeable shift in Apple's iPhone Pro model design that goes beyond the much-talked-about new rear camera bar. Dickson points out that the iPhone 17 Pro dummy models feature an outlined area on the back, beginning just below the camera module and extending to the...
airpods pro 2 gradient

AirPods Pro 3 Launch Now Just Months Away: Here's What We Know

Tuesday March 18, 2025 9:13 am PDT by
Despite being released over two years ago, Apple's AirPods Pro 2 continue to dominate the wireless earbud market. However, with the AirPods Pro 3 expected to launch in 2025, anyone thinking of buying Apple's premium earbuds may be wondering if the next generation is worth holding out for. Apart from their audio and noise-canceling performance, which are generally regarded as excellent for...
CarPlay GM EV

GM Reportedly Blocks Dealership From Installing CarPlay in Newer EVs

Friday March 21, 2025 8:22 am PDT by
A few years ago, the American automaker General Motors (GM) announced that it would be phasing out support for CarPlay and Android Auto in its new electric vehicles, in favor of its own software platform. It was a controversial decision, as many drivers who are in the market for a new vehicle consider CarPlay to be a must-have feature. Looking to capitalize on the situation, one GM...