Apple Makes New On-Screen Game Controller Available to Developers on iOS 15 and iPadOS 15

During the Platforms State of the Union at WWDC this week, Apple unveiled a new API for iOS 15 and iPadOS 15 that enables developers to implement an on-screen virtual game controller in their iPhone and iPad games with just a few lines of code.

apple virtual game controller ios 15
While many iPhone and iPad games already offer on-screen controls, Apple's new virtual game controller is available to all developers, easy to add, and can be customized on a per-game basis. Apple said the on-screen controller can be adjusted to a variety of layouts, with up to four buttons and a thumbstick, d-pad, or touchpad available per left and right side.

"These new on-screen controls for iPhone and iPad look amazing, and they're carefully tuned for grip locations across hand sizes and for a great responsiveness and feel," said Nat Brown, an Apple engineer working on Game Technologies.

Apple offers a WWDC session and developer documentation with more details.

Related Forum: iOS 15

Popular Stories

New Things Your iPhone Can Do in iOS 18

20 New Things Your iPhone Can Do in iOS 18.2

Monday December 16, 2024 8:55 am PST by
Apple released iOS 18.2 in the second week of December, bringing the second round of Apple Intelligence features to iPhone 15 Pro and iPhone 16 models. This update brings several major advancements to Apple's AI integration, including completely new image generation tools and a range of Visual Intelligence-based enhancements. Apple has added a handful of new non-AI related feature controls as...
iphone 16 apple intelligence

Apple Drops Plans for iPhone Hardware Subscription Service

Wednesday December 18, 2024 11:39 am PST by
Apple is no longer planning to launch a hardware subscription service that would let customers "subscribe" to get a new iPhone each year, reports Bloomberg's Mark Gurman. Gurman first shared rumors about Apple's work on a hardware subscription service back in 2022, and at the time, he said that Apple wanted to develop a simple system that would allow customers to pay a monthly fee to gain...
iPhone 17 Pro Dual Tone Feature 1

iPhone 17 Pro Rumored to Stick With 'Triangular' Camera Design

Wednesday December 18, 2024 2:36 am PST by
Contrary to recent reports, the iPhone 17 Pro will not feature a horizontal camera layout, according to the leaker known as "Instant Digital." In a new post on Weibo, the leaker said that a source has confirmed that while the appearance of the back of the iPhone 17 Pro has indeed changed, the layout of the three cameras is "still triangular," rather than the "horizontal bar spread on the...
elevation lab airtag battery

Your AirTag's Battery Will Last for Up to 10 Years With Elevation Lab's New TimeCapsule Enclosure

Wednesday December 18, 2024 10:05 am PST by
Elevation Lab today announced the launch of TimeCapsule, an innovative and simple solution for increasing the battery life of Apple's AirTag. Priced at $20, TimeCapsule is an AirTag enclosure that houses two AA batteries that offer 14x more battery capacity than the CR2032 battery that the AirTag runs on. It works by attaching the AirTag's upper housing to the built-in custom contact in the...
apple tv 4k yellow bg feature

New Apple TV Rumored to Launch Next Year With These Features

Tuesday December 17, 2024 9:02 am PST by
The current Apple TV 4K was released more than two years ago, so the streaming device is becoming due for a hardware upgrade soon. Fortunately, it was recently rumored that a new Apple TV will launch at some point next year. Below, we recap rumors about the next-generation Apple TV. Bloomberg's Mark Gurman last week reported that Apple has been working on its own combined Wi-Fi and...
blackmagic vision pro

Blackmagic Debuts $30K 3D Camera for Capturing Video for Vision Pro

Monday December 16, 2024 4:17 pm PST by
Blackmagic today announced that its URSA Cine Immersive camera is now available for pre-order, with deliveries set to start late in the first quarter of 2025. Blackmagic says that this is the world's first commercial camera system designed to capture 3D content for the Vision Pro. The URSA Cine Immersive camera was first introduced in June, but it has not been available for purchase until...
mac pro creativity

Apple Launched the Controversial 'Trashcan' Mac Pro 11 Years Ago Today

Thursday December 19, 2024 7:00 pm PST by
Apple launched the controversial "trashcan" Mac Pro eleven years ago today, introducing one of its most criticized designs that persisted through a period of widespread discontentment with the Mac lineup. The redesign took the Mac Pro in an entirely new direction, spearheaded by a polished aluminum cylindrical design that became unofficially dubbed the "trashcan" in the Mac community. All of ...
iPhone 17 Slim Feature

'iPhone 17 Air' With 'Major' Design Changes and 19-Inch MacBook Detailed in New Report

Sunday December 15, 2024 9:47 am PST by
Apple is planning a series of "major design" and "format changes" for iPhones over the next few years, according to The Wall Street Journal's Aaron Tilley and Yang Jie. The paywalled report published today corroborated the widely-rumored "iPhone 17 Air" with an "ultrathin" design that is thinner than current iPhone models. The report did not mention a specific measurement, but previous...

Top Rated Comments

dannyyankou Avatar
46 months ago
On screen game controllers have never worked and will never work. It’s very difficult to keep your eyes on the gameplay and controls at the same time. You need physical buttons.
Score: 25 Votes (Like | Disagree)
TheDailyApple Avatar
46 months ago
I find the best on screen controllers are the ones designed from the ground up for touch screen instead on those trying to replicate standard game controls.
Score: 10 Votes (Like | Disagree)
TheDailyApple Avatar
46 months ago

On screen game controllers have never worked and will never work. It’s very difficult to keep your eyes on the gameplay and controls at the same time. You need physical buttons.
While I tend to agree with you, this could help with that. If multiple games share the same on screen controls then it will be easier to memorize button location and placement. Similar to how I can type on the 12.9” iPad’s software keyboard without looking just like I do on a real one (albeit more slowly) because the key placement is the same.

Obviously a heavy gamer should buy a real controller just as a coder or writer should buy a real keyboard. But as light/infrequent gamers are unlikely to invest in one, it’s worth optimizing the on screen interface.
Score: 9 Votes (Like | Disagree)
RadioHedgeFund Avatar
46 months ago

On screen game controllers have never worked and will never work. It’s very difficult to keep your eyes on the gameplay and controls at the same time. You need physical buttons.
I don’t know, Caster (http://www.elecorn.com/caster3d/) largely nailed the core aspects of it in 2009 by just using the position of your thumb from the first point it hits the screen. It is entirely possible to use the orientation of your character or vehicle as a visual cue for where you need to go to next. Controlling a camera using the same method is no different to using a mouse.

Meteor Blitz (https://toucharcade.com/2009/09/16/meteor-blitz-dual-stick-space-shooting-goodness/) also showed how you can use orientation and visual cues to make up for a lack of buttons. Geometry Wars 3 on iOS was and still is a fantastic port.

Where touchscreen controls do fall down is when devs tried to port over console titles to a phone and have to shoehorn touchscreen controls into games not designed for them. This does not work.

There are exceptions, for example games with a largely static camera like FFVII but this pales in comparison to proper ports like FFIX which have been redesigned with the host platform in mind. See also titles like Horizon Chase and Oceanhorn 1.
Score: 7 Votes (Like | Disagree)
LFC2020 Avatar
46 months ago
This is why they must of released a 16gb ram iPad ?? since the ram is useless for anything else on iPadOS at the moment.
Score: 5 Votes (Like | Disagree)
Joniz Avatar
46 months ago
Yeah, I can see someone making a game where these are a set of boobs or something.
Score: 5 Votes (Like | Disagree)