A Look at Apple's Assistant Interface for the New iPhone

Apple has been rumored to be working on advanced speech recognition technology for some time.

After Apple's acquisition of Siri, TechCrunch reported in May that negotiations were ongoing with Nuance to integrate their speech recognition technology into iOS. Earlier this week, 9to5mac detailed much of what is expected to be the major new feature in the next generation iPhone to be release on October 4th. The story was met with some skepticism in our forums, but we were especially confident in the report as we had privately heard the exact same story from our sources.

The Siri/Nuance-based voice recognition Assistant will be the major new feature in the next generation iPhone and will be an iPhone 4S/5 exclusive feature. As detailed, the Assistant will allow users to speak to their iPhones in order to schedule appointments, send text messages, retrieve information and much more. Voice recognition happens on the fly and reportedly with great accuracy.

assistant
Assistant interface, artist rendition

We've created this artist rendition (above) of what the Assistant interface looks like based on sources with knowledge of the feature. After a long press on the home button, the screen fades and slides up, just like with the multitasking interface. Revealed is a silver icon with an animated orbiting purple flare which indicates a ready state. From what we've been told, this image is a close representation of the actual Assistant interface.

From there, the user may be taken to a conversation view that somewhat mimics Siri's original interface, but in Apple's own styling.

Based on this knowledge, we contracted Jan-Michael Cart to put together a video representation of the Assistant workflow. Cart had been responsible for a number of iOS concept videos in the past, but we wanted to mock up what the actual Assistant interface looked like. Due to the short turnaround, we know that not all elements in the video represent actual look/feel of the Assistant interface, but should show off the general workflow.


After receiving spoken commands, the Assistant shows you back the recognized text and then takes the next step. This could involve sending a text message (with confirmation) or pulling data from Wolfram Alpha. The feature is said to be one of the major differentiators for the next generation iPhone.

Apple is hosting a media event on October 4th, where they will introduce the next iPhone and these new features.

Popular Stories

Generic iOS 19 Feature Mock Light

iOS 19 Leak Reveals All-New Design

Friday January 17, 2025 2:42 pm PST by
iOS 19 is still around six months away from being announced, but a new leak has allegedly revealed a completely redesigned Camera app. Based on footage it obtained, YouTube channel Front Page Tech shared a video showing what the new Camera app will apparently look like, with the key change being translucent menus for camera controls. Overall, the design of these menus looks similar to...
2024 iPhone Boxes Feature

Apple Changes Trade-In Values for iPhones, iPads, Macs, and More

Thursday January 16, 2025 6:45 am PST by
Apple today adjusted estimated trade-in values for select iPhone, iPad, Mac, and Apple Watch models in the U.S., according to its website. Some values increased, while others decreased. The changes were not too significant, with most values rising or dropping by $5 to $50. We have outlined some examples below: Device New Value Old Value iPhone 15 Pro Max Up to $630 U ...
2024 App Store Awards

Apple Explains Why It Removed TikTok From the App Store in the U.S.

Sunday January 19, 2025 6:58 am PST by
Apple on late Saturday removed TikTok from the App Store in the U.S., and it has now explained why it was required to take this action. Last year, the U.S. passed a law that required Chinese company ByteDance to divest its ownership of TikTok due to potential national security risks, or else the platform would be banned. That law went into effect today, and companies like Apple and Google...
Generic iOS 18

Everything New in iOS 18.3 Beta 3

Thursday January 16, 2025 12:39 pm PST by
Apple provided the third beta of iOS 18.3 to developers today, and while the betas have so far been light on new features, the third beta makes some major changes to Notification Summaries and also tweaks a few other features. Notification Summary Changes Apple made multiple changes to Notification Summaries in response to complaints about inaccurate summaries of news headlines. For...
iOS 19 Roundup Feature

iOS 19 Rumored to Be Compatible With These iPhones

Saturday January 18, 2025 10:28 am PST by
iOS 19 will not drop support for any iPhone models, according to French website iPhoneSoft.fr. The report cited a source who said iOS 19 will be compatible with any iPhone that can run iOS 18, which would mean the following models: iPhone 16 iPhone 16 Plus iPhone 16 Pro iPhone 16 Pro Max iPhone 15 iPhone 15 Plus iPhone 15 Pro iPhone 15 Pro Max iPhone 14 iPhon...
iPad Pro vs iPhone 17 Air Feature

Here's How Thin the iPhone 17 Air Might Be

Friday January 17, 2025 3:38 pm PST by
For the last several months, we've been hearing rumors about a redesigned version of the iPhone 17 that Apple might call the iPhone 17 "Air," or something along those lines. It's going to replace the iPhone 17 Plus as Apple's fourth iPhone option, and it will be offered alongside the iPhone 17, iPhone 17 Pro, and iPhone 17 Pro Max. We know the iPhone 17 Air is going to be super slim, but...
apple power beats pro 2

Powerbeats Pro 2 Coming Soon: Apple to Announce Them 'Imminently'

Sunday January 19, 2025 8:25 am PST by
In September, Apple said that it would be launching Powerbeats Pro 2 in 2025, and it appears the wireless earbuds are coming very soon. Powerbeats Pro 2 images found in iOS 18 code In his Power On newsletter today, Bloomberg's Mark Gurman said the Powerbeats Pro 2 are "due imminently." In addition to Apple filing the Powerbeats Pro 2 in regulatory databases last month, Gurman said Apple is...
mail categories macos

Apple's Redesigned Mail App is Expanding to the Mac — Here's When

Sunday January 19, 2025 6:02 am PST by
Apple plans to expand the iPhone's redesigned Mail app to the Mac starting with macOS 15.4, according to Bloomberg's Mark Gurman. The first macOS 15.4 beta should be made available in the coming weeks, and Apple has previously suggested that the iOS 18.4, iPadOS 18.4, and macOS 15.4 series of software updates will be released to the public in April. The revamped Mail app debuted on all...

Top Rated Comments

robbieduncan Avatar
174 months ago
Have they solved the problem of feeling like a complete idiot when you use these sort of interfaces?
Score: 49 Votes (Like | Disagree)
theperipheral Avatar
174 months ago
Hopefully this will be for the iphone 4 as well.. Otherwise we will all have to continue texting while driving.

I don't see a problem with texting while driving. I do it almost every day, and I've never h
Score: 35 Votes (Like | Disagree)
arn Avatar
174 months ago
If you activate it by holding down the home button, how will you rearrange your apps?

by long pressing on the app icon as usual. :)

long press home button is already occupied by voice control.

arn
Score: 34 Votes (Like | Disagree)
DrJohnnyN Avatar
174 months ago
Pretty cool! Tuesday cannot come fast enough!!
Score: 25 Votes (Like | Disagree)
euphlyusUNO Avatar
174 months ago
This is the fundamental difference between the Android and the Apple camps.

Androidies think and talk in terms of features, hardware specs

Applelites think in terms of experience


Case In Point:

For those comparing WP7 Tell Me and Google Voice Actions with Apple Assistant:

WP7 and Tell Me are not "Assistants". They perform actions based on voice inputs. WP7 implementation does simpler things (invoking apps, calling a cell phone number). Voice Action packs in more capability (though I haven't worked with either of those, this is based purely on watching videos)

However, if iOS Assistant is anything close to what's described in the Video and something akin the App Siri, then, the Assistant won't simply be "voice commands". You can have conversations, do more things than just call or send text. The assistant will also be more accurate by the virtue of understanding the context of a conversation (you'll understand this if you've carefully observed Siri mobile apps).

Just recognizing voice accurately is not enough. There has to be a simple and logical flow, like a conversation. I'm hoping Apple will nail that (as they've done sometimes before)
Score: 22 Votes (Like | Disagree)
gugy Avatar
174 months ago
this thing looks cool
Score: 20 Votes (Like | Disagree)