Apple Still Pursuing VR-Based Vehicle Motion Sickness Solution With Contributions From Mark Rober

Back in 2018, it was revealed that noted YouTuber and former NASA engineer Mark Rober had been quietly working in Apple's special projects group on several projects related to virtual reality.

While Rober has since left his position at Apple, the company has continued to pursue patent applications based on his team's work, and a newly published application today relates to the team's efforts to create VR-based solutions for motion sickness experienced by riders in vehicles.

Screenshot 2020 08 13 at 15
The patent, which is titled "Immersive Virtual Display" and is a continuation of a previously filed one on the same topic, shows that Apple has made some changes to the technical claims of the patent, deleting the original 20 claims and adding 20 new ones in an ongoing attempt to protect the concepts developed by the team.

Apple's patent application describes a VR system for vehicles with multiple uses. Simply, the system would provide virtual views that match visual cues with the physical motions that a passenger experiences. The VR experience would be immersive, replacing the view of the real world with a virtual environment. In addition to the obvious opportunities for entertainment, this virtual environment would be able to adjust in real time to accommodate a passenger suffering from motion sickness.

The VR system, which could involve a headset or projection onto a window or other surface, would generate virtual content for providing a view of the virtual environment. Users would be able to select a simulated route from a different location based on the route from the real environment. To do this, the system would compare the turns and curves of the route in the other location to the turns and curves of the route in the real environment, and ensure that they at least partially match.

apple vr motion sickness patent
When this is not possible, the system would augment the simulation of the selected simulated route to ensure that it matches the real-world route. The motions and accelerations of the virtual content would therefore be synchronized with the real-world motions and accelerations of the vehicle. The vehicle itself would require a sensor to be coupled to it to facilitate this.

The filing explains that the vehicle's systems and controls could also be integrated with the VR system to provide physical effects with the virtual experience. The patent makes clear that this would include control of throttle, brakes, suspension, and steering. Furthermore, the fan speed, temperature, and direction of heating and air conditioning could also be changed to provide physical effects to the virtual experience. Plans for the inclusion of sound effects via the car's audio system are also included.

Simulated environments would be stereoscopic to create an illusion of depth, and adjust in real time to provide the illusion of the user moving within the scene. All of this would allow users to feel as if they were physically in a different environment.

The patent specifically outlines how slight changes to perceived motion in the simulated environment that differ from the motions of the real world would treat and prevent motion sickness. For example, visual cues that indicate flow past a passenger may be slowed down or sped up when compared to the actual speed or acceleration of the vehicle to mitigate sickness. In addition to adapting the mapping ratio to help prevent motion sickness, visual, sensory, and audio techniques may be used to increase the comfort passengers suffering from motion sickness.

The filing also refers to a potential mixed reality application of this technology, which may potentially indicate its use in the rumored Apple Glasses product. Alternately, the patent mentions use of this VR system in autonomous vehicles, which could refer to Apple's long-rumored vehicle project.

The patent application says that windows in vehicles are "inherently unsafe and not structurally sound, and add cost to vehicles." Providing a virtual view of the real environment or of a simulated environment would eliminate the need for windows in autonomous vehicles completely. The VR system could also provide passengers with the sensation that they are riding in a larger vehicle than its actual size, which the patent says "may provide passengers with a more pleasant and secure-feeling experience when riding in a small autonomous vehicle."

Apple files dozens of patents application weekly, but patent filings are not always indicative of Apple's immediate plans. Given the complexity and outlandish nature of this filing, it is very unlikely that any of the features outlined in it will come to market any time soon. Nonetheless, it offers insight into Apple's current areas of research and development.

Related Roundup: Apple Vision Pro
Buyer's Guide: Vision Pro (Neutral)

Popular Stories

iPhone 17 Pro 34ths Perspective

iPhone 17 Pro Launching Later This Year With These 10 New Features

Sunday March 23, 2025 10:00 am PDT by
While the iPhone 17 Pro and iPhone 17 Pro Max are not expected to launch until September, there are already plenty of rumors about the devices. Below, we recap key changes rumored for the iPhone 17 Pro models as of March 2025: Aluminum frame: iPhone 17 Pro models are rumored to have an aluminum frame, whereas the iPhone 15 Pro and iPhone 16 Pro models have a titanium frame, and the iPhone ...
macbook pro blue green

When Will Apple Release the M5 MacBook Pro?

Wednesday March 26, 2025 4:53 pm PDT by
Apple regularly refreshes the MacBook Pro models, and a new version that uses M5 series chips is in the works. Apple just finished refreshing most of the Mac lineup with M4 chips, and now it's time for the M5. Rumors suggest that we could see the first M5 MacBook Pro models this fall. Design There have been no rumors of a design update for the M5 MacBook Pro models that are coming this...
Apple Lumon Terminal Pro

Apple's Mac Site Features Fictional 'Lumon Terminal Pro'

Wednesday March 26, 2025 12:19 pm PDT by
Apple is going all out with promotions for the popular Severance Apple TV+ show today, and as of right now, you'll find a new "Lumon Terminal Pro" listed on Apple's Mac site. The Lumon Terminal Pro is designed to look similar to the machines that Severance employees like Mark S. and Helly R. use for macrodata refinement. The Terminal features a blue keyboard, a small display with wide...
Facebook Feature

Facebook's New iPhone App Feature Turns the Clock Back to 2007

Thursday March 27, 2025 1:59 pm PDT by
In the mid-to-late 2000s, Facebook was all about staying connected with friends and family. However, as the social media platform added new features and grew over time, that core experience began to get drowned out. That changes starting now, according to Meta, which today introduced a new feature that will "bring back the joy" of classic Facebook. Specifically, Meta has redesigned the...
Generic iOS 18

iOS 18.4 Coming Soon With These New Features for Your iPhone

Tuesday March 25, 2025 6:45 am PDT by
Apple is expected to release iOS 18.4 to the general public as soon as next week, following more than a month of beta testing. Apple's website says some iOS 18.4 features will be released in "early April," so the update should be out as early as Tuesday, April 1. Apple this week seeded the iOS 18.4 Release Candidate, which is typically the final beta version, barring the discovery of any...
iPhone 17 Pro 34ths Perspective

iPhone 17 Pro Supports 8K Video Recording, Suggests Leaker [Updated]

Wednesday March 26, 2025 4:06 am PDT by
Update 7:25 pm: Based on comments from our forums, it appears the original Weibo post may have been mistranslated and "8K" actually refers to the high price of the device rather than 8K video recording capabilities. The iPhone 16 Pro currently starts at 7,999 yuan in China. Our original article follows below. Apple's forthcoming iPhone 17 Pro models are capable of shooting 8K video, up...
Foldable iPhone 2023 Feature 1

'iPhone Fold' to Feature Metallic Glass Hinge That Resists Deformation

Thursday March 27, 2025 4:21 am PDT by
Last week, we covered a report claiming that Apple's book-style foldable iPhone (or "iPhone Fold," as we are provisionally calling it here) will use liquid metal hinges to improve durability and help minimize screen creasing. Today, a Chinese leaker provided more details on the properties of this hinge material that help to clarify why Apple chose it for its first foldable device. According...
Generic iOS 19 Feature Mock

Gurman: Jon Prosser's iOS 19 Mockups 'Aren't Representative' of Redesign

Tuesday March 25, 2025 4:47 pm PDT by
The iOS 19 mockup images that leaker Jon Prosser shared today are not representative of the actual iOS 19 design, Bloomberg's Mark Gurman said on social media. According to Gurman, the images that are "floating around" are based on "very old builds" or "vague descriptions," and are lacking key features. Gurman says that we can "expect more from Apple in June." Gurman made the same comment ...
iOS 18 4 Ambient Music Control Center

How to Use iOS 18.4's New Ambient Music Feature in Control Center

Thursday March 27, 2025 7:45 am PDT by
The upcoming iOS 18.4 update for the iPhone adds an Ambient Music feature to Control Center. Below, we take a closer look at how it works. iOS 18.4 is currently in beta, so the Ambient Music feature is not widely available yet. The update will likely be released to the general public next week. To use the feature on iOS 18.4, open Control Center and tap on the plus sign in the top-left...

Top Rated Comments

Applebot1 Avatar
60 months ago
I am ?
Score: 9 Votes (Like | Disagree)
now i see it Avatar
60 months ago
so we can all now pretend we're in a Rolls Royce.
Poverty will no longer exist. Just put on this VR headset...

The patent application says that windows in vehicles are "inherently unsafe and not structurally sound, and add cost to vehicles." Providing a virtual view of the real environment or of a simulated environment would eliminate the need for windows in autonomous vehicles completely. The VR system could also provide passengers with the sensation that they are riding in a larger vehicle than its actual size, which the patent says "may provide passengers with a more pleasant and secure-feeling experience when riding in a small autonomous vehicle."
Score: 3 Votes (Like | Disagree)
AngerDanger Avatar
60 months ago

so the key is to replace windows with screens that have a projection of real-world views?
Yeah, it's a bit like robbing a bank wearing a mask made from a photo of your own face.
Score: 3 Votes (Like | Disagree)
magicschoolbus Avatar
60 months ago
Can we focus on teleportation instead?
Score: 2 Votes (Like | Disagree)
44267547 Avatar
60 months ago
Side note:

Huge fan of Mark Rober. The Guy Is incredibly talented and shows angles to theories/experiments that take extensive testing For demonstration purposes.
Score: 1 Votes (Like | Disagree)
boswald Avatar
60 months ago

Who's interested in Apple glasses?
Sure as hell isn’t me!
Score: 1 Votes (Like | Disagree)