Apple Shares Research into Self-Driving Car Software That Improves Obstacle Detection

Apple computer scientists working on autonomous vehicle technology have posted a research paper online describing how self-driving cars can spot cyclists and pedestrians using fewer sensors (via Reuters).

The paper by Yin Zhou and Oncel Tuzel was submitted to the moderated scientific pre-print repository arXiv on November 17, in what appears to be Apple's first publicly disclosed research on autonomous vehicle technology.

appleautonomousdrivingtestlexus
The paper is titled "End-to-End Learning for Point Cloud Based 3D Object Detection", and describes how new software developed by Apple scientists improves the ability of LiDAR (Light Detection and Ranging) systems to recognize objects including pedestrians and cyclists from a distance.

Self-driving cars typically use a combination of standard cameras and depth-sensing LiDAR units to receive information about the world around them.

Apple's research team said they were able to get "highly encouraging results" using LiDAR data alone to spot cyclists and pedestrians, and wrote that they were also able to beat other approaches for detecting 3D objects that rely solely on LiDAR tech. The experiments were limited to computer simulations and did not advance to road tests.

Apple famously has a secretive research policy and has kept its work under wraps for many years, but over the last 12 months, the company has shared some of its research advancements with other researchers and the wider public, particularly in the area of machine learning.

In December 2016, Apple said that it would start allowing its AI and machine learning researchers to publish and share their work in papers, with the first paper appearing just a few weeks following the announcement.

Additionally, in July of this year, Apple researchers initiated the "Apple Machine Learning Journal", a blog detailing their work on machine learning, AI, and other related topics.

This new policy of openness could help Apple retain employees who do not want to keep their progress a secret, but the latest research into autonomous vehicle technology also lets regulators see that the company is making progress in this area. Last December, Apple told federal regulators it was excited about the technology and asked them not to restrict testing. In April, the company also filed a self-driving car testing plan with California regulators.

Apple CEO Tim Cook has called autonomy "the mother of all AI projects". During an August 2017 earnings call, Cook re-emphasized Apple's deep interest in the technology, and even hinted Apple's work on autonomy could be used for more than vehicles.

Apple has presumably been working on an autonomous driving system since 2014, when rumors of its efforts to create an electric vehicle first surfaced. Apple has now moved away from creating a full vehicle and is said to be focusing on self-driving technology instead.

Popular Stories

iPhone 17 Pro 34ths Perspective

iPhone 17 Pro Launching Later This Year With These 10 New Features

Sunday March 23, 2025 10:00 am PDT by
While the iPhone 17 Pro and iPhone 17 Pro Max are not expected to launch until September, there are already plenty of rumors about the devices. Below, we recap key changes rumored for the iPhone 17 Pro models as of March 2025: Aluminum frame: iPhone 17 Pro models are rumored to have an aluminum frame, whereas the iPhone 15 Pro and iPhone 16 Pro models have a titanium frame, and the iPhone ...
macbook pro blue green

When Will Apple Release the M5 MacBook Pro?

Wednesday March 26, 2025 4:53 pm PDT by
Apple regularly refreshes the MacBook Pro models, and a new version that uses M5 series chips is in the works. Apple just finished refreshing most of the Mac lineup with M4 chips, and now it's time for the M5. Rumors suggest that we could see the first M5 MacBook Pro models this fall. Design There have been no rumors of a design update for the M5 MacBook Pro models that are coming this...
iOS 18

iOS 18.4 Expected Next Week - Here Are the Release Notes

Friday March 28, 2025 2:01 pm PDT by
With the second release candidate of iOS 18.4 that Apple seeded out today, the company finally provided us with release notes that give a full rundown on what to expect. There's an Apple Vision Pro app, new Apple Intelligence features for notifications and additional language support, plus an Apple News Food feature for Apple News+ subscribers, and several updates that should improve the...
Facebook Feature

Facebook's New iPhone App Feature Turns the Clock Back to 2007

Thursday March 27, 2025 1:59 pm PDT by
In the mid-to-late 2000s, Facebook was all about staying connected with friends and family. However, as the social media platform added new features and grew over time, that core experience began to get drowned out. That changes starting now, according to Meta, which today introduced a new feature that will "bring back the joy" of classic Facebook. Specifically, Meta has redesigned the...
Magic Mouse Green

What to Expect From the Magic Mouse 3

Saturday March 29, 2025 10:15 am PDT by
Apple is reportedly working on a new Magic Mouse. Below, we recap what to expect. The two key rumors for the Magic Mouse 3 so far include a relocated charging port, along with a more ergonomic design. It was briefly rumored that the Magic Mouse 3 would also feature voice control, but that was misinterpreted information. Relocated Charging Port While the Magic Mouse switched from...
Foldable iPhone 2023 Feature Homescreen

Six Things to Know About Apple's Upcoming Foldable iPhone

Friday March 28, 2025 3:54 pm PDT by
We've been hearing rumors about a foldable iPhone for almost a decade now, but it looks like we might finally see the device come to fruition in 2026. We're going to be waiting many more months for the foldable iPhone, but so far we're hearing good things. Apple wants to make it creaseless. It's taken Apple multiple years to design a foldable iPhone that it's satisfied with because Apple ...
iOS 18 4 Ambient Music Control Center

How to Use iOS 18.4's New Ambient Music Feature in Control Center

Thursday March 27, 2025 7:45 am PDT by
The upcoming iOS 18.4 update for the iPhone adds an Ambient Music feature to Control Center. Below, we take a closer look at how it works. iOS 18.4 is currently in beta, so the Ambient Music feature is not widely available yet. The update will likely be released to the general public next week. To use the feature on iOS 18.4, open Control Center and tap on the plus sign in the top-left...
Foldable iPhone 2023 Feature 1

'iPhone Fold' to Feature Metallic Glass Hinge That Resists Deformation

Thursday March 27, 2025 4:21 am PDT by
Last week, we covered a report claiming that Apple's book-style foldable iPhone (or "iPhone Fold," as we are provisionally calling it here) will use liquid metal hinges to improve durability and help minimize screen creasing. Today, a Chinese leaker provided more details on the properties of this hinge material that help to clarify why Apple chose it for its first foldable device. According...
top stories 2025 03 29

Top Stories: WWDC 2025 Announced, iPhone 17 Pro and iOS 19 Rumors, and More

Saturday March 29, 2025 6:00 am PDT by
Apple's big developer event is a little over two months away, and rumors about what we can expect to see in Apple's next major operating system updates are becoming increasingly frequent. A public release of iOS 18.4 is also imminent with a number of updates and improvements, although we won't be getting the major Apple Intelligence Siri upgrades that had reportedly been planned for this...

Top Rated Comments

ErikGrim Avatar
96 months ago
This is good for everyone. Apple sharing this research instead of keeping it proprietary shows they are more interested in getting to a sustainable future faster than retaining whatever competitive business advantage this would give them.
Score: 8 Votes (Like | Disagree)
MistrSynistr Avatar
96 months ago
Why are they making these? Who has ever asked for self driving cars?

We wanted FLYING cars, I think they got this mixed up somewhere.
Score: 7 Votes (Like | Disagree)
ISanych Avatar
96 months ago
check your stats: sad but not millions—fewer than 40,000 deaths per year, “only” 3.6 million 1899-2013, according to National Traffic Safety Transportation Bd.
FYI: US is not the only country on Earth.
http://asirt.org/initiatives/informing-road-users/road-safety-facts/road-crash-statistics

* Nearly 1.3 million people die in road crashes each year, on average 3,287 deaths a day.
* An additional 20-50 million are injured or disabled.
Score: 5 Votes (Like | Disagree)
recoil80 Avatar
96 months ago

We wanted FLYING cars, I think they got this mixed up somewhere.
And I wouldn't say no to a time machine, so I can bring back an almanac, get rich and finally be able to afford the new iMac pro
Score: 5 Votes (Like | Disagree)
BvizioN Avatar
96 months ago
Why are they making these? Who has ever asked for self driving cars?

We wanted FLYING cars, I think they got this mixed up somewhere.
One step at a time.
And who asked for self driving cars? Since humans are quite good at causing terrible accidents on the road that costs the life of millions each year, self driving car seems the logical solution. Who wouldn't want to minimise the road accidents?
Score: 4 Votes (Like | Disagree)
BvizioN Avatar
96 months ago
check your stats: sad but not millions—fewer than 40,000 deaths per year, “only” 3.6 million 1899-2013, according to National Traffic Safety Transportation Bd.

that said—I am not yet crazy about self-driving cars either. Daughter and son-in-law were backseat passengers in vehicle with self-driving engaged that “failed to see” highway exit barrier and would have crashed but for host’s screaming shotgun-riding wife.
You most be one of them that thinks US is the entire world. Here ('http://asirt.org/initiatives/informing-road-users/road-safety-facts/road-crash-statistics')
And I was talking about how it effects the millions of others life, the injured.
And of course, a single or maybe few accidents on a beta testing self driving cars of the future is a clear indication of capabilities if this technology. Nothing compare with the human madness on the road.
[doublepost=1511358366][/doublepost]

Careful what you ask for..... quite a few plan crashes were attributed to automation . Sadly human can adapt and react to situations, when a computer encounters an edge case the consequences can be tragic be it a plane or car.
It is a beta testing technology that can be improved beyond what we even think it is possible today.
And thank you, but I don't trust humans on the road. I have seen quite enough. Can't wait to see the day driving on the road becomes illegal (if in my lifetime)
Score: 4 Votes (Like | Disagree)