Apple Shares Research into Self-Driving Car Software That Improves Obstacle Detection

Apple computer scientists working on autonomous vehicle technology have posted a research paper online describing how self-driving cars can spot cyclists and pedestrians using fewer sensors (via Reuters).

The paper by Yin Zhou and Oncel Tuzel was submitted to the moderated scientific pre-print repository arXiv on November 17, in what appears to be Apple's first publicly disclosed research on autonomous vehicle technology.

appleautonomousdrivingtestlexus
The paper is titled "End-to-End Learning for Point Cloud Based 3D Object Detection", and describes how new software developed by Apple scientists improves the ability of LiDAR (Light Detection and Ranging) systems to recognize objects including pedestrians and cyclists from a distance.

Self-driving cars typically use a combination of standard cameras and depth-sensing LiDAR units to receive information about the world around them.

Apple's research team said they were able to get "highly encouraging results" using LiDAR data alone to spot cyclists and pedestrians, and wrote that they were also able to beat other approaches for detecting 3D objects that rely solely on LiDAR tech. The experiments were limited to computer simulations and did not advance to road tests.

Apple famously has a secretive research policy and has kept its work under wraps for many years, but over the last 12 months, the company has shared some of its research advancements with other researchers and the wider public, particularly in the area of machine learning.

In December 2016, Apple said that it would start allowing its AI and machine learning researchers to publish and share their work in papers, with the first paper appearing just a few weeks following the announcement.

Additionally, in July of this year, Apple researchers initiated the "Apple Machine Learning Journal", a blog detailing their work on machine learning, AI, and other related topics.

This new policy of openness could help Apple retain employees who do not want to keep their progress a secret, but the latest research into autonomous vehicle technology also lets regulators see that the company is making progress in this area. Last December, Apple told federal regulators it was excited about the technology and asked them not to restrict testing. In April, the company also filed a self-driving car testing plan with California regulators.

Apple CEO Tim Cook has called autonomy "the mother of all AI projects". During an August 2017 earnings call, Cook re-emphasized Apple's deep interest in the technology, and even hinted Apple's work on autonomy could be used for more than vehicles.

Apple has presumably been working on an autonomous driving system since 2014, when rumors of its efforts to create an electric vehicle first surfaced. Apple has now moved away from creating a full vehicle and is said to be focusing on self-driving technology instead.

Popular Stories

CarPlay Hero

Apple Releases Wireless CarPlay Fix

Wednesday April 16, 2025 11:28 am PDT by
If you have been experiencing issues with wireless CarPlay in your vehicle lately, it was likely due to a software bug that has now been fixed. Apple released iOS 18.4.1 today, and the update's release notes say it "addresses a rare issue that prevents wireless CarPlay connection in certain vehicles." If wireless CarPlay was acting up for you, updating your iPhone to iOS 18.4.1 should...
Beyond iPhone 13 Better Triad

Apple's 20th Anniversary iPhone May Finally Go All Screen

Tuesday April 15, 2025 6:31 am PDT by
Apple is preparing a "bold" new iPhone Pro model for the iPhone's 20th anniversary in 2027, according to Bloomberg's Mark Gurman. As part of what's being described as a "major shake-up," Apple is said to be developing a design that makes more extensive use of glass – and this could point directly to the display itself. Here's the case for Apple releasing a truly all-screen iPhone with no...
iOS 19 Roundup Feature

iOS 19 Will Add These New Features to Your iPhone

Tuesday April 15, 2025 7:37 am PDT by
The first iOS 19 beta is less than two months away, and there are already a handful of new features that are expected with the update. Apple should release the first iOS 19 beta to developers immediately following the WWDC 2025 keynote, which is scheduled for Monday, June 9. Following beta testing, the update should be released to the general public in September. Below, we recap the key...
maxresdefault

iPhone 17 Pro Launching Later This Year With These 12 New Features

Sunday April 13, 2025 7:52 am PDT by
While the iPhone 17 Pro and iPhone 17 Pro Max are not expected to launch until September, there are already plenty of rumors about the devices. Subscribe to the MacRumors YouTube channel for more videos. Below, we recap key changes rumored for the iPhone 17 Pro models as of April 2025: Aluminum frame: iPhone 17 Pro models are rumored to have an aluminum frame, whereas the iPhone 15 Pro and ...
iphone 16 pro models 1

17 Reasons to Wait for the iPhone 17

Thursday April 17, 2025 4:12 am PDT by
Apple's iPhone development roadmap runs several years into the future and the company is continually working with suppliers on several successive iPhone models simultaneously, which is why we often get rumored features months ahead of launch. The iPhone 17 series is no different, and we already have a good idea of what to expect from Apple's 2025 smartphone lineup. If you skipped the iPhone...
AirPods Pro 3 Mock Feature

AirPods Pro 3 Just Months Away – Here's What We Know

Friday April 18, 2025 5:16 am PDT by
Despite being more than two years old, Apple's AirPods Pro 2 still dominate the premium wireless‑earbud space, thanks to a potent mix of top‑tier audio, class‑leading noise cancellation, and Apple's habit of delivering major new features through software updates. With AirPods Pro 3 widely expected to arrive in 2025, prospective buyers now face a familiar dilemma: snap up the proven...
iOS 18

Apple Releases iOS 18.4.1 With Bug Fixes

Wednesday April 16, 2025 10:11 am PDT by
Apple today released iOS 18.4.1 and iPadOS 18.4.1, minor updates to the iOS 18 and iPadOS 18 operating systems that came out last September. iOS 18.4.1 and iPadOS 18.4.1 come two weeks after the launch of iOS 18.4 and iPadOS 18.4. The new software can be downloaded on eligible iPhones and iPads over-the-air by going to Settings > General > Software Update. There have been complaints about ...
tvOS 18 Thumb 1

Apple Releases tvOS 18.4.1

Wednesday April 16, 2025 10:04 am PDT by
Apple today released tvOS 18.4.1, a minor update to the tvOS 18 operating system that came out last September. tvOS 18.4.1 comes two weeks after Apple released tvOS 18.4, and it is available for the Apple TV 4K and Apple TV HD models. tvOS 18.4.1 can be downloaded using the Settings app on the ‌Apple TV‌. Open up Settings and go to System > Software Update to get the new software....
iPhone Security Feature 25

Five iPhone Security Features You Should Be Using

Wednesday April 16, 2025 4:15 pm PDT by
Apple has quite a few security features that it's added to iPhones, iPads, and Macs over the years. Now more than ever, it's important to make sure you're taking advantage of the built-in security tools that are available to keep yourself and your data safe, so we've rounded up a list of the most important options. If you don't already have these enabled, you might want to consider turning...

Top Rated Comments

ErikGrim Avatar
97 months ago
This is good for everyone. Apple sharing this research instead of keeping it proprietary shows they are more interested in getting to a sustainable future faster than retaining whatever competitive business advantage this would give them.
Score: 8 Votes (Like | Disagree)
MistrSynistr Avatar
97 months ago
Why are they making these? Who has ever asked for self driving cars?

We wanted FLYING cars, I think they got this mixed up somewhere.
Score: 7 Votes (Like | Disagree)
ISanych Avatar
97 months ago
check your stats: sad but not millions—fewer than 40,000 deaths per year, “only” 3.6 million 1899-2013, according to National Traffic Safety Transportation Bd.
FYI: US is not the only country on Earth.
http://asirt.org/initiatives/informing-road-users/road-safety-facts/road-crash-statistics

* Nearly 1.3 million people die in road crashes each year, on average 3,287 deaths a day.
* An additional 20-50 million are injured or disabled.
Score: 5 Votes (Like | Disagree)
recoil80 Avatar
97 months ago

We wanted FLYING cars, I think they got this mixed up somewhere.
And I wouldn't say no to a time machine, so I can bring back an almanac, get rich and finally be able to afford the new iMac pro
Score: 5 Votes (Like | Disagree)
BvizioN Avatar
97 months ago
Why are they making these? Who has ever asked for self driving cars?

We wanted FLYING cars, I think they got this mixed up somewhere.
One step at a time.
And who asked for self driving cars? Since humans are quite good at causing terrible accidents on the road that costs the life of millions each year, self driving car seems the logical solution. Who wouldn't want to minimise the road accidents?
Score: 4 Votes (Like | Disagree)
BvizioN Avatar
97 months ago
check your stats: sad but not millions—fewer than 40,000 deaths per year, “only” 3.6 million 1899-2013, according to National Traffic Safety Transportation Bd.

that said—I am not yet crazy about self-driving cars either. Daughter and son-in-law were backseat passengers in vehicle with self-driving engaged that “failed to see” highway exit barrier and would have crashed but for host’s screaming shotgun-riding wife.
You most be one of them that thinks US is the entire world. Here ('http://asirt.org/initiatives/informing-road-users/road-safety-facts/road-crash-statistics')
And I was talking about how it effects the millions of others life, the injured.
And of course, a single or maybe few accidents on a beta testing self driving cars of the future is a clear indication of capabilities if this technology. Nothing compare with the human madness on the road.
[doublepost=1511358366][/doublepost]

Careful what you ask for..... quite a few plan crashes were attributed to automation . Sadly human can adapt and react to situations, when a computer encounters an edge case the consequences can be tragic be it a plane or car.
It is a beta testing technology that can be improved beyond what we even think it is possible today.
And thank you, but I don't trust humans on the road. I have seen quite enough. Can't wait to see the day driving on the road becomes illegal (if in my lifetime)
Score: 4 Votes (Like | Disagree)