Apple Used Google Tensor Chips to Develop Apple Intelligence

Apple used Tensor Processing Units (TPUs) developed by Google instead of Nvidia's widely-used graphics processing units (GPUs) to construct two critical components of Apple Intelligence.

Apple Intelligence General Feature
The decision is detailed in a new research paper published by Apple that highlights its reliance on Google's cloud hardware (via CNBC). The paper reveals that Apple utilized 2,048 of Google's TPUv5p chips to build AI models and 8,192 TPUv4 processors for server AI models. The research paper does not mention Nvidia explicitly, but the absence of any reference to Nvidia's hardware in the description of Apple's AI infrastructure is telling and this omission suggests a deliberate choice to favor Google's technology.

The decision is noteworthy given Nvidia's dominance in the AI processor market and since Apple very rarely discloses its hardware choices for development purposes. Nvidia's GPUs are highly sought after for AI applications due to their performance and efficiency. Unlike Nvidia, which sells its chips and systems as standalone products, Google provides access to its TPUs through cloud services. Customers using Google's TPUs have to develop their software within Google's ecosystem, which offers integrated tools and services to streamline the development and deployment of AI models.

In the paper, Apple's engineers explain that the TPUs allowed them to train large, sophisticated AI models efficiently. They describe how Google's TPUs are organized into large clusters, enabling the processing power necessary for training Apple's AI models. Apple has announced plans to invest over $5 billion in AI server enhancements over the next two years, which should bolster its AI capabilities and reduce its dependence on external hardware providers.

In addition to detailing its use of Google's TPUs, the paper addresses ethical considerations in AI development. Apple emphasized its adherence to responsible data practices, claiming that no private user data was used in training its AI models. The company relied on a mix of publicly available, licensed, and open-sourced datasets for training purposes. Apple added that its training data set, which includes publicly available web data and licensed content, was curated to protect user privacy.

Popular Stories

iPhone SE 4 Thumb 1

iPhone SE 4 With Apple's Own 5G Modem 'Confirmed' to Launch in March

Tuesday November 19, 2024 12:12 pm PST by
Barclays analyst Tom O'Malley and his colleagues recently traveled to Asia to meet with various electronics manufacturers and suppliers. In a research note this week, outlining key takeaways from the trip, the analysts said they have "confirmed" that a fourth-generation iPhone SE with an Apple-designed 5G modem is slated to launch towards the end of the first quarter next year. In line with previo...
airtag purple

AirTag 2 Rumored to Launch Next Year With These New Features

Sunday November 17, 2024 5:18 am PST by
Apple released the AirTag in April 2021, so it is now three over and a half years old. While the AirTag has not received any hardware updates since then, a new version of the item tracking accessory is rumored to be in development. Below, we recap rumors about a second-generation AirTag. Timing Apple is aiming to release a new AirTag in mid-2025, according to Bloomberg's Mark Gurman....
Magic Mouse Next to Keyboard

No, Apple CEO Tim Cook Didn't Say He Prefers Logitech's MX Master 3 Over the Magic Mouse

Sunday November 17, 2024 3:03 pm PST by
While the Logitech MX Master 3 is a terrific mouse for the Mac, reports claiming that Apple CEO Tim Cook prefers that mouse over the Magic Mouse are false. The Wall Street Journal last month published an interview with Cook, in which he said he uses every Apple product every day. Soon after, The Verge's Wes Davis attempted to replicate using every Apple product in a single day. During that...
Generic iOS 18 Feature Real Mock

Apple Releases iOS 18.1.1 and iPadOS 18.1.1 With Security Fixes

Tuesday November 19, 2024 10:10 am PST by
Apple today released iOS 18.1.1 and iPadOS 18.1.1, minor updates to the iOS 18 and iPadOS 18 operating systems that debuted earlier in September. iOS 18.1.1 and iPadOS 18.1.1 come three weeks after the launch of iOS 18.1. The new software can be downloaded on eligible iPhones and iPads over-the-air by going to Settings > General > Software Update. Apple has also released iOS 17.7.2 for...
at t turbo indicator iphone 16 pro max v0 8hrh7w5f3w1e1

AT&T Turbo Indicator Showing Up in iPhone Status Bar for Subscribers

Wednesday November 20, 2024 3:42 am PST by
AT&T has begun displaying "Turbo" in the iPhone carrier label for customers subscribed to its premium network prioritization service, according to reports on Reddit. The new indicator seems to have started appearing after users updated to iOS 18.1.1, but that could be just coincidence. Image credit: Reddit user No_Highlight7476 The Turbo feature provides enhanced network performance through ...
iPhone 17 Slim Feature Single Camera 1 Redux

'iPhone 17 Air' Rumored to Surpass iPhone 6 as Thinnest iPhone Ever

Monday November 18, 2024 1:07 pm PST by
In a research note with Hong Kong-based investment bank Haitong today, obtained by MacRumors, Apple analyst Jeff Pu said he agrees with a recent rumor claiming that the so-called "iPhone 17 Air" will be around 6mm thick. "We agreed with the recent chatter of an 6mm thickness ultra-slim design of the iPhone 17 Slim model," he wrote. If that measurement proves to be accurate, there would be ...
bug security vulnerability issue fix larry

Make Sure to Update: iOS 18.1.1 and macOS Sequoia 15.1.1 Fix Actively Exploited Vulnerabilities

Tuesday November 19, 2024 10:52 am PST by
The iOS 18.1.1, iPadOS 18.1.1, and macOS Sequoia 15.1.1 updates that Apple released today address JavaScriptCore and WebKit vulnerabilities that Apple says have been actively exploited on some devices. With the JavaScriptCore vulnerability, processing maliciously crafted web content could lead to arbitrary code execution. The WebKit vulnerability had the same issue with maliciously crafted...

Top Rated Comments

MacHelp_75 Avatar
16 weeks ago
There is a history between Apple and Nvidia. Lot's of bad blood over GPU's led them to AMD prior to Apple Silicon. If senior leaders are still around who lived through that it may have affected the choice. Speculation obviously, but one supported by history.
Score: 25 Votes (Like | Disagree)
bigboy29 Avatar
16 weeks ago
Responses here are hilarious.

Apple partners with both Google and Microsoft for various cloud things. What they used (the hardware) has absolutely no bearing on the model or Apple's implementation of the model, no? That's kind of like saying "Apple sucks because they use HP in the data center (vs. Dell for example)".

Apple has an initiative called ACDC (Apple Chips in Data Center) which is how they are creating an infrastructure for AI training using their own (M) silicon.

Tensor Vs. Nvidia is kind of like arguing over the brand of shovel you use to dig a trench. It does not mean that Apple Intelligence is all of a sudden a Google Gemini AI rebranded.
Score: 23 Votes (Like | Disagree)
bLackjackj Avatar
16 weeks ago

So not only was Apple reliant on Google services
Apple IS already reliant on Google services. Where do you think icloud resides?? Of course they are going to chose a partner they are already doing business with. Thats called business sense.
Score: 20 Votes (Like | Disagree)
Contact_Feanor Avatar
16 weeks ago

So while Apple may not have used user attributed data, Google still knows exactly what Apple is doing in AI, exactly how their models perform, and can compare their own AI with Apple's AI since they have both.

Sounds like a win-win for Google, Apple not so much. I wonder how much intellectual property Apple is giving up just to say "We can do that too!"

This sounds like a pretty big failure at the executive level.
This isn't exactly true. Cloud based infrastructure usually has pretty good checks in place to protect customer privacy exactly because of this sort of thing. Microsoft can't/doesn't look at everything that's on azure, amazon doesn't look at everything on their web services exactly for this reason.
Score: 19 Votes (Like | Disagree)
mystery hill Avatar
16 weeks ago

Tensor ... chips that are 2yrs behind the industry standard and using old Samsung Foundry manufacturing processes until next year!
Apple aren’t using phone chips found in the Pixels.

They are using Google’s Cloud TPU v5p.

https://cloud.google.com/blog/products/ai-machine-learning/introducing-cloud-tpu-v5p-and-ai-hypercomputer
Score: 11 Votes (Like | Disagree)
cuiver Avatar
16 weeks ago

What an ABSOLUTE JOKE!

Tensor ... chips that are 2yrs behind the industry standard and using old Samsung Foundry manufacturing processes until next year!

This is a colossal failure of endeavor on Apple's part. The ONLY reason to use Tensor chips in 2024 is simply for being efficient in your code as the SoC is garbage! I'm not just talking out my arse here cause even Samsung's much hated SoC the Exynos 2400 outperforms on ALL measurements and in real world tasks and applications as well.

https://www.gsmarena.com/samsung_galaxy_s24_vs_google_pixel_8_review_battery_camera_price_compared-news-62189.php

Sorry ONLY in video playback minutes the Google Pixel 8 which is the tensor chip Apple supposedly used is 'SLIGHTLY' better by just a few minutes more.
They are using Tensor Processing Units (below), not the mobile SoC named Tensor.
Score: 10 Votes (Like | Disagree)