Ollama Now Runs Faster on Macs Thanks to Apple's MLX Framework - MacRumors
Skip to Content

Ollama Now Runs Faster on Macs Thanks to Apple's MLX Framework

Ollama, the popular app for running AI models locally on a computer, has released an update that takes advantage of Apple's own machine learning framework, MLX. The result is a hefty speed boost on Macs with Apple silicon.

ollama logo mac
According to Ollama, the new version processes prompts around 1.6 times faster (prefill speed) and nearly doubles the speed at which it generates responses (decode speed). Macs with M5-series chips are said to see the largest improvements, thanks to Apple's new GPU Neural Accelerators.

The update also includes smarter memory management, which should make AI-powered coding tools and chat assistants feel noticeably more responsive during extended use.

Ollama says the new performance boost should especially benefit macOS users who run personal assistants like OpenClaw or coding agents like Claude Code, OpenCode, or Codex.

The preview release is available to download as Ollama 0.19 – just make sure you have a Mac with more than 32GB of unified memory to run it. Support is currently limited to Alibaba's Qwen3.5, but Ollama says support for more AI models is planned.

Popular Stories

iPhone Duo Outer Display Hand

Apple Aiming to Upgrade the iPhone Duo in Four Ways

Sunday November 15, 2026 8:42 am PST by
Bloomberg's Mark Gurman today said Apple has four goals for future iPhone Duo models: Face ID, an Action button, a telephoto camera, and a thinner-and-lighter design. Gurman said Apple has already developed iPhone Duo 2 prototypes with Face ID on the outer display, but it is "running out of time" to finalize the feature for that model, so it might not arrive until the iPhone Duo...
Apple Health AI Study App Feature

Apple Just Released a New App

Monday November 16, 2026 9:43 am PST by
Apple today launched a new research study in the U.S. to explore the use of AI for health, and it has released a dedicated iPhone app for participants. In a press release, Apple said the study and app are "designed to advance the understanding of how people interact with conversational health AI tools." The Apple Health AI Study App contains a generative AI chatbot that participants can...
iphone duo yellow hand

Apple Adds Facial Unlock Option on iPhone Duo in iOS 27.3

Monday November 16, 2026 10:17 am PST by
Apple today added a new option for unlocking the iPhone Duo using the front-facing camera, giving device users multiple ways to access their content. The feature is available in the second iOS 27.3 beta. The option to unlock with facial recognition is only available on the Lock Screen, and authentication via Touch ID is still needed for Apple Pay purchases, adding passwords and logins, and...

Top Rated Comments

8 months ago

This is going to be some serious cash flow incoming for Apple in this year.
I think this could be a major business for Apple - it’s way cheaper for a small business to buy a powerful Mac and run qwen 3.5 than pay for an enterprise license for a frontier model - and you don’t need to worry about privacy issues.
Score: 11 Votes (Like | Disagree)
8 months ago
On device is definitely gonna be the future.

I can’t help but wonder if Apple looked ahead and foresaw this when developing the M series, or if they’ve lucked into it.
Score: 10 Votes (Like | Disagree)
Justin Cymbal Avatar
8 months ago
M-Series chips at work😎
Score: 7 Votes (Like | Disagree)
8 months ago
As someone who downloads and experiments with everything possible…

There is a lot of delusion in this thread. Local language models below 100 billion parameters are quite useless. Even 100 billion parameters is considered the weak side. Fun to play with for a while but boredom and frustration sets in quickly.

So what happens is they want the next model…and then the next one…and then the next one…falsely believing their 16GB or 32GB machine will one day have the holy grail of small and powerful local language model.

But it doesn’t happen. The models keep growing and aside from being memory hungry the most important thing that makes them useable is memory bandwidth.

The top 5 language models in the world are all over a trillion parameters and what makes them useful and responsive is that they respond quickly and have GPU with over a terabyte of bandwidth.
Score: 6 Votes (Like | Disagree)
Kirkster Avatar
8 months ago
They are so far behind LM Studio. And only support for one model?
Score: 6 Votes (Like | Disagree)
8 months ago
This is going to be some serious cash flow incoming for Apple in this year.
Score: 6 Votes (Like | Disagree)
Latest Stories
iPhone 20 Pro Rumored to Return to Titanium
iPhone 20 Pro Rumored to Return to Titanium
27 minutes ago
Target's Early Black Friday Event Offers Savings on Apple, TVs, and Accessories
Target's Early Black Friday Event Offers Savings on Apple, TVs, and Accessories
2 hours ago
Apple Announces 2026 App Store Award Finalists
Apple Announces 2026 App Store Award Finalists
3 hours ago
Amazon Offering $100 Off Nearly All M4 iPad Air Models
Amazon Offering $100 Off Nearly All M4 iPad Air Models
3 hours ago
iPhone Duo 2 Likely to Retain Touch ID as Face ID Remains Uncertain
iPhone Duo 2 Likely to Retain Touch ID as Face ID Remains Uncertain
3 hours ago
Apple Releases Firmware Update for New Siri Remote
Apple Releases Firmware Update for New Siri Remote
3 hours ago
Amazon Takes $850 Off 2026 16-Inch MacBook Pro With M5 Max Chip
Amazon Takes $850 Off 2026 16-Inch MacBook Pro With M5 Max Chip
4 hours ago
WhatsApp's iCloud Backup Alternative Rolls Out to Beta Users on iPhone
WhatsApp's iCloud Backup Alternative Rolls Out to Beta Users on iPhone
4 hours ago
MacPaw's Moonlock Cybersecurity App Launches for iPhone
MacPaw's Moonlock Cybersecurity App Launches for iPhone
5 hours ago
Apple Reportedly Developing Two Designs for 20th Anniversary iPhone
Apple Reportedly Developing Two Designs for 20th Anniversary iPhone
5 hours ago
Apple Rolls Out All-New Maps Experience Across India
Apple Rolls Out All-New Maps Experience Across India
5 hours ago
iPhone Air 2 Reportedly Sticks With Same Display
iPhone Air 2 Reportedly Sticks With Same Display
6 hours ago
iPhone 18 and iPhone Air 2 Display Production to Begin Soon Ahead of Expected March Launch
iPhone 18 and iPhone Air 2 Display Production to Begin Soon Ahead of Expected March Launch
6 hours ago
Aqara Debuts Six Matter Smart Lights That Work With Apple Home
Aqara Debuts Six Matter Smart Lights That Work With Apple Home
17 hours ago
Disney+ and Hulu Will Fully Merge Into One App in December
Disney+ and Hulu Will Fully Merge Into One App in December
18 hours ago
iFixit Says Apple's HomeView is Unnecessarily Hard to Repair
iFixit Says Apple's HomeView is Unnecessarily Hard to Repair
20 hours ago
Final Cut Pro Now Includes MotionVFX for Creator Studio Users
Final Cut Pro Now Includes MotionVFX for Creator Studio Users
21 hours ago
Apple Blames Internal Update for Outage, Says It Wasn't a Cyberattack
Apple Blames Internal Update for Outage, Says It Wasn't a Cyberattack
22 hours ago
Nomad Launches Black Friday Sale With Up to 30% Off Apple Accessories
Nomad Launches Black Friday Sale With Up to 30% Off Apple Accessories
23 hours ago
Google Wallet Available on iPhone, But Without Tap to Pay
Google Wallet Available on iPhone, But Without Tap to Pay
23 hours ago
Apple Accounts, App Store and Apple Music Experiencing Issues
Apple Accounts, App Store and Apple Music Experiencing Issues
1 day ago
Apple Moves Ahead With Better Dual SIM Support for Apps
Apple Moves Ahead With Better Dual SIM Support for Apps
1 day ago
Former Apple Chairman Plans to Sell $32 Million in Apple Stock
Former Apple Chairman Plans to Sell $32 Million in Apple Stock
1 day ago
Apple Accused of Silencing iPhone Duo Supplier Over 'Crackgate' Issue
Apple Accused of Silencing iPhone Duo Supplier Over 'Crackgate' Issue
1 day ago
Apple Store App Now Optimized for iPhone Duo
Apple Store App Now Optimized for iPhone Duo
1 day ago
Apple Says iCloud+ Plans Will Not Include Increased Siri AI Usage in UK
Apple Says iCloud+ Plans Will Not Include Increased Siri AI Usage in UK
1 day ago
Amazon Offering Early Black Friday Discounts on TVs, Headphones, and Charging Devices
Amazon Offering Early Black Friday Discounts on TVs, Headphones, and Charging Devices
1 day ago
Apple Now Sells DIY Repair Parts for iPhone Duo
Apple Now Sells DIY Repair Parts for iPhone Duo
1 day ago
iPhone 20 Pro Screen Protectors Show Rumored Curved Design
iPhone 20 Pro Screen Protectors Show Rumored Curved Design
1 day ago
MacBook Neo Black Friday Deals Arrive With $49 Discounts on Nearly Every Model at Amazon
MacBook Neo Black Friday Deals Arrive With $49 Discounts on Nearly Every Model at Amazon
1 day ago