MacRumors

Apple promised that the WWDC 2024 keynote would be action-packed, and it absolutely was. With new updates like iOS 18 and macOS Sequoia, along with a whole new Apple Intelligence suite of AI features, there were a ton of announcements.

To help out, Apple has shared the nearly three-minute video above highlighting 18 key things that it unveiled during the keynote.

Of course, we'll have our own in-depth coverage of Apple's announcements here at MacRumors, so be sure to follow along to learn more.

Apple today announced that public betas of iOS 18, iPadOS 18, macOS Sequoia, watchOS 11, tvOS 18, and HomePod software version 18 will be available in July.

Apple did not provide a specific release date in July for the public betas, and it appears that visionOS 2 will not be available as a public beta, at least initially.

Anyone can join Apple's public beta testing program for free, allowing them to test out the updates next month without paying for Apple Developer Program membership.

Apple developers can test all of the new updates starting today, including visionOS 2.

Apple today announced that Siri will be able to access ChatGPT directly in iOS 18, iPadOS 18, and macOS Sequoia to provide better responses in relevant situations.

‌Siri‌ will determine if queries may be useful to forward to ChatGPT, and asks the user for permission to share. This enables ‌Siri‌ to leverage ChatGPT's image- and text-understanding capabilities with no need to jump between tools. Users can ask questions related to text, documents, photos, PDFs, and more.

ChatGPT will also be available in Apple's new systemwide Writing Tools to help users generate content for anything they're writing about. With Compose, users can similarly access ChatGPT image tools to generate images in a range of styles to compliment their writing.

‌Siri‌ will leverage GPT-4o for free, with no need to create an account. Requests are not logged and IP addresses are obscured. ChatGPT subscribers will also be able to access paid features within the experiences.

As part of Apple Intelligence, Apple has unveiled a new Image Playground feature that allows users to create generative images on the fly using a range of concepts like themes, costumes, accessories, places, and more.

With Image Playground, users can quickly create playful images, choosing from three styles: Animation, Illustration, or Sketch. Image Playground is straightforward to use, built into apps like Messages, and also available as a standalone app.

Previews are created on-device, and your generative images are accessible in Messages, Pages, Freeform, and even a dedicated Image Playground app. The feature is part of "Apple Intelligence," a deeply integrated, personalized AI experience for Apple devices that uses cutting-edge generative artificial intelligence to enhance user experiences across iPhone, iPad, and Mac.

One of the new Apple Intelligence features coming to the iPhone with iOS 18 is Genmoji, which allows you to instantly create your own custom emoji.

AI-generated emoji can be created with text prompts like "smiley relaxing wearing cucumbers" or "t-rex wearing a tutu on a surfboard."

Just like emoji, Apple says Genmoji can be added to messages, shared as a sticker, or used as a Tapback reaction in the Messages app.

Apple Intelligence features are not included in the first beta of iOS 18, and instead will become available for testing over the U.S. summer.

iOS 18 should be publicly released in September.

Apple at WWDC today announced Apple Intelligence, a deeply integrated, personalized AI experience for Apple devices that uses cutting-edge generative artificial intelligence to enhance user experiences across iPhone, iPad, and Mac.

Apple says that Apple Intelligence "combines the power of generative models with personal context to deliver intelligence that's incredibly useful and relevant." Baked into iOS 18, iPadOS 18, and macOS Sequoia, it can create language and images, take action across apps, and draw from personal context to simplify and accelerate everyday tasks. And with Private Cloud Compute, Apple is focused on delivering AI based on privacy, with the ability to flex and scale computational capacity between on-device processing and larger, server-based models that run on dedicated Apple silicon servers.

"We're thrilled to introduce a new chapter in Apple innovation. Apple Intelligence will transform what users can do with our products — and what our products can do for our users," said Tim Cook, Apple’s CEO. "Our unique approach combines generative AI with a user's personal context to deliver truly helpful intelligence. And it can access that information in a completely private and secure way to help users do the things that matter most to them. This is AI as only Apple can deliver it, and we can't wait for users to experience what it can do."

Top of the features list are new ways for users to enhance their writing and communicate more effectively. Apple says that with brand-new systemwide Writing Tools built into ‌iOS 18‌, ‌iPadOS 18‌, and ‌macOS Sequoia‌, users can rewrite, proofread, and summarize text nearly everywhere they write, including Mail, Notes, Pages, and third-party apps.

For example, with Rewrite, Apple Intelligence allows users to choose from different versions of what they have written, and then adjust the tone "to suit the audience and task at hand." According to Apple, the Rewrite feature helps users deliver the right words to meet the occasion, whether that's finessing a cover letter, or adding humor and creativity to a party invitation. A new Proofread option checks grammar, word choice, and sentence structure while also suggesting edits — along with explanations of the edits — that users can review or quickly accept. And with Summarize, users can select text and have it recapped in the form of a digestible paragraph, bulleted key points, a table, or a list.

In Mail, a new section at the top of the inbox called Priority Messages shows your most urgent emails, like a same-day dinner invitation or boarding pass. But instead of previewing the first few lines of each email, you can see summaries without needing to open a message. Meanwhile, for long threads, you can view pertinent details with a tap. There's also a Smart Reply feature that offers suggestions for a quick response. The feature also identifies questions in an email to ensure everything is answered, according to Apple.

Elsewhere, a new Priority Notifications feature surfaces alerts at the top of the stack to show what's most important to you, and summaries help you scan long or stacked notifications to show key details right on the Lock Screen, such as when a group chat is particularly active. To help users stay present in what they are doing, there's also a new Focus called Reduce Interruptions that surfaces only the notifications that might need immediate attention, like a text about an early pickup from daycare.

In the Notes and Phone apps, Apple Intelligence allows users to record, transcribe, and summarize audio. When a recording is initiated while on a call, participants are automatically notified, and once the call ends, Apple Intelligence generates a summary to help recall key points. A new Image Playground feature also allows users to choose from a range of concepts from categories like themes, costumes, accessories, and places to create their own images for sharing in Messages, Notes, Keynote, Freeform, and Pages, and third-party apps that support the new Image Playground API.

Taking emoji to new places, users can also create an original Genmoji to express themselves. By simply typing a description, their Genmoji appears, along with additional options. Users can also create Genmoji of friends and family based on their photos. Just like emoji, Genmoji can be added inline to messages, or shared as a sticker or reaction in a Tapback.

Switching to the Photos app, natural language can be used to search for specific photos, such as "Maya skateboarding in a tie-dye shirt," or "Katie with stickers on her face." Search in videos also becomes more powerful with the ability to find specific moments in clips so users can go right to the relevant segment. Additionally, the new Clean Up tool can identify and remove distracting objects in the background of a photo, without accidentally altering the subject, according to Apple.

With Memories, users can create the story they want to see by simply typing a description. Using language and image understanding, Apple Intelligence will pick out the best photos and videos based on the description, craft a storyline with chapters based on themes identified from the photos, and arrange them into a movie with its own narrative arc. Users will even get song suggestions to match their memory from Apple Music. As with all Apple Intelligence features, user photos and videos are kept private on device and are not shared with Apple or anyone else.

Apple is also emphasizing cross-platform enhancements to Siri, which is said to be "more natural, more contextually relevant, and more personal, with the ability to simplify and accelerate everyday tasks." For example, it can follow along if users stumble over words and maintain context from one request to the next. Additionally, users can type to ‌Siri‌, and switch between text and voice to communicate with ‌Siri‌ however they like. ‌Siri‌ also has a brand-new design, suggestive of its new capabilities, with a glowing light that wraps around the edge of the screen when ‌Siri‌ is active.

‌Siri‌ can answer queries about how to do something on ‌iPhone‌, ‌iPad‌, and Mac, and with onscreen awareness, ‌Siri‌ will be able to understand and take action with users' content in more apps over time, according to Apple. For example, if a friend texts a user their new address in Messages, the receiver can say, "Add this address to his contact card," and ‌Siri‌ will do just that. Similar actions will extend across Apple and third-party apps.

Siri will be able to deliver intelligence that’s tailored to the user and their on-device information. For example, a user can say, “Play that podcast that Jamie recommended,” and Siri will locate and play the episode, without the user having to remember whether it was mentioned in a text or an email. Or they could ask, “When is Mom’s flight landing?” and Siri will find the flight details and cross-reference them with real-time flight tracking to give an arrival time.

Thanks to on-device processing, Apple says its AI features are aware of your personal data without collecting your data. And when it needs more compute capacity, it sends only the data needed to fulfill the request to Apple's Private Cloud Compute servers, which share the same privacy and security capabilities of your ‌iPhone‌, according to Apple.

To verify privacy, Apple says that independent experts can inspect the code that runs on Apple silicon servers, and Private Cloud Compute cryptographically ensures that ‌iPhone‌, ‌iPad‌, and Mac do not talk to a server unless its software has been publicly logged for inspection. "Apple Intelligence with Private Cloud Compute sets a new standard for privacy in AI, unlocking intelligence users can trust," says Apple.

Apple is integrating ChatGPT access into experiences within ‌iOS 18‌, ‌iPadOS 18‌, and ‌macOS Sequoia‌, allowing users to access its expertise — as well as its image- and document-understanding capabilities — without needing to jump between tools. Apple says users are asked before any questions are sent to ChatGPT, along with any documents or photos, and ‌Siri‌ then presents the answer directly.

Additionally, ChatGPT will be available in Apple's systemwide Writing Tools to help users generate content for anything they are writing about. For example, with Compose, users will also be able to access ChatGPT image tools to generate images in a variety of styles to complement what they are writing.

Apple says that ChatGPT will come to ‌iOS 18‌, ‌iPadOS 18‌, and ‌macOS Sequoia‌ later this year, powered by GPT-4o. Users can access it for free without creating an account, and ChatGPT subscribers can connect their accounts and access paid features right from these experiences.

Apple today announced that tvOS 18 is gaining a feature called "InSight," which helps you find more information about all of the actors and songs in the current Apple TV+ show or movie you're watching. InSight will only be available on ‌Apple TV‌+ content.

Apple said that InSight is connected to your Apple Music account. This way, if you hear a song you like in an ‌Apple TV‌+ show, you can use InSight to find out what it is, and immediately add it to your ‌Apple Music‌ library.

Additionally, tvOS 18 is getting a smarter "Enhance Dialogue" feature for TV speakers and receivers, AirPods, and other Bluetooth devices. This feature uses machine learning to give greater vocal clarity to voices in shows and movies.

A few other new tvOS additions include:

• Subtitles will automatically appear if you mute the volume or go back a few seconds
• Adding support for the 21:9 format for projectors on ‌Apple TV‌
• Redesigned Apple Fitness+ experience
• New Portraits category for screen savers
• New TV+ shows and movies category for screen savers
• New Snoopy screen saver

These new features will be coming to tvOS 18 later in 2024.

Apple at WWDC today announced macOS 15 Sequoia, the next version of its Mac operating system featuring several new AI capabilities also announced for iPhone with iOS 18, in addition to a new Password app, a major Safari update, and a new Continuity feature called ‌iPhone‌ Mirroring.

At the heart of the new AI features is "Apple Intelligence," which Apple says is a deeply integrated, personalized AI experience for Apple devices that uses cutting-edge generative artificial intelligence to enhance user experiences across ‌iPhone‌, iPad, and Mac.

According to Apple, the service "combines the power of generative models with personal context to deliver intelligence that's incredibly useful and relevant." Apple Intelligence "understands and creates language and images, takes action across apps, and draws from personal context, simplifying and accelerating everyday tasks."

“The all-star combination of the power of Apple silicon and the legendary ease of use of macOS have made the Mac more capable than ever. Today, we’re excited to take macOS to new heights with macOS Sequoia, a big release that elevates productivity and intelligence,” said Craig Federighi, Apple’s senior vice president of Software Engineering. “‌macOS Sequoia‌ ushers in Apple Intelligence, unlocking incredible new features that will be a game changer for working on Mac. And with more ways to help users effortlessly get things done, new Continuity features like ‌iPhone‌ Mirroring, major updates to Safari, and a host of new games, we think Mac users are going to love it.”

As part of the new AI features, Image Playground lets users can create playful images in seconds, choosing from three styles: Animation, Illustration, or Sketch. Image Playground is designed to be easy to use, and comes built right into apps like Messages, and is also available in a dedicated app.

‌macOS Sequoia‌ includes a new Continuity feature called ‌iPhone‌ Mirroring that allows you to view and control your ‌iPhone‌ right from your Mac. According to Apple, "a user's custom wallpaper and icons appear just like on their ‌iPhone‌, and they can swipe between pages on their Home Screen, or launch and browse any of their favorite apps." Not only that, but also the keyboard, trackpad, and mouse on Mac let you interact with your ‌iPhone‌, and audio even comes through.

Your ‌iPhone‌ on your Mac shows everything, including icons, the ‌Home Screen‌, apps, and more. Any app can be opened, and all the while, your ‌iPhone‌ can stay locked, so nobody else can access it. You can even drag and drop items and files from your Mac to your ‌iPhone‌ seamlessly. macOS 15 also brings ‌iPhone‌ notifications to Mac, where they appear alongside Mac notifications and can be responded to.

Meanwhile, Safari now offers Highlights, which Apple describes as "an even easier way to discover information on the web, such as directions, summaries, or quick links to learn more about people, music, movies, and TV shows." Reader mode has been redesigned, and now includes a streamlined view of the article, a summary, and a table of contents for longer articles."

In addition, macOS now automatically sizes windows to tile them and fill up the screen, utilizing maximum screen real estate. Drag a window to the edge of the screen, and ‌macOS Sequoia‌ automatically suggests a tiled position on your desktop. There are also new keyboard and menu shortcuts designed to better organize tiles.

The Presenter preview feature has also received an update, with new keyboard and menu shortcuts to help users organize tiles. Users can also add built-in backgrounds, including color gradients and system wallpapers, or upload their own photos. Background replacements can also be applied during a video call in FaceTime or in third-party apps like Webex.

macOS 15 also includes a new dedicated Passwords app, allowing you to manage Wi-Fi passwords, app and website passwords, verification codes, and more. Passwords sync across devices, and macOS uses autofill to populate passwords in the Passwords app. The Passwords app is also available on Windows, thanks to the iCloud for Windows app.

Apple is also highlighting Memories in Photos, which it says lets users create the stories they want to see "just by typing a description." Apple Intelligence picks out the best photos and videos based on the description, crafts a storyline with chapters based on themes identified from the photos, and arranges them into a movie with its own narrative arc. There's also a new Clean Up tool that can "identify and remove distracting objects in the background of a photo — without accidentally altering the subject."

Other features include: Updates to Messages, which has all-new text effects, emoji and sticker Tapbacks, and the ability to schedule a message to send later; hike and trail routes in Maps, Collections in the ‌Photos‌ app, smarter Notes, and better Calendar / Reminder integration. macOS 15 Sequoia will be released to the public in the fall.

Apple at WWDC today announced a new Calculator app as part of iPadOS 18 that features special Apple Pencil support and a new Math Notes feature.

Apple says the Math Notes calculator allows users to type or write out mathematical expressions and see them instantly solved in their own handwriting. It's also possible to assign values to variables when learning new concepts in class, calculating a budget, and more.

With a new graphing feature, users can write or type an equation and insert a graph with just one tap, and can even add multiple equations on the same graph to see how they relate, according to Apple. Math Notes are also automatically accessible in the Notes app in a new Math Notes folder.

Basic and scientific calculators are included in the iPad app that are designed to make it easy to view complete expressions before completing them. Meanwhile, a History feature helps users keep track of previous calculations, and unit conversions let users quickly convert length, weight, currencies, and more.

The first developer beta of ‌iPadOS 18‌ is available starting today, with a public beta following in July, and official release to the public in the fall.

Apple today previewed iPadOS 18, a major update to the operating system for the iPad that introduces a new Calendar app, a redesigned systemwide tab bar, and more.

‌iPadOS 18‌ brings over many of the new features and improvements introduced in iOS 18 to the ‌iPad‌ such as the redesigned Photos app and new Home Screen customization tools.

In ‌iPadOS 18‌, a new floating tab bar morphs into the navigation sidebar. The tab bar is also customizable to keep favourites within easy reach. It is available across the system. There is also a new document browser in Pages, Numbers, and Keynote.

‌iPadOS 18‌ also brings the Calculator app to the ‌iPad‌ for the first time, with new features like history and unit conversions. Math notes allows users to solve expressions when writing with the Apple Pencil.

Math notes enable users to hand-write expressions and automatically calculate the answer, displaying it in handwriting that's like their own. Users can use basic or scientific math, and notes can be saved for later. Variables are supported, allowing you to solve algebraic equations. They can be edited to see results change in real time, and even generate a graph.

Notes has the same math capabilities from Calculator. Notes also gains new Smart Script capabilities that automatically improve your handwriting as you write.

SharePlay now allows users to tap and draw on the screen when sharing, and you can remotely control someone else's ‌iPad‌ or iPhone.

‌iPadOS 18‌ also includes refined animations across the UI, making them feel even more responsive. There are new APIs for developers to integrate these animations.

The first developer beta of ‌iPadOS 18‌ is available starting today, with a public beta following in July, and official release to the public in the fall.

Apple today previewed watchOS 11, the next major software update for the Apple Watch that introduces several new health and workout features.

Activity Rings can now be adjusted by day of the week and paused for a rest day, allowing users to keep their award streak going. Users can set workouts to alert a friend that they have been safely completed, such as a late-night run.

‌watchOS 11‌ includes a new "training load" feature, helping users to track intensity over time. A new algorithm uses heart rate, altitude, workout duration, and age and weight data to give a calculation of your estimated effort rating and training load.

A new Vitals app provides an overview of daily health, comparing daily health statistics to historical data and highlighting when health data is outside your typical range. If multiple metrics are out of range, you will receive a tailored message to see how they could be affecting you.

Cycle tracking now shows estimates of gestational age, showing pregnancy across charts to review metrics like high heart rate notification thresholds.

Widgets will be automatically added to the Smart Stack. For example, the Translate app will show automatically when you go to a different country and the Weather app will show up when rain is imminent. ‌watchOS 11‌ also brings Live Activities to the Apple Watch for the first time.

An improved Photos watch face gives users more control and uses machine learning to automatically crop photos. The update also brings the Translate app to the Apple Watch.

The first developer beta of ‌watchOS 11‌ is available starting today, with a public beta following in July, and official release to the public in the fall.

Apple at WWDC has announced iOS 18, which includes an overhauled Control Center interface with new customization features and the ability to add multiple control screens.

In ‌iOS 18‌, Control Center has been redesigned to provide easier access to many of the things users do every day, and it gets new levels of customization and flexibility.

The redesign delivers quick access to new groups of a user's most-utilized controls, such as media playback, Home controls, and connectivity, as well as the ability to easily swipe between each.

In ‌iOS 18‌, when you invoke Control Center with a swipe down from the top-right of your iPhone's screen, you can continuously swipe to get to more control center screens. There's a new controls gallery that lets you customize the controls you see, and you can change the size of buttons to emphasize priority. Additionally, developers can include controls from their own apps, enabling quick access to controls like remotely starting a car, for example.

The new Controls API from Apple also allows you to switch up the controls on your ‌iPhone‌'s lock screen, so you can replace the traditional flashlight and camera buttons with something more convenient to you. And if you have an iPhone 15 Pro, you can also assign Control Center buttons to the physical Action button.

Apple today announced a few new features coming to AirPods Pro later this year, centering on a new ability to use head gestures in order to control the ‌AirPods Pro‌. With this feature, you can nod your head up and down, or shake it left to right, in order to answer or decline a call.

In addition to interacting with a phone call, users will be able to use Siri Interactions to respond to messages, manage notifications, and more.

There's also a new Voice Isolation feature coming to ‌AirPods Pro‌ that removes loud background noise around you, so that the person on the other end of a call can hear you clearly. Apple also said personalized spatial audio is expanding to gaming on tvOS this year.

Finally, AirPods users will gain access to a Personalized Spatial Audio feature with dynamic head tracking that boosts gaming experiences on connected Apple devices. This will be available on AirPods 3, ‌AirPods Pro‌, and AirPods Max.

Apple said that all of these features will arrive this fall.

Apple today previewed new features coming to the Messages app with iOS 18, and this finally includes bold, italics, underline, and strikeout formatting options.

iMessage has also gained all-new text effects that can be applied to individual words in a message to give them a "dynamic, animated" appearance. These effects include Big, Small, Shake, Nod, Explode, Ripple, Bloom, and Jitter.

Other new Messages app features on iOS 18 include upcoming RCS support for improved texting with Android users, an option to schedule messages to be sent later, the ability to use any emoji as a Tapback, the ability to send messages via satellite connection when Wi-Fi and cellular networks are unavailable, and more.

The first developer beta of iOS 18 is available now, and a public beta will follow in July. The update should be widely released in September.

Apple announced iOS 18 today with two notable changes for the Home Screen: the ability to place app icons anywhere, and a dark tint option for app icons.

iPhone users can now place app icons anywhere on the Home Screen, although they still must conform to an invisible grid. In other words, Apple now allows blank spaces, rows, and columns between app icons, which can reveal more of the wallpaper.

App icons can now have a dark or tinted appearance, with many color options available. Icons can be manually set to appear in dark or light mode, or they can automatically switch based on whether Dark Mode is turned on or off on the iPhone.

MacRumors was first to report about the ability to place app icons anywhere on the Home Screen, and the darker tint option, prior to WWDC.

Read our iOS 18 announcement coverage for more details about the update, which is now available in beta for members of the Apple Developer Program.

Apple today previewed iOS 18, the next major update to the operating system for the iPhone, with new customization features, a redesigned Photos app, and more.

iOS 18 features new customization tools for the Home Screen. App icons now feature Dark Mode and users can tint them with a color to create a unique look. Apps can also now be placed anywhere on the ‌Home Screen‌ freely.

The Control Center is redesigned and highly customizable with a new gallery. Developers can provide tools for their apps in the Control Center. Users can continuously swipe to access other Control Center screens. Lock Screen controls are also customizable.

In Messages, tapbacks have been redesigned and users can now react with any emoji. Users can also schedule messages to send later, as well as format text with bold, italicization, underlining, and strikethrough. New text effects provide ways to emphasize words and phrases with automatic suggestions. Users can also now send and receive messages with satellite connectivity.

In Mail, emails are automatically sorted into categories to help prioritize messages. There are also new topographical maps with trail networks and hiking routes in the Maps app. In Wallet, a new Tap to Cash feature sends cash by holding iPhones together.

The ‌Photos‌ app is completely redesigned in ‌iOS 18‌. The app has been unified into a single view, with a photo grid at the top that views the entire library and collections organized by theme below. Users can use Months and Years views at the bottom, and there's a filter button that allows you to hide screenshots and sort in other ways.

The space below the grid includes Collections with the ability to browse by topics like Time, People, Memories, Trips, and more. Recent Days shows photos from the past few days, with things like photos of receipts filtered out automatically. People and Pets now gathers photos of groups of people and collections can be reordered or pinned. Swipe right from the grid and you'll see a new carousel with Featured ‌Photos‌ and other favorite collections. It automatically refreshes to surface new images.

Users can now Lock apps with authentication, simultaneously hiding information from Search and Siri. ‌iOS 18‌ also includes a new way to connect accessories more seamlessly.

‌iOS 18‌ brings RCS messaging support to the ‌iPhone‌, larger ‌Home Screen‌ icons, and Reminders integration in calendar.

Game Mode also comes to the ‌iPhone‌ for the first time, minimizing background activity to keep frame rates high, plus more responsive connections to AirPods and wireless game controllers.

The first developer beta of ‌iOS 18‌ is available starting today, with a public beta following in July, and official release to the public in the fall.

Apple today announced that the Vision Pro headset will be available in eight additional countries over the coming weeks.

The headset is launching in China, Japan, and Singapore on June 28, followed by Australia, Canada, France, Germany, and the UK on July 12.

Pre-orders start June 13 in the first wave of countries, and on June 28 in the second:

Apple today announced Apple Vision Pro will expand to new countries and regions, with pre-orders for China mainland, Hong Kong, Japan, and Singapore beginning this Thursday, June 13, at 6 p.m. PT and availability beginning Friday, June 28. Customers in Australia, Canada, France, Germany, and the United Kingdom can pre-order Vision Pro beginning Friday, June 28, at 5 a.m. PT, with availability beginning Friday, July 12.

visionOS 1.2 adds support for languages in these countries and regions.

Apple first launched the Vision Pro in the U.S. in early February, with the spatial computing headset starting at a costly $3,499 there.

visionOS 2 includes a range of new features and changes, such as a redesigned Photos app with SharePlay support, the ability to turn existing 2D photos into spatial photos with machine learning, new hand gestures for frequently used features like Home View and Control Center, a larger ultra-wide version of Mac Virtual Display that is equivalent to two 4K monitors side by side, support for a physical mouse, and more.

Apple today announced visionOS 2, the first major update to the Vision Pro's operating system. The first visionOS 2 beta is now available for Apple Developer Program members, and the update will be released to the public later this year.

visionOS 2 includes a range of new features and changes, such as a redesigned Photos app with SharePlay support, the ability to turn existing 2D photos into spatial photos with machine learning, new hand gestures for frequently used features like Home View and Control Center, a larger ultra-wide version of Mac Virtual Display that is equivalent to two 4K monitors side by side, and support for a physical mouse.

visionOS 2 also adds a basic feature that was missing on the Vision Pro at launch: the ability to rearrange apps and place them wherever you want.

Travel Mode gains support for trains on visionOS 2, while the Guest User option can now save a guest's eye and hand data for 30 days.

visionOS 2 includes new APIs and frameworks for developers of Vision Pro apps, such as HealthKit for health data and TabletopKit for tabletop games.

Apple's press release outlined some additional visionOS 2 features, such as AirPlay receiving mode and systemwide Live Captions:

- While in Safari, users can watch videos in an Environment, including on popular sites such as YouTube, Netflix, and Amazon. While scrolling through webpages, users can tap on panoramic photos and immerse themselves as the image wraps around them. Siri can also read and speak the content of a webpage while users multitask.
- The Apple TV app brings support for multiview to Apple Vision Pro for the ultimate sports-viewing experience. Later this year, fans will be able to watch up to five simultaneous streams so they can keep track of all their favorite sports and teams.
- To help users achieve calm and focus, the Mindfulness app includes a new capability called Follow Your Breathing that presents dynamic visual animations and sounds that respond to the user’s breathing patterns.
- Systemwide Live Captions help everyone — including users who are deaf or hard of hearing — follow along with spoken dialogue in live conversations and in audio from apps.
- Users can view content on their Vision Pro with AirPlay from their iPhone, iPad, or Mac.

Apple also announced that the Vision Pro will be launching in eight additional countries by mid-July, including Australia, Canada, France, Germany, the UK, China, Japan, and Singapore. The headset first launched in the U.S. in February.