Apple Vision Pro 'Visual Search' Feature Can Identify Items, Copy Printed Text, Translate and More
The Apple Vision Pro headset's visionOS operating system includes a feature called "Visual Search," which sounds like it is similar to the Visual Look Up feature on the iPhone and the iPad.
With Visual Search, users can use the Vision Pro headset to get information about an item, detect and interact with text in the world around them, copy and paste printed text from the real world into apps, translate text between 17 different languages, and more.
Real world text that includes contact information, webpages, and unit conversions and similar information can be acted upon in visionOS. So, for example, if a printed handout has a website link in it, you can scan the link with the Vision Pro, opening up a Safari window to view the website. Or, if a recipe calls for grams and you need ounces, you can convert using the headset.
Real-time text translation will also be useful for traveling and other instances when you might want to quickly translate what you're seeing in the real world. The Apple Vision Pro headset will be able to automatically detect text and documents, similar to how the iPhone can detect text in photos and allow it to be interacted with.
The Visual Search function was found in visionOS by Steve Moser. visionOS can be accessed through the latest Xcode beta at the moment, as Apple released the first version of the software earlier today.
Popular Stories
Bloomberg's Mark Gurman has high expectations for Apple's first foldable iPhone.
In his Power On newsletter today, he said the foldable iPhone will be "the most significant overhaul in the iPhone's history."
"iPhone 4, iPhone 6 and iPhone X were clearly a big deal, but this is a whole new design," he said.
Like Samsung's Galaxy Z Fold 7, the foldable iPhone will reportedly open up like ...
While the iPhone 18 Pro and iPhone 18 Pro Max are not expected to launch for more than five more months, there are already plenty of rumors about the devices.
It was initially reported that the iPhone 18 Pro models would have fully under-screen Face ID, with only a front camera visible in the top-left corner of the screen. However, the latest rumors indicate that only one Face ID component...
Apple offers the iPhone 17 Pro and iPhone 17 Pro Max in just three colors – Silver, Cosmic Orange, and Deep Blue – but notably there's no black option. Last year was the first time Apple's high-end iPhones have not been available with a black or dark gray color option in any way, but those hoping for the return of black this year for the iPhone 18 Pro should look away now....
Popular Stories
Apple today provided developers with the fourth betas of upcoming watchOS 26.4 and visionOS 26.4 betas for testing purposes. The software comes a week after Apple released the third betas.
The software updates are available through the Settings app on each device, and because these are developer betas, a free developer account is required.
watchOS 26.4 adds a new Average Bedtime metric to ...
Apple today seeded the release candidate versions of upcoming watchOS 26.4, tvOS 26.4 and visionOS 26.4 updates for testing purposes. The software comes a week after Apple released the fourth betas. Release candidates are the final updates that will be provided to the public in the near future if no final bugs are discovered.
The software updates are available through the Settings app on...
X-Plane, which is advertised as being the "world's most advanced flight simulator," is coming to Apple's Vision Pro in the next month or so.
The upcoming visionOS 26.4 update adds support for NVIDIA's CloudXR 6.0 platform, and this will enable Vision Pro users to wirelessly stream immersive PC games from NVIDIA RTX-powered servers via Wi-Fi, including the flight simulator X-Plane 12. Accordin...
