Apple Vision Pro 'Visual Search' Feature Can Identify Items, Copy Printed Text, Translate and More
The Apple Vision Pro headset's visionOS operating system includes a feature called "Visual Search," which sounds like it is similar to the Visual Look Up feature on the iPhone and the iPad.
With Visual Search, users can use the Vision Pro headset to get information about an item, detect and interact with text in the world around them, copy and paste printed text from the real world into apps, translate text between 17 different languages, and more.
Real world text that includes contact information, webpages, and unit conversions and similar information can be acted upon in visionOS. So, for example, if a printed handout has a website link in it, you can scan the link with the Vision Pro, opening up a Safari window to view the website. Or, if a recipe calls for grams and you need ounces, you can convert using the headset.
Real-time text translation will also be useful for traveling and other instances when you might want to quickly translate what you're seeing in the real world. The Apple Vision Pro headset will be able to automatically detect text and documents, similar to how the iPhone can detect text in photos and allow it to be interacted with.
The Visual Search function was found in visionOS by Steve Moser. visionOS can be accessed through the latest Xcode beta at the moment, as Apple released the first version of the software earlier today.
Popular Stories
Apple today introduced the iPhone 16e, its newest entry-level smartphone. The device succeeds the third-generation iPhone SE, which has now been discontinued.
The iPhone 16e features a larger 6.1-inch OLED display, up from a 4.7-inch LCD on the iPhone SE. The display has a notch for Face ID, and this means that Apple no longer sells any iPhones with a Touch ID fingerprint button, marking the ...
Over the years, Apple has switched from an aluminum frame to a stainless steel frame to a titanium frame for its highest-end iPhones. And now, it has been rumored that Apple will go back to using aluminum for three out of four iPhone 17 models.
In an investor note with research firm GF Securities, obtained by MacRumors this week, Apple supply chain analyst Jeff Pu said the iPhone 17, iPhone...
Now that Apple has announced its new more affordable iPhone 16e, our thoughts turn to what else we are expecting from the company this spring.
There are three product categories that we are definitely expecting to get upgraded before spring has ended. Keep reading to learn what they are. If we're lucky, Apple might make a surprise announcement about a completely new product category.
M4...
Wednesday February 19, 2025 11:38 am PST by
Juli CloverFollowing the launch of the iPhone 16e, Apple updated its iOS 18, iPadOS 18, and macOS Sequoia pages to give a narrower timeline on when the next updates are set to launch.
All three pages now state that new Apple Intelligence features and languages will launch in early April, an update from the more broader April timeframe that Apple provided before. The next major point updates will be iOS ...
In a social media post today, Apple CEO Tim Cook teased an upcoming "launch" of some kind scheduled for Wednesday, February 19.
"Get ready to meet the newest member of the family," he said, with an #AppleLaunch hashtag.
The post includes a short video with an animated Apple logo inside a circle.
Cook did not provide an exact time for the launch, or share any other specific details, so...
Apple today announced its first custom cellular modem with the name "C1," debuting in the all-new iPhone 16e.
The new modem contributes to the iPhone 16e's power efficiency, giving it the longest battery life of any iPhone with a 6.1-inch display, such as the iPhone 15 and iPhone 16.
Expanding the benefits of Apple silicon, C1 is the first modem designed by Apple and the most...
Apple is permanently closing its retail store at the Northbrook Court shopping mall in the Chicago area. The company confirmed the upcoming closure today in a statement, but it has yet to provide a closing date for the location.
Apple Northbrook opened in 2005, and the store moved to a larger space in the mall in 2017.
Apple confirmed that affected employees will continue to work for the...
