Apple Vision Pro 'Visual Search' Feature Can Identify Items, Copy Printed Text, Translate and More
The Apple Vision Pro headset's visionOS operating system includes a feature called "Visual Search," which sounds like it is similar to the Visual Look Up feature on the iPhone and the iPad.
With Visual Search, users can use the Vision Pro headset to get information about an item, detect and interact with text in the world around them, copy and paste printed text from the real world into apps, translate text between 17 different languages, and more.
Real world text that includes contact information, webpages, and unit conversions and similar information can be acted upon in visionOS. So, for example, if a printed handout has a website link in it, you can scan the link with the Vision Pro, opening up a Safari window to view the website. Or, if a recipe calls for grams and you need ounces, you can convert using the headset.
Real-time text translation will also be useful for traveling and other instances when you might want to quickly translate what you're seeing in the real world. The Apple Vision Pro headset will be able to automatically detect text and documents, similar to how the iPhone can detect text in photos and allow it to be interacted with.
The Visual Search function was found in visionOS by Steve Moser. visionOS can be accessed through the latest Xcode beta at the moment, as Apple released the first version of the software earlier today.
Popular Stories
The first benchmark results for the standard M3 chip surfaced in the Geekbench 6 database today, providing a closer look at the chip's CPU performance improvements. Based on the results so far, the M3 chip has single-core and multi-core scores of around 3,000 and 11,700, respectively. The standard M2 chip has single-core and multi-core scores of around 2,600 and 9,700, respectively, so the...
Apple appears to be internally testing an iOS 17.1.1 update for the iPhone, based on evidence of the software in our website's analytics logs this week. iOS 17.1.1 will almost certainly be focused on bug fixes, but it's unclear exactly which issues the update will address. The update could include the same fix for Wi-Fi connectivity issues that Apple rolled out in the first iOS 17.2 beta,...
Apple's latest M3 Pro chip in the new 14-inch and 16-inch MacBook Pro has 25% less memory bandwidth than the M1 Pro and M2 Pro chips used in equivalent models from the two previous generations. Based on the latest 3-nanometer technology and featuring all-new GPU architecture, the M3 series of chips is said to represent the fastest and most power-efficient evolution of Apple silicon thus far. ...
Apple today released a new firmware update designed for the AirTag item trackers. The firmware features a build number of 2A61, up from the 2A36 firmware that came out last December. It has been nearly a year since Apple updated the firmware on the AirTags, and there is no word yet on what might be included in the update. Today's firmware release will be rolling out on a staggered basis....
The first benchmark results for Apple's M3 Max chip surfaced in the Geekbench 6 database today, providing a look at CPU performance. Based on the "Mac15,9" model identifier shown, the results appear to be for the new 16-inch MacBook Pro. The highest multi-core score for the M3 Max with a 16-core CPU is currently 21,084 as of writing. If this early result is accurate, this means the M3 Max is ...
Apple made the first beta of iOS 17.2 available to developers and public beta testers last week, and the software update includes many new features and changes for iPhones. Below, we have highlighted 10 of these new features and changes. iOS 17.2 is expected to be released to the public in December. Once available, the update can be installed in the Settings app under General → Software...
Macs equipped with the standard M3 chip still support only one external display with up to 6K resolution at 60Hz, according to Apple's tech specs. So far, the chip is available in the entry-level 14-inch MacBook Pro and the 24-inch iMac. This limitation has existed since the first Apple silicon Macs with the M1 chip were released in 2020, but users can connect multiple external displays to...
The lower-cost Apple Music Voice Plan is being discontinued this month in the U.S. and all other countries where it was available, according to an Apple support document. Brazilian website MacMagazine was first to alert us to this news. "Beginning in November, Apple will discontinue the Apple Music Voice plan," said Apple. "We are focused on delivering the best, most robust music experience...
Top Rated Comments
And I wonder, 5-10 years from now?, what will this thing look like, how slim will it get, will it replace the glasses I wear now and be just a few ounces and look like normal glasses? Seems crazy to even think that...
But considering that my first gen iPod I listen to led to my thin and powerful iPhone, and the iMac g4 on my home desk is archaic compared to my 11" super thin iPad Pro → I look fwd to what the future holds for this tech and the innovation that comes along with it.