Students Add Facial Recognition to Meta Smart Glasses to Identify Strangers in Real-Time

Two students at Harvard University modified a set of Meta Ray-Ban Smart Glasses to add AI-based facial recognition technology, and the result is a wearable that is able to identify people in real time, according to a report from 404 Media.

meta ray ban
The modified Meta Glasses are able to use the camera to scan a stranger's face to get their name, and there's also a function for pulling information like home address, phone number, and family members from internet sites that store that kind of data.

AnhPhu Nguyen and Caine Ardayfio, the creators, demonstrated the glasses in public. Ardayfio walked up to a total stranger, scanned her face, got her name and affiliations, and then pretended that he knew her from one of the organizations that came up in a search about her. In a second demo, Nguyen identified a random man and initiated a conversation, pretending to have read his work based on what the glasses surfaced.


The Meta Glasses were set up to stream video directly to Instagram, and a computer program monitors the stream. AI determines when a face is detected, and then an internet search is conducted to find more pictures of the person. From there, online articles, voter registration databases, and other public information is used to suss out a name, phone number, address, and relative's names. Everything happens in a couple of minutes, and it's fed back to a smartphone app.

Dozens of Harvard students were identified and they were never aware that AI face scans had been used to suss out their names and information about them. Nguyen said that the project is meant to raise awareness of what can be done with today's consumer technology, face search engines, LLMs, and public databases. The two creators have no plans to release any kind of product or code.

Nguyen and Ardayfio chose the Meta Ray-Ban Glasses because "they look almost indistinguishable from regular glasses," making them ideal for surreptitious image capture. Reverse facial recognition was used to match faces to publicly available images, and PimEyes, a face recognition search engine, was identified as the "most effective" way to find people. An LLM was used to look up details about a person across the web, and FastPeopleSearch provided additional information. The entire setup is automatic, thanks to LLMs.

Meta's Ray-Ban Glasses are simple in design and are primarily focused on taking images, but even that limited hardware is enough to generate detailed information about a person almost instantly. With a faster processor, on-device AI capabilities, better camera technology, and augmented reality, future products could do even more.

In response to the report, Meta told 404 Media that PimEyes facial recognition can be used with any camera, and it's not something that is "only possible because of Meta Ray-Bans." That is true, but the Meta Ray-Bans look like a standard pair of glasses, and many people aren't aware when the glasses are being used to take photos. PimEyes said that it found the report "quite surprising" because its search engine is "not designed to identify individuals, either directly or indirectly."

Popular Stories

maxresdefault

Apple Releases iOS 18.4 With Priority Notifications, Ambient Music, New Emoji and More

Monday March 31, 2025 10:03 am PDT by
Apple today released iOS 18.4 and iPadOS 18.4, the fourth major updates to the iOS 18 and iPadOS 18 operating system updates that came out last year. iOS 18.4 and iPadOS 18.4 come two months after Apple released iOS 18.3 and iPadOS 18.3. Subscribe to the MacRumors YouTube channel for more videos. The new software can be downloaded on eligible iPhones and iPads over-the-air by going to...
iPhone 17 Pro 34ths Perspective

iPhone 17 Pro Launching Later This Year With These 10 New Features

Sunday March 23, 2025 10:00 am PDT by
While the iPhone 17 Pro and iPhone 17 Pro Max are not expected to launch until September, there are already plenty of rumors about the devices. Below, we recap key changes rumored for the iPhone 17 Pro models as of March 2025: Aluminum frame: iPhone 17 Pro models are rumored to have an aluminum frame, whereas the iPhone 15 Pro and iPhone 16 Pro models have a titanium frame, and the iPhone ...
iOS 19 Mock WWDC25 Feature

iOS 19 Expected to Run on These iPhones

Monday March 31, 2025 5:28 pm PDT by
iOS 19 will not be available on the iPhone XR, iPhone XS, or the iPhone XS Max, according a private account on social media site X that has accurately provided information on device compatibility in the past. The iPhone XR, iPhone XS, and iPhone XS Max all have an A12 Bionic chip, so it looks like iOS 19 will discontinue support for that chip. All other iPhones that run iOS 18 are expected...
top stories 2025 03 29

Top Stories: WWDC 2025 Announced, iPhone 17 Pro and iOS 19 Rumors, and More

Saturday March 29, 2025 6:00 am PDT by
Apple's big developer event is a little over two months away, and rumors about what we can expect to see in Apple's next major operating system updates are becoming increasingly frequent. A public release of iOS 18.4 is also imminent with a number of updates and improvements, although we won't be getting the major Apple Intelligence Siri upgrades that had reportedly been planned for this...
Magic Mouse Green

What to Expect From the Magic Mouse 3

Saturday March 29, 2025 10:15 am PDT by
Apple is reportedly working on a new Magic Mouse. Below, we recap what to expect. The two key rumors for the Magic Mouse 3 so far include a relocated charging port, along with a more ergonomic design. It was briefly rumored that the Magic Mouse 3 would also feature voice control, but that was misinterpreted information. Relocated Charging Port While the Magic Mouse switched from...
iOS 18

iOS 18.4 Expected Next Week - Here Are the Release Notes

Friday March 28, 2025 2:01 pm PDT by
With the second release candidate of iOS 18.4 that Apple seeded out today, the company finally provided us with release notes that give a full rundown on what to expect. There's an Apple Vision Pro app, new Apple Intelligence features for notifications and additional language support, plus an Apple News Food feature for Apple News+ subscribers, and several updates that should improve the...
Foldable iPhone 2023 Feature Homescreen

Six Things to Know About Apple's Upcoming Foldable iPhone

Friday March 28, 2025 3:54 pm PDT by
We've been hearing rumors about a foldable iPhone for almost a decade now, but it looks like we might finally see the device come to fruition in 2026. We're going to be waiting many more months for the foldable iPhone, but so far we're hearing good things. Apple wants to make it creaseless. It's taken Apple multiple years to design a foldable iPhone that it's satisfied with because Apple ...
AirPods Pro Firmware Feature

Apple Releases New Firmware for AirPods Pro 2 and AirPods 4

Monday March 31, 2025 11:27 am PDT by
Apple today released new firmware updates for all AirPods 4 and AirPods Pro 2 models. The new firmware is version 7E93, up from the 7B21 firmware that was installed on the AirPods Pro 2 and the 7B20 firmware available on the AirPods 4 and AirPods 4 with ANC. It is not immediately clear what new features or changes are included in the new firmware, but we'll update this article should we find ...

Top Rated Comments

iMac The Knife Avatar
26 weeks ago
Creepy just got creepier.
Score: 41 Votes (Like | Disagree)
SIGSEGV1 Avatar
26 weeks ago
blood type: AB. organ: matched. target locked
Score: 33 Votes (Like | Disagree)
madmin Avatar
26 weeks ago
that really Zucks
Score: 32 Votes (Like | Disagree)
Achiever Avatar
26 weeks ago
This is why we can't have nice things.
Score: 22 Votes (Like | Disagree)
HobeSoundDarryl Avatar
26 weeks ago
Amazing when used for good. :cool:

Scary when used for bad. :eek:
Score: 21 Votes (Like | Disagree)
wdwpsu Avatar
26 weeks ago
I think I'm going to go back to wearing a face mask and probably sunglasses in public.
Score: 17 Votes (Like | Disagree)