Students Add Facial Recognition to Meta Smart Glasses to Identify Strangers in Real-Time

Two students at Harvard University modified a set of Meta Ray-Ban Smart Glasses to add AI-based facial recognition technology, and the result is a wearable that is able to identify people in real time, according to a report from 404 Media.

meta ray ban
The modified Meta Glasses are able to use the camera to scan a stranger's face to get their name, and there's also a function for pulling information like home address, phone number, and family members from internet sites that store that kind of data.

AnhPhu Nguyen and Caine Ardayfio, the creators, demonstrated the glasses in public. Ardayfio walked up to a total stranger, scanned her face, got her name and affiliations, and then pretended that he knew her from one of the organizations that came up in a search about her. In a second demo, Nguyen identified a random man and initiated a conversation, pretending to have read his work based on what the glasses surfaced.


The Meta Glasses were set up to stream video directly to Instagram, and a computer program monitors the stream. AI determines when a face is detected, and then an internet search is conducted to find more pictures of the person. From there, online articles, voter registration databases, and other public information is used to suss out a name, phone number, address, and relative's names. Everything happens in a couple of minutes, and it's fed back to a smartphone app.

Dozens of Harvard students were identified and they were never aware that AI face scans had been used to suss out their names and information about them. Nguyen said that the project is meant to raise awareness of what can be done with today's consumer technology, face search engines, LLMs, and public databases. The two creators have no plans to release any kind of product or code.

Nguyen and Ardayfio chose the Meta Ray-Ban Glasses because "they look almost indistinguishable from regular glasses," making them ideal for surreptitious image capture. Reverse facial recognition was used to match faces to publicly available images, and PimEyes, a face recognition search engine, was identified as the "most effective" way to find people. An LLM was used to look up details about a person across the web, and FastPeopleSearch provided additional information. The entire setup is automatic, thanks to LLMs.

Meta's Ray-Ban Glasses are simple in design and are primarily focused on taking images, but even that limited hardware is enough to generate detailed information about a person almost instantly. With a faster processor, on-device AI capabilities, better camera technology, and augmented reality, future products could do even more.

In response to the report, Meta told 404 Media that PimEyes facial recognition can be used with any camera, and it's not something that is "only possible because of Meta Ray-Bans." That is true, but the Meta Ray-Bans look like a standard pair of glasses, and many people aren't aware when the glasses are being used to take photos. PimEyes said that it found the report "quite surprising" because its search engine is "not designed to identify individuals, either directly or indirectly."

Popular Stories

AirPods Pro 3 Mock Feature

AirPods Pro 3 Just Months Away – Here's What We Know

Friday April 18, 2025 5:16 am PDT by
Despite being more than two years old, Apple's AirPods Pro 2 still dominate the premium wireless‑earbud space, thanks to a potent mix of top‑tier audio, class‑leading noise cancellation, and Apple's habit of delivering major new features through software updates. With AirPods Pro 3 widely expected to arrive in 2025, prospective buyers now face a familiar dilemma: snap up the proven...
iphone 16 pro models 1

17 Reasons to Wait for the iPhone 17

Thursday April 17, 2025 4:12 am PDT by
Apple's iPhone development roadmap runs several years into the future and the company is continually working with suppliers on several successive iPhone models simultaneously, which is why we often get rumored features months ahead of launch. The iPhone 17 series is no different, and we already have a good idea of what to expect from Apple's 2025 smartphone lineup. If you skipped the iPhone...
Beyond iPhone 13 Better Triad

Apple's 20th Anniversary iPhone May Finally Go All Screen

Tuesday April 15, 2025 6:31 am PDT by
Apple is preparing a "bold" new iPhone Pro model for the iPhone's 20th anniversary in 2027, according to Bloomberg's Mark Gurman. As part of what's being described as a "major shake-up," Apple is said to be developing a design that makes more extensive use of glass – and this could point directly to the display itself. Here's the case for Apple releasing a truly all-screen iPhone with no...
maxresdefault

iPhone 17 Pro Launching Later This Year With These 12 New Features

Sunday April 13, 2025 7:52 am PDT by
While the iPhone 17 Pro and iPhone 17 Pro Max are not expected to launch until September, there are already plenty of rumors about the devices. Subscribe to the MacRumors YouTube channel for more videos. Below, we recap key changes rumored for the iPhone 17 Pro models as of April 2025: Aluminum frame: iPhone 17 Pro models are rumored to have an aluminum frame, whereas the iPhone 15 Pro and ...
CarPlay Hero

Apple Releases Wireless CarPlay Fix

Wednesday April 16, 2025 11:28 am PDT by
If you have been experiencing issues with wireless CarPlay in your vehicle lately, it was likely due to a software bug that has now been fixed. Apple released iOS 18.4.1 today, and the update's release notes say it "addresses a rare issue that prevents wireless CarPlay connection in certain vehicles." If wireless CarPlay was acting up for you, updating your iPhone to iOS 18.4.1 should...
top stories 2025 04 19

Top Stories: iPhone 17 Pro Rumors, CarPlay Bug Fix, and More

Saturday April 19, 2025 6:00 am PDT by
This week saw rumor updates on the iPhone 17 Pro and next-generation Vision Pro, while a minor iOS 18.4.1 update delivered not just security fixes but also a fix for some CarPlay issues. We also looked ahead at what else is in Apple's pipeline for the rest of 2025 and even the 20th-anniversary iPhone coming in 2027, so read on below for all the details on these stories and more! iPhone 17 ...
iOS 18

iOS 18.5 Includes Only a Few Changes So Far

Monday April 21, 2025 11:00 am PDT by
Apple seeded the third beta of iOS 18.5 to developers today, and so far the software update includes only a few minor changes. The changes are in the Mail and Settings apps. In the Mail app, you can now easily turn off contact photos directly within the app, by tapping on the circle with three dots in the top-right corner. In the Settings app, AppleCare+ coverage information is more...

Top Rated Comments

iMac The Knife Avatar
7 months ago
Creepy just got creepier.
Score: 41 Votes (Like | Disagree)
SIGSEGV1 Avatar
7 months ago
blood type: AB. organ: matched. target locked
Score: 33 Votes (Like | Disagree)
madmin Avatar
7 months ago
that really Zucks
Score: 32 Votes (Like | Disagree)
Achiever Avatar
7 months ago
This is why we can't have nice things.
Score: 22 Votes (Like | Disagree)
HobeSoundDarryl Avatar
7 months ago
Amazing when used for good. :cool:

Scary when used for bad. :eek:
Score: 21 Votes (Like | Disagree)
wdwpsu Avatar
7 months ago
I think I'm going to go back to wearing a face mask and probably sunglasses in public.
Score: 17 Votes (Like | Disagree)