Let's talk
Smart glasses Live translation 3D web Self-initiated 2026 View live ↗

LinguaLens

An interpreter for Meta Ray-Ban Display that tells you what a stranger said, then hands you something to say back and how to pronounce it.

Info Project Overview

Challenge

You are three days into a city where you cannot read a sign. Pointing works. Holding out a phone works. Both cost you the moment: she stops talking to you and starts waiting for you, and by the time the translation lands the conversation has moved on.

Solution

LinguaLens runs on Meta Ray-Ban Display, in the corner of your eye. It hears the person in front of you and shows what they said in your language. Then it hands you the answer: the phrase to speak, how to pronounce it, and what it means. You reply without looking away from them.

Result

You hold a conversation instead of a transaction. She asks, you understand her, you answer. Nobody stands there waiting while a phone thinks, and you never look away to read one.

The Ray-Ban Meta frames rendered in three dimensions, turning to the wearing position before the camera flies into the right lens
Live screen labelled They said, showing the Spanish question Algo mas above three translated English lines, with a cultural cue below

The interface renders inside the right lens, because that is where it renders on the glasses.

Understanding someone is only half a conversation.
How I built it

Hear it, read it, say it back.

The glasses pick up what she is saying, put the meaning in front of you, then hand you the words to answer with and how to say them. All of it sits in the corner of your eye, so you never look away from her.

Live screen labelled They said, showing the Spanish question Algo mas above three translated English lines, with a cultural cue below
What it does

Their turn, and only theirs

A label reading They said settles whose line this is before you read a word. Her Spanish sits above the meaning so you can hear it and see it line up, and older lines dim rather than clear, so looking up late still lands you inside the conversation.

The thought process
  • One speaker at a time

    Their line and yours never share a frame. Stacked together there was nothing to say which was which, and colour is the first thing a glance loses.

  • The label comes before the words

    They said, or you say. Two words in the position your eye lands on first, so the question is answered before you start reading.

Reply screen labelled You say, showing Dos naranjas por favor above an English respelling with the stressed syllables marked, and the meaning underneath
What it does

Then it hands you the answer

The phrase you have to pronounce becomes the largest thing on the glass, with the respelling under it and the stress marked, because that is the part that decides whether you are understood. Underneath, in small text, what you are about to say.

The thought process
  • Biggest is whatever you need next

    While she talks that is the English meaning. When it is your turn it is the Spanish you have to pronounce.

  • Pronunciation is a first class line

    A reply you cannot say is not a reply. The respelling sits under the phrase with the stressed syllable marked, because stress is what English speakers get wrong.

LinguaLens home screen listing Languages, Live, ASL and Signs, with the Spanish and English pairing shown at the foot
What it does

Four destinations, no scrolling

The whole app fits one screen, so the D-pad never has to page. Focus is a ring rather than a fill, and the chosen pair sits at the foot where it can be checked without opening anything.

The thought process
  • One speaker at a time

    Their line and yours never share a frame. Stacked together there was nothing to say which was which, and colour is the first thing a glance loses.

Signs screen showing a Spanish cafe list, menu and coffee with milk and how much does it cost, above its English translation
What it does

Signs read in place

Source above, translation below, in one block, so you can check the line you are actually looking at. The captured sign follows whichever pair you set, so choosing Spanish gives you a Spanish menu rather than someone else's language. It stands in for the OCR a real build would run on the camera frame.

The thought process
  • Offline phrasebook, not an API key

    A portfolio demo that depends on a network call and a billed key is a demo that breaks on the day someone looks at it.

Work with me

Ready to
hear more “yes”?

Hell yes!
CaninePages home page with a city search for Mumbai, a headline reading "Find the right help for every stage of your dog’s life", and a row of category chips showing counts for vets, emergency care, grooming, trainers, boarding, walkers, dog-friendly places, stores and rescue Next project CaninePages See project