AR/VR Eye Tracking
Eye tracking measures where your eyes look inside a headset. Small infrared cameras and lights point toward each eye and follow the pupil. The device knows your gaze direction many times per second and shares it with apps that request it.
How Eye Tracking Works
Infrared light bounces off the eye and creates tiny reflections. Cameras capture the position of the pupil and those reflections. Software converts the data into a gaze direction, a line that starts at the eye and extends into the scene. Infrared light stays invisible to users and does not disturb the picture.
Calibration
Every face differs. Calibration asks you to look at a few dots, and the system learns the shape of your eyes. Accurate calibration improves precision for gaze-based features. Recalibrate when a different person uses the headset.
Main Uses
Foveated Rendering
Your eyes see sharp detail only in a small central area called the fovea. Foveated rendering draws the spot you look at in full detail and the surrounding area in lower detail. Hardware does less work, and users rarely notice the difference.
Gaze Selection
Looking at a button highlights it. A pinch or button press confirms the choice. The interaction feels fast because your eyes reach targets before your hands do.
Realistic Avatars
Avatars copy blinking and eye direction. Conversations feel more human when a virtual partner appears to look at you.
Auto Alignment
Some headsets measure eye position and adjust the lens settings or image alignment for each wearer.
Research and Training
Designers study which parts of a scene capture attention. Trainers check whether a learner looked at the right gauge during a practice exercise.
Diagram: Foveated Rendering Zones
+--------------------------------------+ | Outer zone: low detail | | +----------------------------+ | | | Middle zone: medium | | | | +------------------+ | | | | | Gaze point: HIGH | | | | | +------------------+ | | | +----------------------------+ | +--------------------------------------+
Real Example
Imagine reading a page in a virtual library. Only the words near your gaze need full sharpness. The page edges and the bookshelf behind it render with less detail. The headset saves processing power, and the page still looks crisp wherever your eyes land.
Design Guidelines
- Keep gaze targets large, since eye data carries small errors.
- Avoid forcing users to stare for long times to select items.
- Combine gaze with a second action, such as a pinch, to prevent accidental selections.
- Give visual feedback when an item receives focus.
Privacy and Responsible Use
Eye data reveals attention and interest. Developers should request permission before reading gaze data, store as little as possible, and explain the purpose in clear language. Many platforms process gaze data on the device and give apps only the selected target instead of raw eye movement. Users should check permission screens and disable the feature when they prefer.
Limits of Eye Tracking
Glasses, heavy makeup, and certain eye shapes can reduce accuracy. Bright sunlight interferes with infrared sensors in AR glasses. Developers provide a backup input, such as hand or controller selection, for every gaze feature.
Why Eye Tracking Matters
Eyes reveal intent. Devices that follow gaze run faster, respond quicker, and create richer social presence. Eye tracking sits at the center of future comfortable and efficient headsets.
