DIY Eye Tracking For VR Headsets, From A To Z

Republished By Plato

Followers: 0

Eye tracking is a useful feature in social virtual reality (VR) spaces because it really enhances presence and communication when one’s avatar has a realistic gaze. Most headsets lack this feature, but EyeTrackVR has a completely open source solution ready for anyone willing to put it together.

<img data-attachment-id="608099" data-permalink="https://hackaday.com/2023/08/05/diy-eye-tracking-for-vr-headsets-from-a-to-z/eyetrackvr-square/" data-orig-file="https://platoaistream.net/wp-content/uploads/2023/08/diy-eye-tracking-for-vr-headsets-from-a-to-z-1.png" data-orig-size="1415,1415" data-comments-opened="1" data-image-meta="{"aperture":"0","credit":"","camera":"","caption":"","created_timestamp":"0","copyright":"","focal_length":"0","iso":"0","shutter_speed":"0","title":"","orientation":"0"}" data-image-title="EyeTrackVR square" data-image-description data-image-caption="

Camera is visible in lower right corner.

” data-medium-file=”https://platoaistream.net/wp-content/uploads/2023/08/diy-eye-tracking-for-vr-headsets-from-a-to-z.png” data-large-file=”https://platoaistream.net/wp-content/uploads/2023/08/diy-eye-tracking-for-vr-headsets-from-a-to-z-1.png?w=625″ decoding=”async” loading=”lazy” class=”wp-image-608099″ src=”https://platoaistream.net/wp-content/uploads/2023/08/diy-eye-tracking-for-vr-headsets-from-a-to-z.png” alt width=”300″ height=”300″ srcset=”https://platoaistream.net/wp-content/uploads/2023/08/diy-eye-tracking-for-vr-headsets-from-a-to-z-1.png 1415w, https://platoaistream.net/wp-content/uploads/2023/08/diy-eye-tracking-for-vr-headsets-from-a-to-z-1.png?resize=250,250 250w, https://platoaistream.net/wp-content/uploads/2023/08/diy-eye-tracking-for-vr-headsets-from-a-to-z-1.png?resize=400,400 400w, https://platoaistream.net/wp-content/uploads/2023/08/diy-eye-tracking-for-vr-headsets-from-a-to-z-1.png?resize=625,625 625w” sizes=”(max-width: 300px) 100vw, 300px”>

Camera is visible in lower right corner.

EyeTrackVR is a combination of hardware, software, and 3D printable mounts for attaching a pair of microcontroller boards, cameras, and IR LEDs to just about any existing VR headset out there. An ESP32-based board and tiny camera module watches each eyeball, and under IR illumination the pupil presents as an easily-identified round black area. Software takes care of turning the camera’s view of the pupil into a gaze direction value that can be plugged into other software.

The project is still under active development, but in its current state is perfectly suitable for creating a functional system that can integrate into a variety of existing headsets with printed mounting brackets. Interested? Check out the intro and if it sounds up your alley, dive into the build guide which spells out everything you need to know. Check out the video below for a demo of EyeTrackVR working in VRChat, along with an overview of software support.

We’ve seen headsets built to custom specs that integrate eye tracking, but even if one is repackaging an existing headset that’s a perfect opportunity to include this feature.

[embedded content]

Big thanks to [Summer] for sending this in on our tipline!