Eye Tracking Technology Enhances Augmented Reality on Vehicle Windows

Developed at Taiwan’s Industrial Technology Research Institute (ITRI) and set for public unveiling at the Consumer Electronics Show (CES) 2024, the Augmented Reality Interactive Vehicle Display is a vehicle window that can provide additional information about what a passenger is currently viewing. In the future, tour buses may not even need human guides, passengers will just take self-guided tours through their window.

Each window’s interior is covered with a transparent microLED touchscreen panel, and a camera above the window constantly tracks a passenger’s gaze. The system also uses GPS positioning data to know what landmarks are near and, when it notices a passenger looking at something it has additional information about, displays a small photo of the attraction in the microLED panel. Clicking the photo will then bring up text boxes with additional information. That’s pretty neat, but reading in a moving vehicle always makes me queasy.

The technology could be applied to any mode of transportation with windows, including planes, trains, and cruise ships. Databases of attractions and their details just have to be built for the various landmarks, and passengers will be free to explore their surroundings on their own, all from the comfort of their seats! Alternatively, they can just stay home and look up pictures of said attractions on the internet. At least that’s what I do.

Jonathan has over 17 years of writing experience and has had a passion for all things tech-related since he watched Inspector Gadget as a child. He has disassembled countless appliances and managed to put a few back together, with one still working. When not writing, he can often be found playing video games or accidentally hurting himself in the garage.