Dr. Fusheng Wang on “EyeCanDo: Eye Gaze-based Technology to Enable Communication for ALS patients”

On February 16, 2021, Dr. Fusheng Wang presented the development of his and his team’s EyeCanDo app, which is used to enable amyotrophic lateral sclerosis (ALS) patients to communicate freely using an eye gaze based technique.

Dr. Wang discussed how he and his team used Apple augmented reality (AR) and an iPad/iPhone with a built-in TrueDepth camera to develop the app.  They also employed artificial intelligence (AI), human computer interaction, and face topology to create a detailed 3D geometry of the face to build the app.

The online event, which attracted students, faculty, staff, and the community to learn about this innovative technology, generated a rich discussion of technologies used in this app.

Posted in Computer Science, Research, Technology