On February 16, 2021, Dr. Fusheng Wang presented the development of his and his team’s EyeCanDo app, which is used to enable amyotrophic lateral sclerosis (ALS) patients to communicate freely using an eye gaze based technique.
Dr. Wang discussed how he and his team used Apple augmented reality (AR) and an iPad/iPhone with a built-in TrueDepth camera to develop the app. They also employed artificial intelligence (AI), human computer interaction, and face topology to create a detailed 3D geometry of the face to build the app.
The online event, which attracted students, faculty, staff, and the community to learn about this innovative technology, generated a rich discussion of technologies used in this app.
Clara Tran
Head, Science and Engineering at Stony Brook University Libraries
Clara is the member of the Library STEM Team.
Email: clara.tran@stonybrook.edu
Email: clara.tran@stonybrook.edu