(Image courtesy of Purdue University.)
New software developed by engineering researchers at Purdue University could one day help people with visual impairments “see” again, by enabling them to identify scientific images on a computer screen using their other senses.
The “haptic device” created by Ting Zhang, a graduate student in Purdue’s School of Industrial Engineering, employs a specially designed joystick attached to a computer that controls a cursor.
As the cursor moves across an object on the screen, it provides force feedback, vibrations and sound cues that help the user gain information about it. Through this sensory feedback, the user can determine the size, shape, texture and color of the object, thus helping them identify it.
According to a 2014 paper from the National Science Foundation, about 1 percent of people working and studying in the fields of advanced science and engineering research have visual impairments, and Zhang’s technology could prove to be an invaluable resource for them. Current solutions are limited to 3D printing representations of computer images they can hold in their hands—an effective, yet costly and time-consuming process.
According to Zhang’s advisor and Purdue associate professor of engineering practice, Brad Duerstock, Zhang’s project could provide a better solution.
“How science is conducted and how findings are typically represented is usually quite visual, making it difficult for students with visual impairments,” Duerstock said. “We’re hoping this technology can be used by schools in the future to assist students with visual impairments to study science.”
“The method is much less expensive, and allows a person to directly interface with a computerized image using a haptic device and other sensory interfaces,” Duerstock added.
Assistive technology specialist for IT at Purdue, David Schwarte, has a visual impairment. After testing the system, he says it presents a lot of potential for people like him. “I think this has a possibility of making things easier for people with a visual impairment, Schwarte said. “The big advantage is that it’s electronic and more real time.”
For her part, Zhang believes her technology also has the potential to be used for applications other than aiding people with visual impairments.
“We think the technology could be extended to other users as well, such as people without disabilities needing to get details about objects that only exist in a virtual state,” Zhang says, noting that she’s planning to launch a start-up company to market the technology via Purdue Foundry’s LaunchBox program.
Currently Zhang and the team are working with a prototype of the device, with plans to do field trials this summer. They are seeking collaborators and investors to help with the process of commercializing their new technology.
People with visual impairments are also using haptic devices with GPS navigation to help them find their way around the world.
For more information, visit Purdue University’s School of Industrial Engineering.