Main Content

Hearing problems? There’s an app for that

Computer scientist Liran Ma is developing a program so an iPhone can function as an inexpensive hearing aid.

BY CAROLINE COLLIER AND MIKE DEL VECHIO

WIDESPREAD PROBLEM

When Liran Ma’s mother visited Texas from China, the associate professor of computer science said he noticed her hearing was deteriorating.

1 in 3Mother Ma, whose name is Ziyun Wang, is not alone. The Hearing Loss Association of America reports that as many as 48 million residents in the United States alone suffer some degree of hearing loss. By 65, at least 1 of every 3 people is moving in the direction of deaf.

1 in 4Current hearing aid options are expensive and complex, Ma said. Devices cost an average of more than $2,000 per ear, and most private insurance companies — as well as Medicare — do not pay for them. Only 1 out of every 5 Americans with hearing loss uses a hearing aid, Ma said, and “cost is a significant barrier.”

A SOUND IDEA

Liran Ma

Liran Ma, computer science professor – photo by: Robert Hart

Ma, whose primary research interest is in network security, decided to develop an iPhone app, using Apple’s built-in sound-processing tools and a pair of headphones, to work like a hearing aid at a fraction of the cost.

The professor needed to learn how hearing aids work and, by default, how humans hear. At first, he said he assumed, “You just have to amplify the sound to a level that’s sufficiently loud for them so that they can hear again.”

The task would not be so simple.

LOSING HIGH FREQUENCIES

Hearing loss discriminates among frequencies. The cochlea cells, which vibrate to transfer sound information to the brain, begin dying at the outside of the inner ear, and those outer cells are responsible for high-frequency sounds.

frequency

 

NECESSARY CONSONANTS

waves

The loss of high-frequency hearing is a problem, as the sounds made by consonants register in the upper frequencies. People who cannot hear consonants have difficulty distinguishing between hard sounds, such as ‘S’ or ‘SH.’ Consonants often differentiate words, enabling listeners to tell the difference between cash and class, or pig and big, for example.

A FAST TRANSFORMATION

To amplify just the high frequencies, the app needed to break sounds apart.

For the mathematics behind manipulating portions of sound waves, Ma and his student research assistants sought the wisdom of Ken Richardson, professor
of math at TCU. He taught them properties of the fast Fourier transform, an algorithm that can convert sound from time ranges to constituent frequencies, simplifying manipulation of specific frequencies. small gap

A phone’s processor can only handle so much sound at once, leaving a small discontinuity between processed segments. The app also needed to reduce noise. Filtering out background chatter allows the listener to focus on the desired sounds.

The app incorporated a “partition of unity,” which Richardson said “allows one to piece together things that are not smooth and create something smooth out of it.”

The total processing has to happen in a flash. If the delay between sound emission and hearing is more than 50 milliseconds, confusion and disorientation can result due to visual experiences being out of sync with audio.

futureFUTURE TECH

Ma said he is planning future enhancements for the app, including “situational awareness,” which will rely on location-based data to estimate the average noise level around a person.

And instead of frequent trips to an audiologist to adjust a hearing device, the app will include “automatic fitting,” which instructs the user to say a sentence aloud and then makes changes.

“Based on [the listener’s] preference, the app can dynamically adjust the parameters,” Ma said.

clapHAPPY TO HEAR

The professor is still waiting to do a formal trial, but his mother is now using the app in China. She promises it works great, Ma said.

Helping his mother and other people with age-related hearing loss is a good reason to spend so much time on his side project, Ma said. “If you cannot hear, it’s like living in the dark. … I want people to see the light again … so I will make the app easily available at a much lower cost.”