Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:


Listening to bipolar disorder: Smartphone app detects mood swings via voice analysis


Subtle changes could act as early warning of need for care, U-M research suggests

A smartphone app that monitors subtle qualities of a person's voice during everyday phone conversations shows promise for detecting early signs of mood changes in people with bipolar disorder, a University of Michigan team reports.

While the app still needs much testing before widespread use, early results from a small group of patients show its potential to monitor moods while protecting privacy.

The researchers hope the app will eventually give people with bipolar disorder and their health care teams an early warning of the changing moods that give the condition its name. The technology could also help people with other conditions.

More patients, all taking part in the study funded by the National Institute of Mental Health and facilitated by the Prechter Bipolar Research Fund at the U-M Depression Center, have already started to use the app on study-provided smartphones. As more patients volunteer, the team will continue to test and improve the technology.

The U-M team, led by computer scientists Zahi Karam, Ph.D. and Emily Mower Provost, Ph.D., and psychiatrist Melvin McInnis, M.D., presented its first findings today at the International Conference on Acoustics, Speech and Signal Processing in Italy, and published details simultaneously in the conference proceedings.

They call the project PRIORI, because they hope it will yield a biological marker to prioritize bipolar disorder care to those who need it most urgently to stabilize their moods – especially in regions of the world with scarce mental health services. Bipolar disorder affects tens of millions of people worldwide, and can have devastating effects including suicide.

But first, based on these encouraging findings, the technology and algorithms will be developed via research involving 60 American patients who receive treatment from U-M teams at the nation's first center devoted to depression and related disorders.

"These pilot study results give us preliminary proof of the concept that we can detect mood states in regular phone calls by analyzing broad features and properties of speech, without violating the privacy of those conversations," says Karam, a postdoctoral fellow and specialist in machine learning and speech analysis. "As we collect more data the model will become better, and our ultimate goal is to be able to anticipate swings, so that it may be possible to intervene early."

Adds McInnis, a bipolar specialist, "This is tremendously exciting not only as a technical achievement, but also as an illustration of what the marriage of mental health research, engineering and innovative research funding can make possible."

He adds, "The ability to predict mood changes with sufficient advance time to intervene would be an enormously valuable biomarker for bipolar disorder."

He notes that the initial seed funding for the voice technology research came from the Michigan Institute for Clinical and Health Research. The ready source of patient-volunteers came from a Prechter Fund-supported registry, and the new early results were made possible by NIMH funding.

The research team hails from the Department of Psychiatry at the U-M Medical School and the Division of Computer Science and Engineering in the Department of Electrical and Computer Engineering at the U-M College of Engineering. It includes Satinder Singh, Ph.D. an artificial intelligence and machine learning expert.

How it works

The app runs in the background on an ordinary smartphone, and automatically monitors the patients' voice patterns during any calls made as well as during weekly conversations with a member of the patient's care team. The computer program analyzes many characteristics of the sounds – and silences – of each conversation.

Only the patient's side of everyday phone calls is recorded – and the recordings themselves are encrypted and kept off-limits to the research team. They can see only the results of computer analysis of the recordings, which are stored in secure servers that comply with patient privacy laws.

Standardized weekly mood assessments with a trained clinician provide a benchmark for the patient's mood, and are used to correlate the acoustic features of speech with their mood state.

Because other mental health conditions also cause changes in a person's voice, the same technology framework developed for bipolar disorder could prove useful in everything from schizophrenia and post-traumatic stress disorder to Parkinson's disease, the researchers say.

Results so far

The first six patients all have a rapid-cycling form of Type 1 bipolar disorder and a history of being prone to frequent depressive and manic episodes. The researchers showed that their analysis of voice characteristics from everyday conversations could detect elevated and depressed moods.

The detection of mood states will improve over time as the software gets trained based on more conversations and data from more patients.

The researchers study patients as they experience all aspects of bipolar disorder mood changes, from mild depressions and hypomania (mild mania) to full-blown depressed and manic states. Over time, they hope to develop software that will learn to detect the changes that precede the transitions to each of these states. They also need to develop and explore strategies for notifying the app user and care providers about mood changes, so that appropriate intervention can take place.

The app currently runs on Android operating system phones, and complies with laws about recording conversations because only one side of the conversation actually gets recorded. The University of Michigan has applied for patent protection for the intellectual property involved.


Prechter project manager Gloria Harrington, MSW, social worked Jennifer Montgomery, MSW, and research technician Christopher Archer, B.S. also worked on the project.

To be eligible for the smartphone app study, patients must first enroll in the Prechter Fund-sponsored long-term study of bipolar disorder, which accepts adults with and without bipolar disorder. More information and contact information to sign up: (study number HUM00000606). For more about the Prechter Fund, visit

Funding: National Institute of Mental Health, MH100404

Kara Gavin | Eurek Alert!
Further information:

Further reports about: Engineering Listening Smartphone bipolar characteristics conversation disorder

More articles from Health and Medicine:

nachricht Antioxidants cause malignant melanoma to metastasize faster
09.10.2015 | University of Gothenburg

nachricht Finding cannabinoids in hair does not prove cannabis consumption
07.10.2015 | Universitätsklinikum Freiburg

All articles from Health and Medicine >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: Reliable in-line inspections of high-strength automotive body parts within seconds

Nondestructive material testing (NDT) is a fast and effective way to analyze the quality of a product during the manufacturing process. Because defective materials can lead to malfunctioning finished products, NDT is an essential quality assurance measure, especially in the manufacture of safety-critical components such as automotive B-pillars. NDT examines the quality without damaging the component or modifying the surface of the material. At this year's Blechexpo trade fair in Stuttgart, Fraunhofer IZFP will have an exhibit that demonstrates the nondestructive testing of high-strength automotive body parts using 3MA. The measurement results are available in a matter of seconds.

To minimize vehicle weight and fuel consumption while providing the highest level of crash safety, automotive bodies are reinforced with elements made from...

Im Focus: Kick-off for a new era of precision astronomy

The MICADO camera, a first light instrument for the European Extremely Large Telescope (E-ELT), has entered a new phase in the project: by agreeing to a Memorandum of Understanding, the partners in Germany, France, the Netherlands, Austria, and Italy, have all confirmed their participation. Following this milestone, the project's transition into its preliminary design phase was approved at a kick-off meeting held in Vienna. Two weeks earlier, on September 18, the consortium and the European Southern Observatory (ESO), which is building the telescope, have signed the corresponding collaboration agreement.

As the first dedicated camera for the E-ELT, MICADO will equip the giant telescope with a capability for diffraction-limited imaging at near-infrared...

Im Focus: Locusts at the wheel: University of Graz investigates collision detector inspired by insect eyes

Self-driving cars will be on our streets in the foreseeable future. In Graz, research is currently dedicated to an innovative driver assistance system that takes over control if there is a danger of collision. It was nature that inspired Dr Manfred Hartbauer from the Institute of Zoology at the University of Graz: in dangerous traffic situations, migratory locusts react around ten times faster than humans. Working together with an interdisciplinary team, Hartbauer is investigating an affordable collision detector that is equipped with artificial locust eyes and can recognise potential crashes in time, during both day and night.

Inspired by insects

Im Focus: Physicists shrink particle accelerator

Prototype demonstrates feasibility of building terahertz accelerators

An interdisciplinary team of researchers has built the first prototype of a miniature particle accelerator that uses terahertz radiation instead of radio...

Im Focus: Simple detection of magnetic skyrmions

New physical effect: researchers discover a change of electrical resistance in magnetic whirls

At present, tiny magnetic whirls – so called skyrmions – are discussed as promising candidates for bits in future robust and compact data storage devices. At...

All Focus news of the innovation-report >>>



Event News

EHFG 2015: Securing healthcare and sustainably strengthening healthcare systems

01.10.2015 | Event News

Conference in Brussels: Tracking and Tracing the Smallest Marine Life Forms

30.09.2015 | Event News

World Alzheimer`s Day – Professor Willnow: Clearer Insights into the Development of the Disease

17.09.2015 | Event News

Latest News

Navigating the unknown

09.10.2015 | Information Technology

New Artificial Cells Mimic Nature’s Tiny Reactors

09.10.2015 | Materials Sciences

Chimpanzees Shed Light on Origins of Human Walking

09.10.2015 | Life Sciences

More VideoLinks >>>