Amateur drone videos could aid in natural disaster damage assessment

Drone video of damage from Hurricane Laura in Lake Charles, LA, was processed automatically by a Carnegie Mellon University system. Areas bounded in orange are considered severely damaged, while those in yellow are slightly damaged.
Credit: Carnegie Mellon University

Carnegie Mellon system uses social media posts to assess building damage

It wasn’t long after Hurricane Laura hit the Gulf Coast Thursday that people began flying drones to record the damage and posting videos on social media. Those videos are a precious resource, say researchers at Carnegie Mellon University, who are working on ways to use them for rapid damage assessment.

By using artificial intelligence, the researchers are developing a system that can automatically identify buildings and make an initial determination of whether they are damaged and how serious that damage might be.

“Current damage assessments are mostly based on individuals detecting and documenting damage to a building,” said Junwei Liang, a Ph.D. student in CMU’s Language Technologies Institute (LTI). “That can be slow, expensive and labor-intensive work.”

Satellite imagery doesn’t provide enough detail and shows damage from only a single viewpoint — vertical. Drones, however, can gather close-up information from a number of angles and viewpoints. It’s possible, of course, for first responders to fly drones for damage assessment, but drones are now widely available among residents and routinely flown after natural disasters.

“The number of drone videos available on social media soon after a disaster means they can be a valuable resource for doing timely damage assessments,” Liang said.

Xiaoyu Zhu, a master’s student in AI and Innovation in the LTI, said the initial system can overlay masks on parts of the buildings in the video that appear damaged and determine if the damage is slight or serious, or if the building has been destroyed.

###

The team will present their findings at the Winter Conference on Applications of Computer Vision (WACV 2021), which will be held virtually next year.

The researchers, led by Alexander Hauptmann, an LTI research professor, downloaded drone videos of hurricane and tornado damage in Florida, Missouri, Illinois, Texas, Alabama and North Carolina. They then annotated the videos to identify building damage and assess the severity of the damage.

The resulting dataset — the first that used drone videos to assess building damage from natural disasters — was used to train the AI system, called MSNet, to recognize building damage. The dataset is available for use by other research groups via Github.

The videos don’t include GPS coordinates — yet — but the researchers are working on a geolocation scheme that would enable users to quickly identify where the damaged buildings are, Liang said. This would require training the system using images from Google Streetview. MSNet could then match the location cues learned from Streetview to features in the video.

The National Institute of Standards and Technology sponsored this research.

Media Contact

Byron Spice
bspice@cs.cmu.edu
412-268-9068

 @CMUScience

http://www.cmu.edu 

Media Contact

Byron Spice
Carnegie Mellon University

All latest news from the category: Information Technology

Here you can find a summary of innovations in the fields of information and data processing and up-to-date developments on IT equipment and hardware.

This area covers topics such as IT services, IT architectures, IT management and telecommunications.

Back to home

Comments (0)

Write a comment

Newest articles

EEG ad tDCS chould serve as the basis of therapeutic strategies to combat newrological disorders. Image Credit: Institute of Science Tokyo

Using Electroencephalography to Improve Language Disorder Treatments

Researchers work towards an inexpensive and portable solution for treating aphasia  Electroencephalography (EEG) may offer a more accessible alternative to functional magnetic resonance imaging (fMRI) for guiding transcranial direct current…

The BioSCape team is poctured with NASA and South African aircraft. Image Credit: Jeremey Shelton/Fishwater Films

Measuring Life on Earth from Space: A Global Research Project

Measurements and data collected from space can be used to better understand life on Earth. An ambitious, multinational research project funded by NASA and co-led by UC Merced civil and…

NEJM study finds patients with blockages in medium-sized vessels in the brain who had endovascular treatment did not do any better and did not see any improvement compared to patients who had the standard of care. Dr. Michael Hill, MD, Dr. Mayank Goyal, MD, PhD (right). Image Credit: Riley Brandt, University of Calgary

Best Approach for Stroke in Medium-Sized Blood Vessels Identified

Calgary’s Stroke Program advancing science to improve care, treatment and outcomes for patients  University of Calgary’s Hotchkiss Brain Institute researchers with the Calgary Stroke Program at Foothills Medical Centre revolutionized…