Computer Science and Biology Come Together to Make Tree Identification a Snap

This electronic field guide allows users to identify tree species simply by taking a photograph of the tree’s leaves. In addition to the species name, Leafsnap provides high-resolution photographs and information about the tree’s flowers, fruit, seeds and bark—giving the user a comprehensive understanding of the species.

Users of Leafsnap will not only be learning about the trees in their communities and on their hikes; they will also be contributing to science. As people use Leafsnap, the free mobile app automatically shares their images, species identifications and the tree’s location with a community of scientists. These scientists will use the information to map and monitor population growth and decline of trees nationwide. Currently, Leafsnap’s database includes the trees of the Northeast, but will soon expand to cover the trees of the entire continental United States. The app is available for the iPhone, with iPad and Android versions expected to be released later this summer.

APPlying Visual Recognition Tech to Trees

The genesis of the project was the desire by computer scientists David Jacobs of the University of Maryland and Peter Belhumeur of Columbia University to apply the face recognition technologies that they were developing to the identification of tree species. They approached John Kress, research botanist at the Smithsonian’s National Museum of Natural History, to collaborate on remaking the traditional field guide for the 21st century.

“Traditional field guides can be frustrating – you often do not find what you are looking for. We thought we could redesign them using today’s smartphones and visual recognition technology,” said Belhumeur, professor of computer science at Columbia and leader of the Columbia team working on Leafsnap.

The visual recognition algorithms developed by the University of Maryland and Columbia University are key to Leafsnap. Each leaf photograph is matched against a leaf image library using numerous shape measurements computed at points along the leaf’s outline. The best matches are then ranked and returned to the user for final verification.

“Within a single species leaves can have quite diverse shapes, while leaves from different species are sometimes quite similar,” said Jacobs, a professor of computer science at Maryland. “So one of the main technical challenges in using leaves to identify plant species has been to find effective representations of their shape, which capture their most important characteristics.”

The algorithms and software were developed by Columbia and Maryland, and the Smithsonian supervised the identification and collection of leaves needed to create the image library used for the visual recognition in Leafsnap. In addition, the not-for-profit organization Finding Species was hired and supervised by the Smithsonian to acquire the detailed species images seen in the Leafsnap app and on the Leafsnap.com website.

“Leafsnap was originally designed as a specialized aid for scientists and plant explorers to discover new species in poorly known habitats,” said John Kress, leader of the Smithsonian team working on Leafsnap. Kress was digitizing the botanical specimens at the Smithsonian when first contacted by Jacobs and Belhumeur, so the match between a botanist and computer scientists came at a perfect time. “Now Smithsonian research is available as an app for the public to get to know the plant diversity in their own backyards, in parks, and in natural areas. This tool is especially important for the environment, because learning about nature is the first step in conserving it.”

About the University of Maryland
The University of Maryland, College Park, is recognized nationally and internationally as a center of academic and research excellence. The university, which attracted more than $545 million in research funding in fiscal year 2010, is No. 5 among Kiplinger's 100 Best Values in Public Colleges, No. 18 among U.S. public universities according to U.S. News & World Report and No. 1 in awarding undergraduate degrees to African Americans according to Diverse Issues in Higher Education. The University of Maryland and the Smithsonian Institution have a long history of research and educational collaborations, which since 2009 have been facilitated by a Memorandum of Understanding between the two institutions that makes it easier for their scholars, scientists and researchers to work together to increase contributions to science, share their knowledge with the public, and educate future generations.
About Columbia Engineering
Founded in 1864, Columbia University's Fu Foundation School of Engineering and Applied Science offers programs in nine departments to both undergraduate and graduate students. With facilities specifically designed and equipped to meet the laboratory and research needs of faculty and students, Columbia Engineering is home to NSF and NIH funded centers in genomic science, molecular nanostructures, materials science, and energy, as well as one of the world’s leading programs in financial engineering. These interdisciplinary centers are leading the way in their respective fields while individual groups of engineers and scientists collaborate to solve some of society’s more vexing challenges. http://www.engineering.columbia.edu/
About Smithsonian Institution
Founded in 1846, the Smithsonian is the world’s largest museum and research complex, consisting of 19 museums and galleries, the National Zoological Park and nine research facilities. There are 6,000 Smithsonian employees and 6,500 volunteers. Approximately 30 million people from around the world visited the Smithsonian in 2009, with 188 million visits to the Smithsonian websites. The total number of objects, works of art and specimens at the Smithsonian is estimated at 137 million.

Media Contact

Lee Tune Newswise Science News

More Information:

http://www.leafsnap.com

All latest news from the category: Information Technology

Here you can find a summary of innovations in the fields of information and data processing and up-to-date developments on IT equipment and hardware.

This area covers topics such as IT services, IT architectures, IT management and telecommunications.

Back to home

Comments (0)

Write a comment

Newest articles

Lighting up the future

New multidisciplinary research from the University of St Andrews could lead to more efficient televisions, computer screens and lighting. Researchers at the Organic Semiconductor Centre in the School of Physics and…

Researchers crack sugarcane’s complex genetic code

Sweet success: Scientists created a highly accurate reference genome for one of the most important modern crops and found a rare example of how genes confer disease resistance in plants….

Evolution of the most powerful ocean current on Earth

The Antarctic Circumpolar Current plays an important part in global overturning circulation, the exchange of heat and CO2 between the ocean and atmosphere, and the stability of Antarctica’s ice sheets….

Partners & Sponsors