Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

Cebit 2012: Intelligent software assigns appropriate background music for pictures

16.02.2012
Previously, setting a picture or whole series of pictures to suitable music required expert knowledge and a great deal of time.

Newly developed software called Picasso succeeds in arranging pictures with appropriate compositions in an instant, by utilizing the technical skills of movie directors. Scientists at the Cluster of Excellence on “Multimodal Computing and Interaction” at Saarland University developed the software, and they will present the program with its associated smart phone app “PicasSound” at the Cebit computer expo, stand F34, hall 9. Cebit will take place from the 6th through the 10th of March at the fairground in Hanover.

“Usually, directors select consistent melodies for a particular movie scene,” explains Sebastian Michel, head of a junior research group at the Cluster of Excellence at the Saarland University. He designed the Picasso software together with Ph.D. student Aleksander Stupar. The program utilizes the expertise of movie producers in assigning appropriate background music for pictures, enabling users to select music that will harmonize with their impressions of their last summer vacation without putting in an extraordinary amount of effort.

A three-level algorithm carries out the elaborate process. First, the picture the user has chosen is compared with a huge database of movie scenes and their corresponding soundtracks. The software creates a ranking of the scenes that look most similar to the user’s picture. This database was compiled by the two researchers Michel and Stupar by splitting 50 movies into screenshots and their accompanying soundtracks. In the next step, the software creates a list of the selected tracks. And finally, the total number of tracks gets reduced to a few selections through a mathematical calculation; these are at last proposed to the user.

Here, a list of suggestions makes sense because particular pictures bring up different associations for different users, according to Michel. “Some people might connect a picture of a little house surrounded by an idyllic landscape with a romantic weekend for two, while others might think about loneliness,” Michel explains.

Interested people can experience the software on the demo website and get an idea of Picasso’s hit rate. Or they can use the free smartphone app “PicasSound,” which is programmed to pick out an appropriate soundtrack using the music which is already saved on the smartphone. It is free available for the mobile operating systems iOSX and Android.

Next, Michel and Stupar will try to expand the software system to support automatic sound recording of audiobooks on a textual basis. Furthermore, the researchers are planning to integrate a function inside the system that will take the individual preferences of the users into account.

Sebastian Michel is head of the junior research group “Querying, Indexing and Dynamic Data” at the Cluster of Excellence on “Multimodal Computing and Interaction” (MMCI). The Cluster was established by the German Research Foundation (DFG) within the framework of the German Excellence Initiative in November 2007. Besides the Saarland University, the Max Planck Institute for Informatics, the German Research Center for Artificial Intelligence, and the newly established Max Planck Institute for Software Systems are also members of the cluster. All departments of the institutions are located on the Saarland University campus.

For further information please contact:

Dr.-Ing. Sebastian Michel, Head of the Junior Research Group
“Querying, Indexing, and Discovery in Dynamic Data”
Phone: +49 681 302 70 803 ?
E-Mail: smichel@mmci.uni-saarland.de
Gordon Bolduan
Scientific communication
Cluster of Excellence «Multimodal Computing and Interaction»
Phone: 0681 302-70741
E-Mail: bolduan@mmci.uni-saarland.de

Friederike Meyer zu Tittingdorf | Universität des Saarlandes
Further information:
http://www.uni-saarland.de
http://picasso.mmci.uni-saarland.de/demo/
http://qid3.mmci.uni-saarland.de/people/sebastian.html

More articles from CeBIT 2012:

nachricht UDE at the CeBIT fair: Protecting huge National Parks
07.03.2012 | Universität Duisburg-Essen

nachricht Cebit: Automated stress testing for Web 2.0 applications helps developers find programming errors
27.02.2012 | Universität des Saarlandes

All articles from CeBIT 2012 >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: Neutron star merger directly observed for the first time

University of Maryland researchers contribute to historic detection of gravitational waves and light created by event

On August 17, 2017, at 12:41:04 UTC, scientists made the first direct observation of a merger between two neutron stars--the dense, collapsed cores that remain...

Im Focus: Breaking: the first light from two neutron stars merging

Seven new papers describe the first-ever detection of light from a gravitational wave source. The event, caused by two neutron stars colliding and merging together, was dubbed GW170817 because it sent ripples through space-time that reached Earth on 2017 August 17. Around the world, hundreds of excited astronomers mobilized quickly and were able to observe the event using numerous telescopes, providing a wealth of new data.

Previous detections of gravitational waves have all involved the merger of two black holes, a feat that won the 2017 Nobel Prize in Physics earlier this month....

Im Focus: Smart sensors for efficient processes

Material defects in end products can quickly result in failures in many areas of industry, and have a massive impact on the safe use of their products. This is why, in the field of quality assurance, intelligent, nondestructive sensor systems play a key role. They allow testing components and parts in a rapid and cost-efficient manner without destroying the actual product or changing its surface. Experts from the Fraunhofer IZFP in Saarbrücken will be presenting two exhibits at the Blechexpo in Stuttgart from 7–10 November 2017 that allow fast, reliable, and automated characterization of materials and detection of defects (Hall 5, Booth 5306).

When quality testing uses time-consuming destructive test methods, it can result in enormous costs due to damaging or destroying the products. And given that...

Im Focus: Cold molecules on collision course

Using a new cooling technique MPQ scientists succeed at observing collisions in a dense beam of cold and slow dipolar molecules.

How do chemical reactions proceed at extremely low temperatures? The answer requires the investigation of molecular samples that are cold, dense, and slow at...

Im Focus: Shrinking the proton again!

Scientists from the Max Planck Institute of Quantum Optics, using high precision laser spectroscopy of atomic hydrogen, confirm the surprisingly small value of the proton radius determined from muonic hydrogen.

It was one of the breakthroughs of the year 2010: Laser spectroscopy of muonic hydrogen resulted in a value for the proton charge radius that was significantly...

All Focus news of the innovation-report >>>

Anzeige

Anzeige

IHR
JOB & KARRIERE
SERVICE
im innovations-report
in Kooperation mit academics
Veranstaltungen

Das Immunsystem in Extremsituationen

19.10.2017 | Veranstaltungen

Die jungen forschungsstarken Unis Europas tagen in Ulm - YERUN Tagung in Ulm

19.10.2017 | Veranstaltungen

Bauphysiktagung der TU Kaiserslautern befasst sich mit energieeffizienten Gebäuden

19.10.2017 | Veranstaltungen

 
VideoLinks
B2B-VideoLinks
More VideoLinks >>>
Aktuelle Beiträge

Forscher finden Hinweise auf verknotete Chromosomen im Erbgut

20.10.2017 | Biowissenschaften Chemie

Saugmaschinen machen Waschwässer von Binnenschiffen sauberer

20.10.2017 | Ökologie Umwelt- Naturschutz

Strukturbiologieforschung in Berlin: DFG bewilligt Mittel für neue Hochleistungsmikroskope

20.10.2017 | Förderungen Preise