Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

Cebit 2012: Intelligent software assigns appropriate background music for pictures

16.02.2012
Previously, setting a picture or whole series of pictures to suitable music required expert knowledge and a great deal of time.

Newly developed software called Picasso succeeds in arranging pictures with appropriate compositions in an instant, by utilizing the technical skills of movie directors. Scientists at the Cluster of Excellence on “Multimodal Computing and Interaction” at Saarland University developed the software, and they will present the program with its associated smart phone app “PicasSound” at the Cebit computer expo, stand F34, hall 9. Cebit will take place from the 6th through the 10th of March at the fairground in Hanover.

“Usually, directors select consistent melodies for a particular movie scene,” explains Sebastian Michel, head of a junior research group at the Cluster of Excellence at the Saarland University. He designed the Picasso software together with Ph.D. student Aleksander Stupar. The program utilizes the expertise of movie producers in assigning appropriate background music for pictures, enabling users to select music that will harmonize with their impressions of their last summer vacation without putting in an extraordinary amount of effort.

A three-level algorithm carries out the elaborate process. First, the picture the user has chosen is compared with a huge database of movie scenes and their corresponding soundtracks. The software creates a ranking of the scenes that look most similar to the user’s picture. This database was compiled by the two researchers Michel and Stupar by splitting 50 movies into screenshots and their accompanying soundtracks. In the next step, the software creates a list of the selected tracks. And finally, the total number of tracks gets reduced to a few selections through a mathematical calculation; these are at last proposed to the user.

Here, a list of suggestions makes sense because particular pictures bring up different associations for different users, according to Michel. “Some people might connect a picture of a little house surrounded by an idyllic landscape with a romantic weekend for two, while others might think about loneliness,” Michel explains.

Interested people can experience the software on the demo website and get an idea of Picasso’s hit rate. Or they can use the free smartphone app “PicasSound,” which is programmed to pick out an appropriate soundtrack using the music which is already saved on the smartphone. It is free available for the mobile operating systems iOSX and Android.

Next, Michel and Stupar will try to expand the software system to support automatic sound recording of audiobooks on a textual basis. Furthermore, the researchers are planning to integrate a function inside the system that will take the individual preferences of the users into account.

Sebastian Michel is head of the junior research group “Querying, Indexing and Dynamic Data” at the Cluster of Excellence on “Multimodal Computing and Interaction” (MMCI). The Cluster was established by the German Research Foundation (DFG) within the framework of the German Excellence Initiative in November 2007. Besides the Saarland University, the Max Planck Institute for Informatics, the German Research Center for Artificial Intelligence, and the newly established Max Planck Institute for Software Systems are also members of the cluster. All departments of the institutions are located on the Saarland University campus.

For further information please contact:

Dr.-Ing. Sebastian Michel, Head of the Junior Research Group
“Querying, Indexing, and Discovery in Dynamic Data”
Phone: +49 681 302 70 803 ?
E-Mail: smichel@mmci.uni-saarland.de
Gordon Bolduan
Scientific communication
Cluster of Excellence «Multimodal Computing and Interaction»
Phone: 0681 302-70741
E-Mail: bolduan@mmci.uni-saarland.de

Friederike Meyer zu Tittingdorf | Universität des Saarlandes
Further information:
http://www.uni-saarland.de
http://picasso.mmci.uni-saarland.de/demo/
http://qid3.mmci.uni-saarland.de/people/sebastian.html

More articles from CeBIT 2012:

nachricht UDE at the CeBIT fair: Protecting huge National Parks
07.03.2012 | Universität Duisburg-Essen

nachricht Cebit: Automated stress testing for Web 2.0 applications helps developers find programming errors
27.02.2012 | Universität des Saarlandes

All articles from CeBIT 2012 >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: Electron cryo-microscopy: Using inexpensive technology to produce high-resolution images

Biochemists at Martin Luther University Halle-Wittenberg (MLU) have used a standard electron cryo-microscope to achieve surprisingly good images that are on par with those taken by far more sophisticated equipment. They have succeeded in determining the structure of ferritin almost at the atomic level. Their results were published in the journal "PLOS ONE".

Electron cryo-microscopy has become increasingly important in recent years, especially in shedding light on protein structures. The developers of the new...

Im Focus: The spin state story: Observation of the quantum spin liquid state in novel material

New insight into the spin behavior in an exotic state of matter puts us closer to next-generation spintronic devices

Aside from the deep understanding of the natural world that quantum physics theory offers, scientists worldwide are working tirelessly to bring forth a...

Im Focus: Excitation of robust materials

Kiel physics team observed extremely fast electronic changes in real time in a special material class

In physics, they are currently the subject of intensive research; in electronics, they could enable completely new functions. So-called topological materials...

Im Focus: Electrons in the fast lane

Solar cells based on perovskite compounds could soon make electricity generation from sunlight even more efficient and cheaper. The laboratory efficiency of these perovskite solar cells already exceeds that of the well-known silicon solar cells. An international team led by Stefan Weber from the Max Planck Institute for Polymer Research (MPI-P) in Mainz has found microscopic structures in perovskite crystals that can guide the charge transport in the solar cell. Clever alignment of these "electron highways" could make perovskite solar cells even more powerful.

Solar cells convert sunlight into electricity. During this process, the electrons of the material inside the cell absorb the energy of the light....

Im Focus: The lightest electromagnetic shielding material in the world

Empa researchers have succeeded in applying aerogels to microelectronics: Aerogels based on cellulose nanofibers can effectively shield electromagnetic radiation over a wide frequency range – and they are unrivalled in terms of weight.

Electric motors and electronic devices generate electromagnetic fields that sometimes have to be shielded in order not to affect neighboring electronic...

All Focus news of the innovation-report >>>

Anzeige

Anzeige

VideoLinks
Industry & Economy
Veranstaltungen

Intensiv- und Notfallmedizin: „Virtueller DIVI-Kongress ist ein Novum für 6.000 Teilnehmer“

08.07.2020 | Veranstaltungen

Größte nationale Tagung für Nuklearmedizin

07.07.2020 | Veranstaltungen

Corona-Apps gegen COVID-19: Nationalakademie Leopoldina veranstaltet internationales virtuelles Podiumsgespräch

07.07.2020 | Veranstaltungen

VideoLinks
Science & Research
Overview of more VideoLinks >>>
 
Aktuelle Beiträge

Nanoelektronik lernt wie das Gehirn

14.07.2020 | Informationstechnologie

Anwendungslabor Industrie 4.0 der THD: Smarte Lösungen für die Unikatproduktion

14.07.2020 | Informationstechnologie

Neue Kunststoff-Schaltschränke AX von Rittal

14.07.2020 | Maschinenbau

Weitere B2B-VideoLinks
IHR
JOB & KARRIERE
SERVICE
im innovations-report
in Kooperation mit academics