Newly developed software called Picasso succeeds in arranging pictures with appropriate compositions in an instant, by utilizing the technical skills of movie directors. Scientists at the Cluster of Excellence on “Multimodal Computing and Interaction” at Saarland University developed the software, and they will present the program with its associated smart phone app “PicasSound” at the Cebit computer expo, stand F34, hall 9. Cebit will take place from the 6th through the 10th of March at the fairground in Hanover.
“Usually, directors select consistent melodies for a particular movie scene,” explains Sebastian Michel, head of a junior research group at the Cluster of Excellence at the Saarland University. He designed the Picasso software together with Ph.D. student Aleksander Stupar. The program utilizes the expertise of movie producers in assigning appropriate background music for pictures, enabling users to select music that will harmonize with their impressions of their last summer vacation without putting in an extraordinary amount of effort.
A three-level algorithm carries out the elaborate process. First, the picture the user has chosen is compared with a huge database of movie scenes and their corresponding soundtracks. The software creates a ranking of the scenes that look most similar to the user’s picture. This database was compiled by the two researchers Michel and Stupar by splitting 50 movies into screenshots and their accompanying soundtracks. In the next step, the software creates a list of the selected tracks. And finally, the total number of tracks gets reduced to a few selections through a mathematical calculation; these are at last proposed to the user.
Here, a list of suggestions makes sense because particular pictures bring up different associations for different users, according to Michel. “Some people might connect a picture of a little house surrounded by an idyllic landscape with a romantic weekend for two, while others might think about loneliness,” Michel explains.
Interested people can experience the software on the demo website and get an idea of Picasso’s hit rate. Or they can use the free smartphone app “PicasSound,” which is programmed to pick out an appropriate soundtrack using the music which is already saved on the smartphone. It is free available for the mobile operating systems iOSX and Android.
Next, Michel and Stupar will try to expand the software system to support automatic sound recording of audiobooks on a textual basis. Furthermore, the researchers are planning to integrate a function inside the system that will take the individual preferences of the users into account.
Sebastian Michel is head of the junior research group “Querying, Indexing and Dynamic Data” at the Cluster of Excellence on “Multimodal Computing and Interaction” (MMCI). The Cluster was established by the German Research Foundation (DFG) within the framework of the German Excellence Initiative in November 2007. Besides the Saarland University, the Max Planck Institute for Informatics, the German Research Center for Artificial Intelligence, and the newly established Max Planck Institute for Software Systems are also members of the cluster. All departments of the institutions are located on the Saarland University campus.
For further information please contact:Dr.-Ing. Sebastian Michel, Head of the Junior Research Group
Friederike Meyer zu Tittingdorf | Universität des Saarlandes
UDE at the CeBIT fair: Protecting huge National Parks
07.03.2012 | Universität Duisburg-Essen
Cebit: Automated stress testing for Web 2.0 applications helps developers find programming errors
27.02.2012 | Universität des Saarlandes
Scientists at the Max Planck Institute for Polymer Research (MPI-P) in Mainz (Germany) together with scientists from Dresden, Leipzig, Sofia (Bulgaria) and Madrid (Spain) have now developed and characterized a novel, metal-organic material which displays electrical properties mimicking those of highly crystalline silicon. The material which can easily be fabricated at room temperature could serve as a replacement for expensive conventional inorganic materials used in optoelectronics.
Silicon, a so called semiconductor, is currently widely employed for the development of components such as solar cells, LEDs or computer chips. High purity...
Augsburg chemists present a new technology for compressing, storing and transporting highly volatile gases in porous frameworks/New prospects for gas-powered vehicles
Storage of highly volatile gases has always been a major technological challenge, not least for use in the automotive sector, for, for example, methane or...
When we put water in a freezer, water molecules crystallize and form ice. This change from one phase of matter to another is called a phase transition. While this transition, and countless others that occur in nature, typically takes place at the same fixed conditions, such as the freezing point, one can ask how it can be influenced in a controlled way.
We are all familiar with such control of the freezing transition, as it is an essential ingredient in the art of making a sorbet or a slushy. To make a cold...
Thin organic layers provide machines and equipment with new functions. They enable, for example, tiny energy recuperators. In future, these will be installed...
Das Zusammenspiel aus Struktur und Dynamik bestimmt die Funktion von Proteinen, den molekularen Werkzeugen der Zelle. Durch Fortschritte in der...
19.10.2018 | Veranstaltungen
18.10.2018 | Veranstaltungen
16.10.2018 | Veranstaltungen
19.10.2018 | Materialwissenschaften
19.10.2018 | Biowissenschaften Chemie
19.10.2018 | Bildung Wissenschaft