Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

Active listening gives meaning to digital music

22.11.2005


Imagine a home hi-fi system where music was automatically categorised according to preferences, where you could read the lyrics as you listen, summon up a favourite tune by humming it, and play along with your favourites. It may sound farfetched, but all these functions and more have already been achieved.



The SemanticHIFI project, coordinated by the Paris-based music technology institute, Ircam, is unique. It represents a quantum leap in home music technology, in which access to musical content, and the ability to manipulate it, have hardly advanced since the days of the gramophone.

“Essentially, we are adding descriptions to musical content,” explains Ircam’s Hugues Vinet, the project coordinator. “This allows for more interaction with music, so users can do more than just passively listen. Actually, it’s about making our sophisticated software tools for professional musicians available to a broader public.”


These tools enable a wide variety of functions. Some address ways to browse the large number of recordings that now inhabit the average hard disk. “Browsing techniques for digital music were very basic,” explains Vinet. “You could only search ‘editorial’ information, such as titles. But SemanticHIFI will allow people to label and browse their own collections according to actual musical content, categorised as they see fit. “It’s not our object to define genres, but to let people define their own,” explains Vinet. “Then the system learns the definition criteria, and can label other titles accordingly.”

‘Browsing by example’ is another intriguing possibility – simply select the kind of music you want to hear, on the basis of features such as tempo or orchestration, and the programme comes up with a list of comparable pieces.

Naturally, exploring musical content in this way requires a mode of visualisation. “So we have developed a system that analyses the temporal structure of a piece of music and develops a graphical map or interface based on that,” explains Vinet. “So if you click on one of the elements in the graphical map, you go directly to that part of the music. What’s more, using this algorithm you can generate a musical summary as a new file – condensing a long piece into a much shorter one, but complete with all its variations. Then you can manipulate musical content via the summary and the graphical map.”

Another way of navigating through musical documents involves the ability to separate different instruments, using sound manipulation techniques that reproduce sounds in space. Here, SemanticHIFI challenges the usual recorded music model, which is undoubtedly polyphonic: “We have to persuade the music industry to evolve its production process by providing multitrack recordings,” says Vinet. Being able to separate the instruments allows the listener to arrange an orchestra in space, choosing where to place the violins, for example. It invites listeners and musicians to really understand the construction of a piece, and play along with it. “The system even includes simplified musical instruments that you can play with, using your voice,” Vinet explains.

SemanticHIFI’s system architecture has several components: a hi-fi box in the living room will house most of the capabilities. PC applications will enable more advanced functions, such as performance ones. Other capabilities are peer-to-peer file sharing – “In a non-copyright infringing way,” Vinet insists. “Users can share metadata – their indexing and manipulations – but not original tracks. The computer identifies the original behind the metadata, and if you don’t own it, will suggest you buy it. SemanticHIFI is therefore compatible with the commercial model.”

The project counts Berlin’s Native Instruments and the Sony European Technology Centre (Stuttgart) as its industrial partners. Sony handles the integration of the technologies into a box, which is the next step. “We’re two-thirds of the way there,” says Vinet. “All the technologies have been validated and the first application prototypes will be ready early in 2006, for a first trial at the Cité des Sciences in Paris.” He believes it is up to industry to decide the commercial future of the project: “The box itself may be a product, and parts of it may be adapted into mobiles or games – there are many possibilities,” he says.

But whatever form SemanticHIFI takes, one thing is for sure: listening to music will never be the same again.

Tara Morris | alfa
Further information:
http://istresults.cordis.lu/

More articles from Communications Media:

nachricht New Technologies for A/V Analysis and Search
13.04.2017 | Fraunhofer-Institut für Digitale Medientechnologie IDMT

nachricht On patrol in social networks
25.01.2017 | Fraunhofer-Institut für Arbeitswirtschaft und Organisation IAO

All articles from Communications Media >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: Fizzy soda water could be key to clean manufacture of flat wonder material: Graphene

Whether you call it effervescent, fizzy, or sparkling, carbonated water is making a comeback as a beverage. Aside from quenching thirst, researchers at the University of Illinois at Urbana-Champaign have discovered a new use for these "bubbly" concoctions that will have major impact on the manufacturer of the world's thinnest, flattest, and one most useful materials -- graphene.

As graphene's popularity grows as an advanced "wonder" material, the speed and quality at which it can be manufactured will be paramount. With that in mind,...

Im Focus: Exotic quantum states made from light: Physicists create optical “wells” for a super-photon

Physicists at the University of Bonn have managed to create optical hollows and more complex patterns into which the light of a Bose-Einstein condensate flows. The creation of such highly low-loss structures for light is a prerequisite for complex light circuits, such as for quantum information processing for a new generation of computers. The researchers are now presenting their results in the journal Nature Photonics.

Light particles (photons) occur as tiny, indivisible portions. Many thousands of these light portions can be merged to form a single super-photon if they are...

Im Focus: Circular RNA linked to brain function

For the first time, scientists have shown that circular RNA is linked to brain function. When a RNA molecule called Cdr1as was deleted from the genome of mice, the animals had problems filtering out unnecessary information – like patients suffering from neuropsychiatric disorders.

While hundreds of circular RNAs (circRNAs) are abundant in mammalian brains, one big question has remained unanswered: What are they actually good for? In the...

Im Focus: RAVAN CubeSat measures Earth's outgoing energy

An experimental small satellite has successfully collected and delivered data on a key measurement for predicting changes in Earth's climate.

The Radiometer Assessment using Vertically Aligned Nanotubes (RAVAN) CubeSat was launched into low-Earth orbit on Nov. 11, 2016, in order to test new...

Im Focus: Scientists shine new light on the “other high temperature superconductor”

A study led by scientists of the Max Planck Institute for the Structure and Dynamics of Matter (MPSD) at the Center for Free-Electron Laser Science in Hamburg presents evidence of the coexistence of superconductivity and “charge-density-waves” in compounds of the poorly-studied family of bismuthates. This observation opens up new perspectives for a deeper understanding of the phenomenon of high-temperature superconductivity, a topic which is at the core of condensed matter research since more than 30 years. The paper by Nicoletti et al has been published in the PNAS.

Since the beginning of the 20th century, superconductivity had been observed in some metals at temperatures only a few degrees above the absolute zero (minus...

All Focus news of the innovation-report >>>

Anzeige

Anzeige

Event News

Call for Papers – ICNFT 2018, 5th International Conference on New Forming Technology

16.08.2017 | Event News

Sustainability is the business model of tomorrow

04.08.2017 | Event News

Clash of Realities 2017: Registration now open. International Conference at TH Köln

26.07.2017 | Event News

 
Latest News

A Map of the Cell’s Power Station

18.08.2017 | Life Sciences

Engineering team images tiny quasicrystals as they form

18.08.2017 | Physics and Astronomy

Researchers printed graphene-like materials with inkjet

18.08.2017 | Materials Sciences

VideoLinks
B2B-VideoLinks
More VideoLinks >>>