With the advent of compressed music files (MP3) and easily accessible internet file exchange and download services, consumers are increasingly turning to personal mini-databases of music files (iPod, MP3 players) for their musical enjoyment. The CD market has already taken a hard knock and many predict its imminent demise. The hi-fi market is also suffering with sales decreasing steadily every year.
In the future, the boundaries between the stereo system, computer and the television will become more and more blurred, but how the various functions will combine, and what new ones will emerge, is still ‘a work in progress’.
The Semantic Hi-Fi project explored the possibilities opened up by the digital revolution and paved the way for the next wave of hi-fi, including a number of new features likely to change fundamentally the way we listen to and interact with music.
“Music is no longer limited by a fixed format. Network-based distribution has freed music from the limits imposed by these formats and opened a whole new range of possibilities which will encourage greater interaction with musical pieces,” says Hugues Vinet of the French music and acoustics research centre, IRCAM, which coordinated the project.
Introducing the active listener
The working prototype of this next-generation hi-fi, produced by the EU-funded Semantic Hi-Fi, incorporates a number of new functionalities to help promote a more interactive listening experience.
Using either a hand-held, touch screen remote, or the touch screen display on the central unit, the user will, for example, be able to visualise the structure of a piece through a graphic display which will enable them to navigate smoothly within a piece and even to modify elements of the musical composition: slow the tempo down, speed it up, modify the relative weight of different instruments in the piece, or remove them altogether…
Some of the results of the project have already been incorporated into new products. Project partner, Native Instruments, used many of Semantic Hi-Fi’s features for its ‘Traktor DJ Studio 3’ DJ software solution, hailed as one of the market leaders in its field. The prototype developed by the project also incorporated many of these ‘professional’ tools into a home system accessible to all music lovers.
“The hi-fi of the future will make sophisticated software tools for professional musicians available to a wider public,” notes Vinet. “Owners of next-generation hi-fi will be able to do more than just passively listen, they will have a tool which also allows them to manipulate music and to create new pieces themselves.”
Hi-fis of the future will be linked up to the internet, and it will be possible to share personal works with others through peer-to-peer (P2P) systems. The project has not overlooked the issue of copyright, either.
“The P2P systems envisaged will respect the songs’ copyrights by only transmitting the information necessary for editing and modifying them,” stresses Vinet.
The ability to extract and display a whole range of information – tempo, key, lyrics, musical score – on a musical piece should also deepen the listeners musical knowledge and appreciation.
Managing your music
One of the challenges of the digital hi-fi will be managing extensive databases of music. It will no longer be a matter of simply grabbing a favourite CD from the shelf but of trawling through a database of perhaps tens of thousands of pieces. Semantic Hi-Fi, which concluded in November 2006, continued the work of Cuidado, an earlier EU-funded project, developing search engines capable of extracting information on musical content and providing tools for the effective management of musical ‘libraries’.
As a result of this work, users of future hi-fi can expect to be able to navigate easily through their collections using search criteria, such as tempo, genre, instrumentation, in addition to the traditional search criteria of artist and title. If you have a particular tune running through your head, but no information on it, you can simply hum the tune into the system’s microphone and it will find it for you!
You can also start from a reference piece and search for those similar to it according to selected musical criteria. You can classify and retrieve your songs by defining your own musical categories from a set of track examples that will be automatically generalised to your whole database. Last but not least, the system computes ‘musical summaries’ that give a global idea, within a few tens of seconds, of the main changes occurring in the pieces (intro, chorus, verses, solos, etc.), thus enabling rapid ‘auditory browsing’.
Many of the results of the project are now available for licensing and several are being developed further within the context on new research projects. Targeted applications include multimedia search engines, music portals, and automatic play-list generation.
Christian Nielsen | alfa
New Technologies for A/V Analysis and Search
13.04.2017 | Fraunhofer-Institut für Digitale Medientechnologie IDMT
On patrol in social networks
25.01.2017 | Fraunhofer-Institut für Arbeitswirtschaft und Organisation IAO
At the productronica trade fair in Munich this November, the Fraunhofer Institute for Laser Technology ILT will be presenting Laser-Based Tape-Automated Bonding, LaserTAB for short. The experts from Aachen will be demonstrating how new battery cells and power electronics can be micro-welded more efficiently and precisely than ever before thanks to new optics and robot support.
Fraunhofer ILT from Aachen relies on a clever combination of robotics and a laser scanner with new optics as well as process monitoring, which it has developed...
Plants and algae use the enzyme Rubisco to fix carbon dioxide, removing it from the atmosphere and converting it into biomass. Algae have figured out a way to increase the efficiency of carbon fixation. They gather most of their Rubisco into a ball-shaped microcompartment called the pyrenoid, which they flood with a high local concentration of carbon dioxide. A team of scientists at Princeton University, the Carnegie Institution for Science, Stanford University and the Max Plank Institute of Biochemistry have unravelled the mysteries of how the pyrenoid is assembled. These insights can help to engineer crops that remove more carbon dioxide from the atmosphere while producing more food.
A warming planet
Our brains house extremely complex neuronal circuits, whose detailed structures are still largely unknown. This is especially true for the so-called cerebral cortex of mammals, where among other things vision, thoughts or spatial orientation are being computed. Here the rules by which nerve cells are connected to each other are only partly understood. A team of scientists around Moritz Helmstaedter at the Frankfiurt Max Planck Institute for Brain Research and Helene Schmidt (Humboldt University in Berlin) have now discovered a surprisingly precise nerve cell connectivity pattern in the part of the cerebral cortex that is responsible for orienting the individual animal or human in space.
The researchers report online in Nature (Schmidt et al., 2017. Axonal synapse sorting in medial entorhinal cortex, DOI: 10.1038/nature24005) that synapses in...
Whispering gallery mode (WGM) resonators are used to make tiny micro-lasers, sensors, switches, routers and other devices. These tiny structures rely on a...
Using ultrafast flashes of laser and x-ray radiation, scientists at the Max Planck Institute of Quantum Optics (Garching, Germany) took snapshots of the briefest electron motion inside a solid material to date. The electron motion lasted only 750 billionths of the billionth of a second before it fainted, setting a new record of human capability to capture ultrafast processes inside solids!
When x-rays shine onto solid materials or large molecules, an electron is pushed away from its original place near the nucleus of the atom, leaving a hole...
19.09.2017 | Event News
12.09.2017 | Event News
06.09.2017 | Event News
25.09.2017 | Power and Electrical Engineering
25.09.2017 | Health and Medicine
25.09.2017 | Physics and Astronomy