Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

Music maestro! Bringing out the conductor in you

06.02.2008
New information and communications technologies are rapidly transforming our lives in many areas. A new European research project is looking at ways of harnessing technological advances to make musical education more accessible and enhance teaching practices.

The traditional method of teaching music is based on verbal feedback from the teacher and relatively short teacher-pupil contact. New technologies provide opportunities to extend the options available to both students and teachers, and to develop new pedagogical tools which could enhance the learning experience – either by providing alternative forms of feedback or by offering access to interactive training materials during and outside the lesson itself.

The i-Maestro project is currently investigating different ways in which ICT tools can be harnessed to improve music training in both theory and practice, and exploring the potential of interactive multimedia environments for technology enhanced learning.

Mirror, mirror, ...
“One of the areas we are looking at is gesture analysis,” says project coordinator Dr Kia Ng. “The ‘i-Maestro 3D Augmented Mirror’ we developed uses motion-capture technology to provide interactive feedback to the musician on their bowing technique and posture, which can greatly affect the quality of sound produced.”

Twelve infrared cameras capture the performer’s movements in 3D with synchronised audio and video recordings. The software analyses the motion data and provides multi-modal feedback using visual and auditory displays.

“A performed gesture can be compared with a set of pre-recorded gestures which allows both the teacher and the student to see clearly every detailed nuance of posture and bowing technique,” notes Ng.

This also has implications for professional musicians who frequently suffer from career threatening injury, much of which can be traced back to bad posture. Dr Ng believes that the use of 3D imagery and sensor technologies could have a beneficial impact for many musicians and make it much easier for teachers to spot potential problems.

3D motion capture is still relatively expensive but facilities can be hired and the EU-funded project is working to develop a more economic sensor-based interface.

Knowing the score
Another area being looked at is ways of presenting and accessing the musical score. i-Maestro is extending and developing MPEG Symbolic Music Representation (SMR) to help integrate multimedia functions and musical score information. MPEG SMR is being used to support new, improved pedagogical tools for interactive home learning, as well as for use in classroom situations. It is also be used to improve the accessibility of music to those with visual or other impairments.

The ‘score follower’, for example, is able to ‘listen’ to the player and track his/her location within the score, allowing functions such as automated page turning, or simply following the score of a piece of music as it is being played. Taking it a stage further, the ‘score follower’ could allow functions like musical accompaniment, where a backing track can be synchronised to the musician’s performance.

“Learning and playing with others is a key part of musical education,” notes Ng. “However, access to this kind of experience may be limited. The technologies we are developing, such as the cooperative environment, could help make it much more accessible – at least in virtual terms.”

Virtual music school
Part of the project’s work focuses more particularly on music education in schools and the provision of novel tools for teachers and students in a networked school context. The ‘School Server’ is being developed and tested as a key resource, providing online access to lesson materials and various shared tools: metronome, tuner, various collaborative tools, an MPEG SMR viewer, and others.

Students will also be able to access exercise materials from home and teachers will be able to gather practice data from students and so monitor their work virtually.

As a further tool for teachers, the ‘exercise generator’ will support the (semi-)automated creation of exercises. “Teachers will be able to create teaching material corresponding to the level of a student, or a group of students, in a simple way, thus helping to personalise the tuition,” adds Ng.

Many prototype tools are already available and are expected to be incorporated in various new products and services, which will be made available to both the general public and educational establishments. These are in the process of being validated and refined and the project is inviting music teachers and students to take part in the initial testing phase of the i-Maestro software.

“We are particularly interested in testing the system in real pedagogical situations to see how teachers and students interact with the technology,” confirms Ng. In addition, the ICSRiM - University of Leeds (UK) is organising open lab sessions for people to come and try out the i-Maestro 3D augmented mirror system.

Christian Nielsen | alfa
Further information:
http://cordis.europa.eu/ictresults/index.cfm/section/news/tpl/article/id/89495

More articles from Information Technology:

nachricht UT professor develops algorithm to improve online mapping of disaster areas
29.11.2016 | University of Tennessee at Knoxville

nachricht New standard helps optical trackers follow moving objects precisely
23.11.2016 | National Institute of Standards and Technology (NIST)

All articles from Information Technology >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: Novel silicon etching technique crafts 3-D gradient refractive index micro-optics

A multi-institutional research collaboration has created a novel approach for fabricating three-dimensional micro-optics through the shape-defined formation of porous silicon (PSi), with broad impacts in integrated optoelectronics, imaging, and photovoltaics.

Working with colleagues at Stanford and The Dow Chemical Company, researchers at the University of Illinois at Urbana-Champaign fabricated 3-D birefringent...

Im Focus: Quantum Particles Form Droplets

In experiments with magnetic atoms conducted at extremely low temperatures, scientists have demonstrated a unique phase of matter: The atoms form a new type of quantum liquid or quantum droplet state. These so called quantum droplets may preserve their form in absence of external confinement because of quantum effects. The joint team of experimental physicists from Innsbruck and theoretical physicists from Hannover report on their findings in the journal Physical Review X.

“Our Quantum droplets are in the gas phase but they still drop like a rock,” explains experimental physicist Francesca Ferlaino when talking about the...

Im Focus: MADMAX: Max Planck Institute for Physics takes up axion research

The Max Planck Institute for Physics (MPP) is opening up a new research field. A workshop from November 21 - 22, 2016 will mark the start of activities for an innovative axion experiment. Axions are still only purely hypothetical particles. Their detection could solve two fundamental problems in particle physics: What dark matter consists of and why it has not yet been possible to directly observe a CP violation for the strong interaction.

The “MADMAX” project is the MPP’s commitment to axion research. Axions are so far only a theoretical prediction and are difficult to detect: on the one hand,...

Im Focus: Molecules change shape when wet

Broadband rotational spectroscopy unravels structural reshaping of isolated molecules in the gas phase to accommodate water

In two recent publications in the Journal of Chemical Physics and in the Journal of Physical Chemistry Letters, researchers around Melanie Schnell from the Max...

Im Focus: Fraunhofer ISE Develops Highly Compact, High Frequency DC/DC Converter for Aviation

The efficiency of power electronic systems is not solely dependent on electrical efficiency but also on weight, for example, in mobile systems. When the weight of relevant components and devices in airplanes, for instance, is reduced, fuel savings can be achieved and correspondingly greenhouse gas emissions decreased. New materials and components based on gallium nitride (GaN) can help to reduce weight and increase the efficiency. With these new materials, power electronic switches can be operated at higher switching frequency, resulting in higher power density and lower material costs.

Researchers at the Fraunhofer Institute for Solar Energy Systems ISE together with partners have investigated how these materials can be used to make power...

All Focus news of the innovation-report >>>

Anzeige

Anzeige

Event News

ICTM Conference 2017: Production technology for turbomachine manufacturing of the future

16.11.2016 | Event News

Innovation Day Laser Technology – Laser Additive Manufacturing

01.11.2016 | Event News

#IC2S2: When Social Science meets Computer Science - GESIS will host the IC2S2 conference 2017

14.10.2016 | Event News

 
Latest News

UTSA study describes new minimally invasive device to treat cancer and other illnesses

02.12.2016 | Medical Engineering

Plasma-zapping process could yield trans fat-free soybean oil product

02.12.2016 | Agricultural and Forestry Science

What do Netflix, Google and planetary systems have in common?

02.12.2016 | Physics and Astronomy

VideoLinks
B2B-VideoLinks
More VideoLinks >>>