Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

Music maestro! Bringing out the conductor in you

06.02.2008
New information and communications technologies are rapidly transforming our lives in many areas. A new European research project is looking at ways of harnessing technological advances to make musical education more accessible and enhance teaching practices.

The traditional method of teaching music is based on verbal feedback from the teacher and relatively short teacher-pupil contact. New technologies provide opportunities to extend the options available to both students and teachers, and to develop new pedagogical tools which could enhance the learning experience – either by providing alternative forms of feedback or by offering access to interactive training materials during and outside the lesson itself.

The i-Maestro project is currently investigating different ways in which ICT tools can be harnessed to improve music training in both theory and practice, and exploring the potential of interactive multimedia environments for technology enhanced learning.

Mirror, mirror, ...
“One of the areas we are looking at is gesture analysis,” says project coordinator Dr Kia Ng. “The ‘i-Maestro 3D Augmented Mirror’ we developed uses motion-capture technology to provide interactive feedback to the musician on their bowing technique and posture, which can greatly affect the quality of sound produced.”

Twelve infrared cameras capture the performer’s movements in 3D with synchronised audio and video recordings. The software analyses the motion data and provides multi-modal feedback using visual and auditory displays.

“A performed gesture can be compared with a set of pre-recorded gestures which allows both the teacher and the student to see clearly every detailed nuance of posture and bowing technique,” notes Ng.

This also has implications for professional musicians who frequently suffer from career threatening injury, much of which can be traced back to bad posture. Dr Ng believes that the use of 3D imagery and sensor technologies could have a beneficial impact for many musicians and make it much easier for teachers to spot potential problems.

3D motion capture is still relatively expensive but facilities can be hired and the EU-funded project is working to develop a more economic sensor-based interface.

Knowing the score
Another area being looked at is ways of presenting and accessing the musical score. i-Maestro is extending and developing MPEG Symbolic Music Representation (SMR) to help integrate multimedia functions and musical score information. MPEG SMR is being used to support new, improved pedagogical tools for interactive home learning, as well as for use in classroom situations. It is also be used to improve the accessibility of music to those with visual or other impairments.

The ‘score follower’, for example, is able to ‘listen’ to the player and track his/her location within the score, allowing functions such as automated page turning, or simply following the score of a piece of music as it is being played. Taking it a stage further, the ‘score follower’ could allow functions like musical accompaniment, where a backing track can be synchronised to the musician’s performance.

“Learning and playing with others is a key part of musical education,” notes Ng. “However, access to this kind of experience may be limited. The technologies we are developing, such as the cooperative environment, could help make it much more accessible – at least in virtual terms.”

Virtual music school
Part of the project’s work focuses more particularly on music education in schools and the provision of novel tools for teachers and students in a networked school context. The ‘School Server’ is being developed and tested as a key resource, providing online access to lesson materials and various shared tools: metronome, tuner, various collaborative tools, an MPEG SMR viewer, and others.

Students will also be able to access exercise materials from home and teachers will be able to gather practice data from students and so monitor their work virtually.

As a further tool for teachers, the ‘exercise generator’ will support the (semi-)automated creation of exercises. “Teachers will be able to create teaching material corresponding to the level of a student, or a group of students, in a simple way, thus helping to personalise the tuition,” adds Ng.

Many prototype tools are already available and are expected to be incorporated in various new products and services, which will be made available to both the general public and educational establishments. These are in the process of being validated and refined and the project is inviting music teachers and students to take part in the initial testing phase of the i-Maestro software.

“We are particularly interested in testing the system in real pedagogical situations to see how teachers and students interact with the technology,” confirms Ng. In addition, the ICSRiM - University of Leeds (UK) is organising open lab sessions for people to come and try out the i-Maestro 3D augmented mirror system.

Christian Nielsen | alfa
Further information:
http://cordis.europa.eu/ictresults/index.cfm/section/news/tpl/article/id/89495

More articles from Information Technology:

nachricht Deep Learning predicts hematopoietic stem cell development
21.02.2017 | Helmholtz Zentrum München - Deutsches Forschungszentrum für Gesundheit und Umwelt

nachricht Sensors embedded in sports equipment could provide real-time analytics to your smartphone
16.02.2017 | University of Illinois College of Engineering

All articles from Information Technology >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: Breakthrough with a chain of gold atoms

In the field of nanoscience, an international team of physicists with participants from Konstanz has achieved a breakthrough in understanding heat transport

In the field of nanoscience, an international team of physicists with participants from Konstanz has achieved a breakthrough in understanding heat transport

Im Focus: DNA repair: a new letter in the cell alphabet

Results reveal how discoveries may be hidden in scientific “blind spots”

Cells need to repair damaged DNA in our genes to prevent the development of cancer and other diseases. Our cells therefore activate and send “repair-proteins”...

Im Focus: Dresdner scientists print tomorrow’s world

The Fraunhofer IWS Dresden and Technische Universität Dresden inaugurated their jointly operated Center for Additive Manufacturing Dresden (AMCD) with a festive ceremony on February 7, 2017. Scientists from various disciplines perform research on materials, additive manufacturing processes and innovative technologies, which build up components in a layer by layer process. This technology opens up new horizons for component design and combinations of functions. For example during fabrication, electrical conductors and sensors are already able to be additively manufactured into components. They provide information about stress conditions of a product during operation.

The 3D-printing technology, or additive manufacturing as it is often called, has long made the step out of scientific research laboratories into industrial...

Im Focus: Mimicking nature's cellular architectures via 3-D printing

Research offers new level of control over the structure of 3-D printed materials

Nature does amazing things with limited design materials. Grass, for example, can support its own weight, resist strong wind loads, and recover after being...

Im Focus: Three Magnetic States for Each Hole

Nanometer-scale magnetic perforated grids could create new possibilities for computing. Together with international colleagues, scientists from the Helmholtz Zentrum Dresden-Rossendorf (HZDR) have shown how a cobalt grid can be reliably programmed at room temperature. In addition they discovered that for every hole ("antidot") three magnetic states can be configured. The results have been published in the journal "Scientific Reports".

Physicist Dr. Rantej Bali from the HZDR, together with scientists from Singapore and Australia, designed a special grid structure in a thin layer of cobalt in...

All Focus news of the innovation-report >>>

Anzeige

Anzeige

Event News

Booth and panel discussion – The Lindau Nobel Laureate Meetings at the AAAS 2017 Annual Meeting

13.02.2017 | Event News

Complex Loading versus Hidden Reserves

10.02.2017 | Event News

International Conference on Crystal Growth in Freiburg

09.02.2017 | Event News

 
Latest News

Stingless bees have their nests protected by soldiers

24.02.2017 | Life Sciences

New risk factors for anxiety disorders

24.02.2017 | Life Sciences

MWC 2017: 5G Capital Berlin

24.02.2017 | Trade Fair News

VideoLinks
B2B-VideoLinks
More VideoLinks >>>