Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

Hands on learning for the visually impaired

06.06.2008
European researchers have made it easy for software developers to build educational tools that let pupils collaborate to see, hear – and now also feel – what is on the computer screen.

When you think of the solar system you probably picture a textbook diagram: nine planets, different sizes and colours, all circling the bright yellow sun. But how can a visually impaired child take in this information? How can they grasp how the solar system works?

European researchers have developed a computer program that lets sighted and visually impaired pupils explore space together. Using a special device similar to a robotic arm, a visually impaired child can move around the solar system and hear about the planets.

Sighted children can guide their visually impaired partners. As they move the mouse, the pressure and resistance in the robot arm gently nudges the visually impaired user in the right direction.

Students colloborate in hands on learning the Micole way.

The space explorer is just one of many applications developed by the EU-funded MICOLE project which is bringing multi-modal interfaces into the classroom.

The software is one of the first releases of multi-modal educational computer programs. It allows sighted children and the visually impaired to collaborate, helping to remove some of the barriers that the latter group faces every day in mainstream education.

Multi-modal computing is on the rise. Soon a third sense could be added to the sight and sound that computers currently use as their mode of output. Haptic devices, such as the robot arm, enable users to control computers as if they were using a mouse. Such devices also provide output – of movement, pressures or even raised bumps to deliver information to the user via the sense of touch.

This output is exploited in another MICOLE application. Current software drawing software allows pupils to create pictures, but the lines are in relief.

Using the haptic device, they can actually feel the picture. As they move a virtual stylus over the picture on the screen the pupils can sense the raised lines through the device communicated to their fingertips.

Collaborative design

“These applications have been very welcomed in our test classrooms,” says project coordinator Roope Raisamo. “It has been wonderful to see visually impaired and sighted children really working together and sharing the same experiences and opportunities.

“Our aim was to allow blind people to create, manipulate and share information using hearing and touch to replace use of vision, and to work with other blind and sighted people. We want to see visually impaired people take a full role in society and work at an equal level with sighted people.”

Before MICOLE, very little was known about how multi-modality could be used when blind people work alongside those with full sight. But through its user-centred approach – lots of observation, focus groups, consultation and field-testing – the MICOLE partners have greatly added to our understanding about such collaborative work.

“Adding the sense of touch to information and communication technology is just getting to the point where it can be commercialised,” Raisamo continues. “The first people to benefit are people with disabilities, especially people who are blind or have visual impairment. The more senses you can use, the more multi-modal your computer interface, the more inclusive the technology can be.”

Much of the knowledge that the team has built up during the project's three years have been incorporated into guidelines for software developers on how to develop successful applications for collaborative learning.

Raisamo believes the project has increased the potential for successful commercialisation of multi-modal software in all fields.

A feeling for the future

MICOLE’s researchers have done far more than publish theoretical documents and produce a few prototype applications. Their main output comes in the form of the ‘MICOLE architecture’ and an accompanying software development toolkit. The architecture is like a high level programming language. It provides the virtual environment – all the processes and mechanisms for software applications to function in a multi-modal fashion.

It is designed so that software developers can quickly build new multi-modal applications for the visually impaired and can be used for applications in widespread disciplines including medicine, education or ‘edutainment’.

“We've made it an open source architecture to encourage more people to access it, spread it, and adapt it for their own requirements without worrying about licenses or intellectual property,” says Raisamo.

So far 14 organisations from outside the project have downloaded the architecture and toolkit files in the first six months since these were made available for download on the project's website.

“This is encouraging,” Raisamo says. “We know that several groups are working on new applications and we hope that the market will take off soon.”

Reachin Technology, a key MICOLE partner and a distributor of the haptic robot device, could be one of the first to sell multi-modal software based on MICOLE’s research.

Fully functional

Multi-modal interfaces can support people with many disabilities because if one of the modalities is missing, the system remains usable.

“If multi-modal applications are used widely and match the needs of different users, they could narrow the gap between sighted and impaired children,” says Raisamo.

MICOLE, which received funding from the EU's Sixth Framework Programme for research, ended in August 2007. However, the partners involved continue to push research and development in the field.

Raisamo's team is currently working with local schools to develop new applications based on the architecture – one that explores physical phenomena, another the natural sciences.

Ahmed ElAmin | alfa
Further information:
http://cordis.europa.eu/ictresults/index.cfm/section/news/tpl/article/BrowsingType/Features/ID/89780

More articles from Information Technology:

nachricht Deep Learning predicts hematopoietic stem cell development
21.02.2017 | Helmholtz Zentrum München - Deutsches Forschungszentrum für Gesundheit und Umwelt

nachricht Sensors embedded in sports equipment could provide real-time analytics to your smartphone
16.02.2017 | University of Illinois College of Engineering

All articles from Information Technology >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: Breakthrough with a chain of gold atoms

In the field of nanoscience, an international team of physicists with participants from Konstanz has achieved a breakthrough in understanding heat transport

In the field of nanoscience, an international team of physicists with participants from Konstanz has achieved a breakthrough in understanding heat transport

Im Focus: DNA repair: a new letter in the cell alphabet

Results reveal how discoveries may be hidden in scientific “blind spots”

Cells need to repair damaged DNA in our genes to prevent the development of cancer and other diseases. Our cells therefore activate and send “repair-proteins”...

Im Focus: Dresdner scientists print tomorrow’s world

The Fraunhofer IWS Dresden and Technische Universität Dresden inaugurated their jointly operated Center for Additive Manufacturing Dresden (AMCD) with a festive ceremony on February 7, 2017. Scientists from various disciplines perform research on materials, additive manufacturing processes and innovative technologies, which build up components in a layer by layer process. This technology opens up new horizons for component design and combinations of functions. For example during fabrication, electrical conductors and sensors are already able to be additively manufactured into components. They provide information about stress conditions of a product during operation.

The 3D-printing technology, or additive manufacturing as it is often called, has long made the step out of scientific research laboratories into industrial...

Im Focus: Mimicking nature's cellular architectures via 3-D printing

Research offers new level of control over the structure of 3-D printed materials

Nature does amazing things with limited design materials. Grass, for example, can support its own weight, resist strong wind loads, and recover after being...

Im Focus: Three Magnetic States for Each Hole

Nanometer-scale magnetic perforated grids could create new possibilities for computing. Together with international colleagues, scientists from the Helmholtz Zentrum Dresden-Rossendorf (HZDR) have shown how a cobalt grid can be reliably programmed at room temperature. In addition they discovered that for every hole ("antidot") three magnetic states can be configured. The results have been published in the journal "Scientific Reports".

Physicist Dr. Rantej Bali from the HZDR, together with scientists from Singapore and Australia, designed a special grid structure in a thin layer of cobalt in...

All Focus news of the innovation-report >>>

Anzeige

Anzeige

Event News

Booth and panel discussion – The Lindau Nobel Laureate Meetings at the AAAS 2017 Annual Meeting

13.02.2017 | Event News

Complex Loading versus Hidden Reserves

10.02.2017 | Event News

International Conference on Crystal Growth in Freiburg

09.02.2017 | Event News

 
Latest News

Stingless bees have their nests protected by soldiers

24.02.2017 | Life Sciences

New risk factors for anxiety disorders

24.02.2017 | Life Sciences

MWC 2017: 5G Capital Berlin

24.02.2017 | Trade Fair News

VideoLinks
B2B-VideoLinks
More VideoLinks >>>