Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:


Technology to improve learning for visually-impaired children


Supporting learning for blind and visually-impaired children in schools is the goal of a system that offers collaboration, data exploration, communication and creativity based on a common software architecture. Already interfaces and application prototypes are being tested.

Partners in the IST programme-funded MICOLE project, the teams responsible are working in close contact with national and local associations and organisations of visually-disabled persons, as well as schools. Their main task is to design the system itself. However, project coordinator Roope Raisamo, University of Tampere, Finland, describes several supporting activities emphasising users and their real needs.

“We are experimenting with how to use different senses to partially replace missing visual capabilities, especially in tasks that are central in the construction of the system,” he says. “Empirical research of collaborative and cross-modal haptic interfaces for visually-impaired children is one of the most important research activities.”

Haptic technology interfaces with the user through the sense of touch. This emerging technology adds the sense of touch to previously visual-only solutions. MICOLE’s software architecture and applications are multimodal, that is, they use hearing and touch to complement different levels of visual disability.

Their work extends beyond developing an assistive tool. “In addition to MICOLE’s immediate value as a tool, the system will have societal implications by improving the inclusion of the visually disabled in education, work and society in general,” explains Raisamo.

Initial field studies involved interviews with teachers, children and related user organisations as well as observations of actual group work in schools. The objective was to determine how visually-impaired children collaborate in school with peers and teachers, and to understand to what extent they engage in group work.

“The interaction among the pupils, with teachers and with their peers is very important for learning,” says Raisamo. “We know that collaborative learning has benefits because the pupils learn through a dialogue with their peers and construct their own knowledge by doing tasks together with others.”

Field study results from Austria, Finland, France, Greece, Ireland, Lithuania, Sweden and the UK showed major differences in the education of visually-impaired children, however, they revealed many similarities regarding aspects of collaboration. Based on these results, a prototyping workshop was held in Stockholm where the school situation for such pupils was addressed. Various hapitc and auditory applications developed within MICOLE were assessed and new designs formulated.

He notes there are no specific requirements for the users of the system. “The system adapts to the users. It is aimed at visually-impaired children, but because it facilitates collaboration among sighted and visually-impaired children, it also supports sighted children.”

A multimodal system with visual, audio and haptic feedback can support many kinds of users with disabilities because missing one of the modalities does not make the system unusable, Raisamo adds.

Project partners have developed or tested 16 different interfaces and application prototypes, such as explorative learning of the earth’s internal layers, rhythm reproduction, a tactile maze game, virtual maracas (percussion instruments), post-its with a haptic barcode, an electric circuit browser, a haptic simon game, memory games, a haptic turtle and a haptic game of the classic first video game, pong.

For example, to better teach natural phenomenon, such as seasons, gravity and the solar system, project partners constructed a system using proactive agents that offer the pupil help when necessary. The user decides whether to accept help comprised of visual, auditory and haptic feedback to present content.

Project partners include European and world leaders in the area of haptics and multimodal-human-computer interaction. For example, Reachin Technologies AB is a world leader in haptic technology; France Telecom has experience in developing applications for the blind.

“MICOLE offers an outstanding opportunity and the critical mass for the consortium to integrate and realise results of their earlier work and to test the most novel ideas to meet the needs of the visually impaired,” says Raisamo. “The results are expected to make a valuable European contribution to the development of the information society and real-world equality for visually-disabled children, empowering them as future citizens.”

The multimodal software architecture to create new applications is under construction. Scientific results from multimodal navigation and cross-modal presentation of information are being fed in to the team’s work. The three-year project is scheduled to end in August 2007.

Tara Morris | alfa
Further information:

More articles from Information Technology:

nachricht TIB’s Visual Analytics Research Group to develop methods for person detection and visualisation
19.03.2018 | Technische Informationsbibliothek (TIB)

nachricht Green Light for Galaxy Europe
15.03.2018 | Albert-Ludwigs-Universität Freiburg im Breisgau

All articles from Information Technology >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: Tiny implants for cells are functional in vivo

For the first time, an interdisciplinary team from the University of Basel has succeeded in integrating artificial organelles into the cells of live zebrafish embryos. This innovative approach using artificial organelles as cellular implants offers new potential in treating a range of diseases, as the authors report in an article published in Nature Communications.

In the cells of higher organisms, organelles such as the nucleus or mitochondria perform a range of complex functions necessary for life. In the networks of...

Im Focus: Locomotion control with photopigments

Researchers from Göttingen University discover additional function of opsins

Animal photoreceptors capture light with photopigments. Researchers from the University of Göttingen have now discovered that these photopigments fulfill an...

Im Focus: Surveying the Arctic: Tracking down carbon particles

Researchers embark on aerial campaign over Northeast Greenland

On 15 March, the AWI research aeroplane Polar 5 will depart for Greenland. Concentrating on the furthest northeast region of the island, an international team...

Im Focus: Unique Insights into the Antarctic Ice Shelf System

Data collected on ocean-ice interactions in the little-researched regions of the far south

The world’s second-largest ice shelf was the destination for a Polarstern expedition that ended in Punta Arenas, Chile on 14th March 2018. Oceanographers from...

Im Focus: ILA 2018: Laser alternative to hexavalent chromium coating

At the 2018 ILA Berlin Air Show from April 25–29, the Fraunhofer Institute for Laser Technology ILT is showcasing extreme high-speed Laser Material Deposition (EHLA): A video documents how for metal components that are highly loaded, EHLA has already proved itself as an alternative to hard chrome plating, which is now allowed only under special conditions.

When the EU restricted the use of hexavalent chromium compounds to special applications requiring authorization, the move prompted a rethink in the surface...

All Focus news of the innovation-report >>>



Industry & Economy
Event News

Virtual reality conference comes to Reutlingen

19.03.2018 | Event News

Ultrafast Wireless and Chip Design at the DATE Conference in Dresden

16.03.2018 | Event News

International Tinnitus Conference of the Tinnitus Research Initiative in Regensburg

13.03.2018 | Event News

Latest News

Virtual reality conference comes to Reutlingen

19.03.2018 | Event News

TIB’s Visual Analytics Research Group to develop methods for person detection and visualisation

19.03.2018 | Information Technology

Tiny implants for cells are functional in vivo

19.03.2018 | Interdisciplinary Research

Science & Research
Overview of more VideoLinks >>>