Researchers at the UAB Department of Basic, Developmental and Educational Psychology have studied the level of comprehension of subtitled television programmes by groups of students who have a severe or profound hearing impairment.
The results demonstrate that deaf children and adolescents have difficulties in following subtitles and images together, due to the speed at which the subtitles appear and the literal transcription of the dialogues. Researchers consider it necessary to review the criteria used in subtitling until now and define new criteria with the aim of offering different types of subtitles (from less to more complex).
After almost twenty years since the first television subtitles were used, professors Cristina Cambra, Núria Silvestre and Aurora Leal, members of the UAB Research Centre on Hearing Impairment and Language Acquisition (GISTAL), were interested in discovering whether deaf viewers - the main users of this service - actually can understand the programmes, find it easy to read subtitles and understand the messages transmitted through the images.
Research work was carried out with the support of the Audiovisual Council of Catalonia (CAC) and the Spanish Ministry for Education and Science (MEC). Participants included students with hearing impairment of different ages and the research focused on the role played by visual, audio, and oral and written information on the screen. Twenty adolescents aged 12 to 19 participated in this study. All of them suffer from either severe or profound hearing impairment, went to municipal schools of the Barcelona province with children who had no hearing impairments, and communicated with others using spoken language with the help of auditory prostheses and by learning how to lip-read.
Participants were asked to explain what was happening in a fragment of the Catalan TV series "El cor de la ciutat". The first viewing was done with no sound, the second with sound and the third with sound and subtitles.
At the end of the first viewing, 30% of participants had a global understanding of what had happened by only watching the images. The percentage increased to 40% after turning on the sound and after adding the subtitles.
According to researchers these figures indicate that for teenagers with hearing impairments, subtitles as they are currently presented are not a good enough resource in helping them understand what a television programme is about. More specifically, researchers verified that the speed at which they appeared and a literal transcription of the dialogues did not give participants time to view the images and reach an overall understanding.
Two more studies were carried out with younger participants: one consisted in a pilot study with seven kids aged 6 and 7, while the other was formed by 16 children aged 7 to 10. Both groups viewed a fragment of the cartoon "Shin-Chan", but the second group was shown the cartoon with subtitles created by the professors themselves (using new speed and text selection criteria). In the first group, only 2% of participants understood what the cartoon was about. In the second group, overall understanding of the fragment reached 65.5%.
These studies show that there is a need to review currently used criteria and define new parameters which take into account information offered by the images, sound and spoken language, as well as the language skills of deaf people. According to research results, two general criteria which should be followed are: firstly, respect for the heterogeneity of the hearing impaired and the possibility to choose from more than one type of subtitle, offering different degrees of language complexity so that each viewer can choose the level that best fits their case. Secondly, and especially in the case of children programmes, it would be advisable to subtitle only essential information that cannot be deduced by the images. In contrast, when the images are explicit enough, e.g. emotional states of the characters, viewers should be able to deduce this information themselves. Therefore, the time spent reading the subtitles can be combined with the time needed to view the images.
According to researchers, an adaptation in subtitles is particularly necessary in the case of deaf children, since they are in the process of learning to read and this is a stage in which subtitles can help to boost their motivation.
They also highlight the fact that television programmes which offer subtitles can be used as an additional educational resource in schools when teaching children to read. It would help both kids with hearing impairments and those without, who may find written language a support tool which helps them understand spoken language. The research carried out by professors Cambra, Silvestre and Leal aims to create teaching and learning material for teachers and parents of deaf children.Reference articles:
"Comprehension of the television message in deaf pupils at various stages of education". Cristina Cambra, Núria Silvestre, Aurora Leal. THE AMERICAN ANNALS OF THE DEAF. In press.
Octavi López Coronado | alfa
Smart Data Transformation – Surfing the Big Wave
02.12.2016 | Fraunhofer-Institut für Angewandte Informationstechnik FIT
Climate change could outpace EPA Lake Champlain protections
18.11.2016 | University of Vermont
A multi-institutional research collaboration has created a novel approach for fabricating three-dimensional micro-optics through the shape-defined formation of porous silicon (PSi), with broad impacts in integrated optoelectronics, imaging, and photovoltaics.
Working with colleagues at Stanford and The Dow Chemical Company, researchers at the University of Illinois at Urbana-Champaign fabricated 3-D birefringent...
In experiments with magnetic atoms conducted at extremely low temperatures, scientists have demonstrated a unique phase of matter: The atoms form a new type of quantum liquid or quantum droplet state. These so called quantum droplets may preserve their form in absence of external confinement because of quantum effects. The joint team of experimental physicists from Innsbruck and theoretical physicists from Hannover report on their findings in the journal Physical Review X.
“Our Quantum droplets are in the gas phase but they still drop like a rock,” explains experimental physicist Francesca Ferlaino when talking about the...
The Max Planck Institute for Physics (MPP) is opening up a new research field. A workshop from November 21 - 22, 2016 will mark the start of activities for an innovative axion experiment. Axions are still only purely hypothetical particles. Their detection could solve two fundamental problems in particle physics: What dark matter consists of and why it has not yet been possible to directly observe a CP violation for the strong interaction.
The “MADMAX” project is the MPP’s commitment to axion research. Axions are so far only a theoretical prediction and are difficult to detect: on the one hand,...
Broadband rotational spectroscopy unravels structural reshaping of isolated molecules in the gas phase to accommodate water
In two recent publications in the Journal of Chemical Physics and in the Journal of Physical Chemistry Letters, researchers around Melanie Schnell from the Max...
The efficiency of power electronic systems is not solely dependent on electrical efficiency but also on weight, for example, in mobile systems. When the weight of relevant components and devices in airplanes, for instance, is reduced, fuel savings can be achieved and correspondingly greenhouse gas emissions decreased. New materials and components based on gallium nitride (GaN) can help to reduce weight and increase the efficiency. With these new materials, power electronic switches can be operated at higher switching frequency, resulting in higher power density and lower material costs.
Researchers at the Fraunhofer Institute for Solar Energy Systems ISE together with partners have investigated how these materials can be used to make power...
16.11.2016 | Event News
01.11.2016 | Event News
14.10.2016 | Event News
02.12.2016 | Medical Engineering
02.12.2016 | Agricultural and Forestry Science
02.12.2016 | Physics and Astronomy