Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

Machine translation: going beyond sentence by sentence

03.04.2017

In working sentence by sentence, translation algorithms omit much of the context and make mistakes. A project supported by the SNSF has developed new algorithmic techniques designed to do a better job of taking the entire text into account.

Researchers supported by the Swiss National Science Foundation (SNSF) have come up with a new approach to improving machine translation tools such as the famous Google Translate, which processes hundreds of billions of words daily.

The computer scientists and linguists were the first to show that it is possible to improve translation systems by forcing artificial intelligence to go beyond simple “sentence by sentence” techniques. Instead, the algorithms track information contained elsewhere in the text, an approach that is currently being studied the world over. The scientists will be revealing their latest results (*) on 3 April 2017 during an Association for Computational Linguistics conference in Valencia (Spain).

Translating without understanding

“Machine translation systems don’t really understand the meaning of a text,” explains Andrei Popescu-Belis, who heads up the project as well as the Natural Language Processing Group at the Idiap Research Institute in Martigny (VS). They render one language into another according to statistical rules. And in particular, they proceed sentence by sentence. But isolated sentences frequently don’t carry enough information about the context to ensure a correct translation. The systems need to be able to take into account information in other parts of the text.”

To demonstrate their approach, the researchers settled on the question of pronouns – words like “she” or “it,” which replace other elements in the text. Often, these elements are located outside the sentence being translated, which explains the high number of errors made by machine translation systems.

Popescu-Belis provides a simple example that easily trips up the most sophisticated systems: “Ma tante a acheté une excellente voiture. Elle n’est pas très jolie.” In English, Google Translate renders this pair of sentences as “My aunt bought an excellent car. But she is not very pretty.” The tool has translated “elle” into “she.” But because this pronoun is reserved for female persons, the English-speaking reader will have the impression that it is “my aunt” who “is not very pretty.”

The statistical trap

The system has made an error because it knows that the qualifier “not very pretty” applies more frequently to people than to objects. If the qualifier is replaced by “rusty” or “broken down”, the chances are greater that the pronoun “elle” will be correctly translated by “it”.

To obtain a relevant result, automatic translation would have to consider the information contained in the first sentence. That, in a nutshell, is the approach of the system developed by the Idiap researchers together with the Departments of Linguistics at the Universities of Geneva and Utrecht (Netherlands), and the Institute of Computational Linguistics at the University of Zurich.

The researchers employ machine learning tools. During each test, they introduce or remove hundreds of parameters, which the algorithms refine, until an improvement is noted. “Put broadly, we tell the system the number of preceding sentences that it must analyse, how it must analyse them and then we proceed to testing under real conditions.”

A recruitment pool for Google

The results are encouraging, says Popescu-Belis. In language pairs like French-English or Spanish-English, pronouns lead machine translation systems to make errors about half of the time. “By forcing the system to consider information across sentences, we have managed to reduce the error rate to 30%,” says Popescu-Belis.

The implications of this research go far beyond the question of pronouns: sequence of verb tenses, word choice and register all pose challenges whose solution depends largely on the entire text as opposed to isolated sentences.

The techniques developed by Popescu-Belis and his colleagues are not yet ready for off-the-shelf tools, but they are of interest to practitioners and others in the field. “Our work has shown the necessity of going beyond sentence-by-sentence machine translation. But most important, three young researchers involved in the project are now working in the area at Google Zurich. That just goes to show the interest our approach has generated.”

Contact

Andrei Popescu-Belis
Idiap Research Institute
Centre du Parc, CP 592
1920 Martigny
Phone.: +41 27 721 77 29
E-mail: andrei.popescu-belis@idiap.ch

* * * * *

Project “MODERN” in the SNSF project database > http://p3.snf.ch/project-147653

(*) N. Q. Luong and A. Popescu-Belis: Machine translation of Spanish personal and possessive pronouns using anaphora probabilities. Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics (EACL), Valencia, 5-7 April 2017. pdf > http://publications.idiap.ch/downloads/papers/2017/Luong_EACL_2017.pdf

(*) X. Pu, L. Mascarell and A. Popescu-Belis: Consistent Translation of Repeated Nouns using Syntactic and Semantic Cues. Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics (EACL), Valencia, 5-7 April 2017. pdf > http://publications.idiap.ch/downloads/papers/2017/Pu_EACL_2017.pdf

(*) L. Miculicich Werlen and A. Popescu-Belis: Using Coreference Links to Improve Spanish-to-English Machine Translation. Proceedings of the EACL Workshop on Coreference Resolution beyond OntoNotes (CORBON), Valencia, 4 April 2017. pdf > http://publications.idiap.ch/downloads/papers/2017/Werlen_CORBON_2017.pdf

(*) A. R. Gonzales and D. Tuggener: Co-reference Resolution of Elided Subjects and Possessive Pronouns in Spanish-English Statistical Machine Translation. Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics (EACL), Valencia, 5-7 April 2017. pdf > http://www.zora.uzh.ch/136447/1/CoReferenceAwareMT.pdf

Weitere Informationen:

http://www.snf.ch/en/researchinFocus/newsroom/Pages/news-170403-press-release-ma... 'The text of this press release is available online'

Medien - Abteilung Kommunikation | idw - Informationsdienst Wissenschaft

Further reports about: Computational Linguistics Google Linguistics SNF machine translation

More articles from Information Technology:

nachricht Cloud technology: Dynamic certificates make cloud service providers more secure
15.01.2018 | Technische Universität München

nachricht New discovery could improve brain-like memory and computing
10.01.2018 | University of Minnesota

All articles from Information Technology >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: Artificial agent designs quantum experiments

On the way to an intelligent laboratory, physicists from Innsbruck and Vienna present an artificial agent that autonomously designs quantum experiments. In initial experiments, the system has independently (re)discovered experimental techniques that are nowadays standard in modern quantum optical laboratories. This shows how machines could play a more creative role in research in the future.

We carry smartphones in our pockets, the streets are dotted with semi-autonomous cars, but in the research laboratory experiments are still being designed by...

Im Focus: Scientists decipher key principle behind reaction of metalloenzymes

So-called pre-distorted states accelerate photochemical reactions too

What enables electrons to be transferred swiftly, for example during photosynthesis? An interdisciplinary team of researchers has worked out the details of how...

Im Focus: The first precise measurement of a single molecule's effective charge

For the first time, scientists have precisely measured the effective electrical charge of a single molecule in solution. This fundamental insight of an SNSF Professor could also pave the way for future medical diagnostics.

Electrical charge is one of the key properties that allows molecules to interact. Life itself depends on this phenomenon: many biological processes involve...

Im Focus: Paradigm shift in Paris: Encouraging an holistic view of laser machining

At the JEC World Composite Show in Paris in March 2018, the Fraunhofer Institute for Laser Technology ILT will be focusing on the latest trends and innovations in laser machining of composites. Among other things, researchers at the booth shared with the Aachen Center for Integrative Lightweight Production (AZL) will demonstrate how lasers can be used for joining, structuring, cutting and drilling composite materials.

No other industry has attracted as much public attention to composite materials as the automotive industry, which along with the aerospace industry is a driver...

Im Focus: Room-temperature multiferroic thin films and their properties

Scientists at Tokyo Institute of Technology (Tokyo Tech) and Tohoku University have developed high-quality GFO epitaxial films and systematically investigated their ferroelectric and ferromagnetic properties. They also demonstrated the room-temperature magnetocapacitance effects of these GFO thin films.

Multiferroic materials show magnetically driven ferroelectricity. They are attracting increasing attention because of their fascinating properties such as...

All Focus news of the innovation-report >>>

Anzeige

Anzeige

Event News

10th International Symposium: “Advanced Battery Power – Kraftwerk Batterie” Münster, 10-11 April 2018

08.01.2018 | Event News

See, understand and experience the work of the future

11.12.2017 | Event News

Innovative strategies to tackle parasitic worms

08.12.2017 | Event News

 
Latest News

Let the good tubes roll

19.01.2018 | Materials Sciences

How cancer metastasis happens: Researchers reveal a key mechanism

19.01.2018 | Health and Medicine

Meteoritic stardust unlocks timing of supernova dust formation

19.01.2018 | Physics and Astronomy

VideoLinks
B2B-VideoLinks
More VideoLinks >>>