NewsClick

NewsClick
  • हिन्दी
  • Politics
  • Economy
  • Covid-19
  • Science
  • Culture
  • India
  • International
  • Sports
  • Articles
  • Videos
search
menu

INTERACTIVE ELECTION MAPS

image/svg+xml
  • All Articles
  • Newsclick Articles
  • All Videos
  • Newsclick Videos
  • हिन्दी
  • Politics
  • Economy
  • Science
  • Culture
  • India
  • Sports
  • International
  • Africa
  • Latin America
  • Palestine
  • Nepal
  • Pakistan
  • Sri Lanka
  • US
  • West Asia
About us
Subscribe
Follow us Facebook - Newsclick Twitter - Newsclick RSS - Newsclick
close menu
×
For latest updates on nCOVID-19 around the world visit our INTERACTIVE COVID MAP
Science
International

Artificial Intelligence Learns Language Translation Without Human Interference

Two techniques were developed independently which enable neural networks to translate between two languages without the use of a dictionary or human intervention. This has never been done by AI before.
Surangya Kaur
05 Dec 2017
AI

Two teams of computer scientists, one at Facebook, and the other at University of the Basque Country (UPV) in Spain, have made a new breakthrough in translating languages using artificial intelligence. Both groups independently formulated techniques to enable neural networks to translate between two languages without the use of a dictionary or human intervention. Translation has never been done by AI before without training it with translation texts. 

Both the techniques first identify patterns in each language individually. For instance, they recognised word pairs which are common across languages, such as table-chair or shoes-socks. The neural networks then linked these co-occurences in both languages and developed bilingual dictionaries without any human feedback on the accuracy of the translation. Later, these dictionaries were used for translating whole sentences.

Neural networks are powerful machine learning algorithms that imitate the structure of the human brain. These algorithms have been trained to perform a variety of complex tasks, from facial recognition to decision making in games such as chess. But these algorithms require training with huge labelled datasets, similar to how our brain learns to perform a new task by acquiring knowledge about it. For the purpose of translation, a neural network will require some parallel texts for it to learn how to perform translation by itself. Parallel texts consist of translated words and sentences placed along with the text in the original language. 

But these two new papers have demonstrated how a neural network learnt translation without any parallel texts for training, by the process of unsupervised machine learning. 

To translate sentences using the dictionary, the neural networks used two more techniques: back translation and denoising.

Back translation involves a sentence being translated to the required language, and then translated back into the original language. If there are differences between the back-translated sentence and the source sentence, the neural network learns and adjusts itself to make a more accurate translation next time. Denoising follows a similar process, but it also adds some noise to the sentence. The translation is done from one language to the other, then some words are rearranged or removed before it is back-translated into the original language. This essentially takes away the need for human feedback. It also makes the process better than a simple word-for-word translation as it allows the neural network to learn the syntax of both languages, and give better results.

Both papers were published within days of each other and use strikingly similar techniques, and they achieved comparable accuracy. The bilingual evaluation understudy score which is used to measure accuracy of translations was about 15 for both the neural networks. It is lower than humans, who can score more than 50, and also lower than Google Translate, which can score around 40. But Google Translate uses parallel texts and other language data for training. 

Both teams have said that the score for their techniques can go much higher when the algorithms are provided with some parallel texts, making it a semi-supervised approach.    

Get the latest reports & analysis with people's perspective on Protests, movements & deep analytical videos, discussions of the current affairs in your Telegram app. Subscribe to NewsClick's Telegram channel & get Real-Time updates on stories, as they get published on our website.
Artificial Intelligence
Facebook
Translation
Machine Learning
Neural networks
Technology breakthrough
Powerful artificial intelligence
Unsupervised Machine Learning
Related Stories
Google

Google Under Fire in US for Predatory Monopoly Practices

canada social media pipeline

Facebook Blocks Dozens of Accounts just Days Ahead of anti-pipeline Social Media Campaign

Facebook Whistleblower

FB Whistle Blower Confirms How Social Network Benefitted From Fake News, Bots and Misinformation

The tendency to conceal vital information and declare rivals enemies of the state is hurting Indian democracy.

Of Conspiracies and Conspiracy Theories

Ankhi Das, Facebook and Narendra Modi

Report Says Top Facebook Executive Openly Backed Modi on Internal Company Group

Trump's threat to ban TIktok

TikTok Ban and Trump’s Extortionist Policies

Facebook Employees Take on Bosses on Hate Speech Tolerance in India

Facebook Employees Take on Bosses on Hate Speech Tolerance in India

Trump Signs Executive Orders, Bans Popular Chinese Apps TikTok, Wechat

Trump Signs Executive Orders, Bans Popular Chinese Apps TikTok, Wechat

Big Tech

'Titans of Tech' Face Grilling in US Congress

Big tech

Rich Big Tech, Dead Democracy

Share on FacebookShare on TwitterShare on WhatsAppShare via EmailShare on RedditShare on KindlePrint
Share
Share on FacebookShare on TwitterShare on WhatsAppShare via EmailShare on RedditShare on KindlePrint
Share

Related Stories

PTI

15 Democratic Senators ask Facebook to Take Action to Check Anti-Muslim Bigotry

17 November 2020
Washington: A group of 15 influential Democratic sen
K Raveendran

Ankhi Das’s Exit from Facebook Is Not Enough for Indian Users

01 November 2020
While Ankhi Das’s exit may seem like the end of saffronisation of the social media giant, the root of the problem if much deeper that goes to d
Steven Hill

Can Facebook be Used to Steal an Election?

31 October 2020
What a year.

Pagination

  • Next page ››

More

  • 100 Former Civil Servants Raise Questions on Transparency in PM-CARES Fund

    100 Former Civil Servants Raise Questions on Transparency in PM-CARES Fund

  • Andhra Pradesh: Anantapur Farmers Protest Against Real Estate on Land Acquired for Industries

    Andhra Pradesh: Anantapur Farmers Protest Against Real Estate on Land Acquired for Industries

  • Too Little Too Late: Former MP on Chit Fund ‘Moghul’ KD Singh’s Arrest

    Too Little Too Late: Former MP on Chit Fund ‘Moghul’ KD Singh’s Arrest

  • Bihar: Thousands of Truck Join Indefinite Strike Against Govt Policy

    Bihar: Thousands of Truck Join Indefinite Strike Against Govt Policy

  • Load More
Subscribe
connect with
about