Language Translation with Transformer In Python!
Introduction
Natural Language Processing (NLP) is a field at the convergence of artificial intelligence, and linguistics. The aim is to make the computers understand real-world language or natural language so that they can perform tasks like Question Answering, Language Translation, and many more.
NLP has lots of applications in different fields.
1. NLP enables the recognition and prediction of diseases based on electronic health records.
2. It is used to obtain customer reviews.
3. To help to identify fake news.
4. Chatbots.
5. Social Media monitoring etc.
What is the Transformer?
The Transformer model architecture was introduced by Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser and Illia Polosukhin in their paper “Attention Is All You Need”. [1]
The Transformer model extracts the features for each word using a self-attention mechanism to know the importance of each word in the sentence. No other recurrent units are used to extract this feature, they