Issue #89 – Norm-Based Curriculum Learning for Neural Machine Translation

09 Jul20 Issue #89 – Norm-Based Curriculum Learning for Neural Machine Translation Author: Dr. Patrik Lambert, Senior Machine Translation Scientist @ Iconic Introduction Neural machine translation (NMT) models benefit from large amounts of data. However in high resource conditions, training these models is computationally expensive. In this post we take a look at a paper from Liu et al. (2020) aiming at improving the efficiency of training by introducing a curriculum learning method based on the word embedding norm. The […]

Read more