Issue #131 – Measuring and Increasing Context Usage in Context-Aware NMT
20 May21
Issue #131 – Measuring and Increasing Context Usage in Context-Aware NMT
Author: Dr. Patrik Lambert, Senior Machine Translation Scientist @ Iconic
Introduction
Context-aware neural machine translation (NMT) is a topic which has often been covered in this blog, for its application to domain adaptation or document-level NMT (see issues #15, #31, #34, #39, #98, #128). However, most papers on context-aware NMT present approaches which have the ability to leverage context information, but they don’t measure how much of this information they actually use at translation time. Today we take a look at a paper by Fernandes et al. (2021) which introduces a