Issue #111 – How can test suites be used to evaluate MT quality?

10 Dec20 Issue #111 – How can test suites be used to evaluate MT quality? Author: Dr. Carla Parra Escartín, Global Program Manager @ Iconic Introduction The pursuit of finding a way to evaluate Machine Translation (MT) accurately has resulted in a vast number of publications over the years. This is indicative of the difficulty of the task. Researchers keep searching for the magic formula that can accurately depict if MT output is good or bad. At Iconic, we are […]

Issue #104 – Using Test Sets to Evaluate Machine Translation

22 Oct20 Issue #104 – Using Test Sets to Evaluate Machine Translation Author: Dr. Karin Sim, Machine Translation Scientist @ Iconic Introduction There is finally a growing acceptance in some circles that evaluation of Machine Translation (MT) is lagging behind progress in Neural MT (NMT). Especially with regards to metrics such as BLEU, there is a recognition that “as NMT continues to improve, these metrics will inevitably lose their effectiveness” (Isabelle et al., 2017). In today’s blog post, we look […]