The State of Transfer Learning in NLP
Update 16.10.2020: Added Chinese and Spanish translations.
This post expands on the NAACL 2019 tutorial on Transfer Learning in NLP. The tutorial was organized by Matthew Peters, Swabha Swayamdipta, Thomas Wolf, and me. In this post, I highlight key insights and takeaways and provide updates based on recent work. You can see the structure of this post below:
The slides, a Colaboratory notebook, and code of the tutorial are available online.
For an overview of what transfer learning is, have a look at this blog post. Our go-to definition throughout this post will be the following,