Gentle Introduction to Statistical Language Modeling and Neural Language Models
Last Updated on August 7, 2019
Language modeling is central to many important natural language processing tasks.
Recently, neural-network-based language models have demonstrated better performance than classical methods both standalone and as part of more challenging natural language processing tasks.
In this post, you will discover language modeling for natural language processing.
After reading this post, you will know:
- Why language modeling is critical to addressing tasks in natural language processing.
- What a language model is and some examples of where they are used.
- How neural networks can be used for language modeling.
Kick-start your project with my new book Deep Learning for Natural Language Processing, including step-by-step tutorials and the Python source code files for all examples.
Let’s get started.
- Updated Jun/2019: Added links to step-by-step language model tutorials.
Gentle Introduction to Statistical Language Modeling and Neural Language Models
Photo by Chris Sorge, some rights reserved.
Overview
This post is divided into 3 parts; they are:
- Problem of Modeling Language
- Statistical Language Modeling
- Neural Language
To finish reading, please visit source site