Hugging Face Releases New NLP ‘Tokenizers’ Library Version (v0.8.0)
Hugging Face is at the forefront of a lot of updates in the NLP space. They have released one groundbreaking NLP library after another in the last few years. Honestly, I have learned and improved my own NLP skills a lot thanks to the work open-sourced by Hugging Face. And today, they’ve released another big update – a brand new version of their popular Tokenizer library. A Quick Introduction to Tokenization So, what is tokenization? Tokenization is a crucial […]
Read more