Deep Learning, NLP, NMT, AI, ML
Problem with Bag of Words: A problem with the Bag of Words approach is that highly frequent words start to dominate in the document (e.g. larger score), but may not contain as much “informational content”. Also, it will give more weight to longer documents than shorter documents. TFIDF or Term Frequency-Inverse Document Frequency indicates the importance
Read more
Authors Note: This piece was originally published by the author in November 2020 on translatingnerd.com
Read more
Comparison of Annotation Tools
Read moreLast Updated: 17 Oct 2022 I was lucky enough to get a seat in the 2-day FREE virtual masterclass on “NLP Foundation workshop”, conducted by Dr. Yogendra Singh Rathore (YSR). The total session lasted more than 5 hours. It helped me to understand how our brain works and how to deal with its
Read moreYou don’t need to be a math whiz to program well. The truth is, few programmers need to know more than basic algebra. Of course, how much math you need to know depends on the application you’re working on. In general, the level of math required to be a programmer is lower than you might expect. Although math and computer programming aren’t as correlated as some people might believe, numbers are an integral part of any programming language, and Python […]
Read more
SAS and Python can be used together instead of just as separate entities. The code in the example can be found in this Github repository. One of the common notes from recent graduates is that open source software, including Python, is being taught in school much
Read more
Life of Data Scientist — CSV
Read more
When we think about Data Engineering, ETL is the powerhouse and a core building block of most Data Warehouses. And while it is becoming a popular subject among all and is as simple as it sounds, an inside look in its processes is often something that most don’t mention about. If we peek at the first step of ETL, i.e. the Extraction of Data, it is a very important and crucial process. Until and unless you have the correct and […]
Read more
Although regular expressions are great for pattern matching in general, sometimes it’s easier to use an HTML parser that’s explicitly designed for parsing out HTML pages. There are many Python tools written for this purpose, but the Beautiful Soup library is a good one to start with. Install Beautiful Soup To install Beautiful Soup, you can run the following in your terminal: $ python -m pip install beautifulsoup4 With this command, you’re installing the latest version of Beautiful Soup into […]
Read more