Natural Language Processing

A method to pre-train general purpose natural language models

TunBERT People in Tunisia use the Tunisian dialect in their daily communications, in most of their media (TV, radio, songs, etc), and on the internet (social media, forums). Yet, this dialect is not standardized which means there is no unique way for writing and speaking it. Added to that, it has its proper lexicon, phonetics, and morphological structures. The need for a robust language model for the Tunisian dialect has become crucial in order to develop NLP-based applications (translation, information […]

Read more
Network

Group Fisher Pruning for Practical Network Compression

FisherPruning Group Fisher Pruning for Practical Network Compression(ICML2021) NOTES All models about detection has been released. The classification models will be released later, because we want to refactor all our code into a Hook , so that it can become a more general tool for all tasks in OpenMMLab. We will continue to improve this method and apply it to more other tasks, such as segmentation and pose. The layer grouping algorithm is implemtated based on the AutoGrad of Pytorch, […]

Read more
Neural Network

Improving Convolutional Neural Networks for Automatic Speech Recognition with Global Context

ContextNet ContextNet has CNN-RNN-transducer architecture and features a fully convolutional encoder that incorporates global context information into convolution layers by adding squeeze-and-excitation modules.Also, ContextNet supports three size models: small, medium, and large. ContextNet uses the global parameter alpha to control the scaling of the model by changing the number of channels in the convolution filter. This repository contains only model code, but you can train with ContextNet at openspeech. Model Architecuture Configuration of the ContextNet encoder If you choose the […]

Read more
Raspberrypi

Monorepo for my Raspberry Pi dashboard and GPS satellite listener

pi dashboard Monorepo for my Raspberry Pi dashboard and GPS satellite listener. It includes: a module system allows different features to be toggled on and off so you don’t need my exact hardware setup. It also allows multiple Pis to use the same server. :house: a Windows 98 themed dashboard. :satellite: view the list of visible GPS satellites from a GPS hardware device. :printer: receive printer messages to a POS58 compatible printer. :thermometer: live temperature/humidity collected from an AMxx compatible […]

Read more
Machine Learning

A python library that lets you customize automated machine learning

nylon An intelligent, flexible grammar of machine learning. Nylon is a python library that lets you customize automated machine learning workflows through a concise, JSON syntax. It provides a built in grammar, in which you can access different operations in ML with the english language. Installation Install latest release version: pip install -U nylon-ai Install directory from github: git clone https://github.com/Palashio/nylon.git cd nylon-ai pip install . Usage: the basics A new Polymer object should be created everytime you’re working with […]

Read more
PyTorch

A variety of sequence model architectures from scratch in PyTorch

Sequence Models This repository implements a variety of sequence model architectures from scratch in PyTorch. Effort has been put to make the code well structured so that it can serve as learning material. The training loop implements the learner design pattern from fast.ai in pure PyTorch, with access to the loop provided through callbacks. Detailed logging and graphs are also provided with python logging and wandb. Additional implementations will be added. Setup Using Miniconda/Anaconda: cd path_to_repo conda create –name –file […]

Read more
Machine Learning

RGB-D Local Implicit Function for Depth Completion of Transparent Objects

implicit_depth This repository maintains the official implementation of our CVPR 2021 paper: RGB-D Local Implicit Function for Depth Completion of Transparent Objects By Luyang Zhu, Arsalan Mousavian, Yu Xiang, Hammad Mazhar, Jozef van Eenbergen, Shoubhik Debnath, Dieter Fox Requirements The code has been tested on the following system: Ubuntu 18.04 Nvidia GPU (4 Tesla V100 32GB GPUs) and CUDA 10.2 python 3.7 pytorch 1.6.0 Installation Docker (Recommended) We provide a Dockerfile for building a container to run our code. More […]

Read more
Jupyter notebooks

Manage python virtual environments on the working notebook server

notebook-environments Manage python virtual environments on the working notebook server. Installation It is recommended to use this package together with virtualenv and virtualenvwrapper to work with python virtual environments more suitable. Make sure the installed python interpreters work without errors on the current operating system. To install this package as a standalone application with the command-line interface you are to run the following command: sudo sh -c “$(curl https://raw.githubusercontent.com/vladpunko/notebook-environments/master/install.sh)” Use the package manager pip to install notebook-environments without the command-line […]

Read more
Deep Learning, Libraries, NLP, Python, Unsupervised

Implementing Transformers in NLP Under 5 Lines Of Codes

This article was published as a part of the Data Science Blogathon Introduction Today, we will see a gentle introduction to the transformers library for executing state-of-the-art models for complex NLP tasks. Applying state-of-the-art Natural Language Processing models has never been more straightforward. Hugging Face has revealed a compelling library called transformers that allow us to perform and use a broad class of state-of-the-art NLP models in a specific way. Today we are operating to install and use the transformers library […]

Read more
Advanced, NLP, Project, Python, Structured Data, Text

Text Preprocessing made easy!

This article was published as a part of the Data Science Blogathon Introduction We will learn the basics of text preprocessing in this article. Humans communicate using words and hence generate a lot of text data for companies in the form of reviews, suggestions, feedback, social media, etc. A lot of valuable insights can be generated from this text data and hence companies try to apply various machine learning or deep learning models to this data to gain actionable insights. Text […]

Read more
1 … 618 619 620 621 622 … 947