Facebook NLP Research
NLP

Pay Better Attention to Attention: Head Selection in Multilingual and Multi-Domain Sequence Modeling

Abstract Multi-head attention has each of the attention heads collect salient information from different parts of an input sequence, making it a powerful mechanism for sequence modeling. Multilingual and multi-domain learning are common scenarios for sequence modeling, where the key challenge is to maximize positive transfer and mitigate negative interference across languages and domains. In this paper, we find that non-selective attention sharing is sub-optimal for achieving good generalization across all languages and domains. We further propose attention sharing strategies […]

Read more
Workflow

A fork of the BakeTool with some improvements that I did to have better workflow

This is a fork of the BakeTool with some improvements that I did to have better workflow. 99.99% of work was done by BakeTool team. But as there is no public git repository and as it was hard for me to contact the team with my bug-fixes and extra features, I decided to setup this repo. I think, that Blender baking workflow, as it is without any add-ons, is the worst, that can be imagined. At least, I can’t imagine […]

Read more
Methods

Enhancing Twin Delayed Deep Deterministic Policy Gradient with Cross-Entropy Method

Hieu Trung Nguyen, Khang Tran and Ngoc Hoang Luong Setup $ git clone https://github.com/junhill-2000/eTD3.git $ cd eTD3 The following packages are needed: tianshou==0.4.4 gym==0.19.0 mujoco_py==2.0.2.13 (need to install mujoco200 from http://www.mujoco.org/) Usage train agent with eTD3 python3 mujoco_td3_mod_v3.py –task [environment_name] –seed [seed] –logdir [log_directory] Visualize (comming soon) Acknowledgement Our source code is    

Read more
Airplane

Airplane reservation system python 2

Announcement 🔊: đź”´IMPORTANTđź”´ :Few new things have been added into the code [16/05/2021] different names is asked for each seat different phone number is asked for each seat All the issues present in the first program have been fixed in this one with more adaptations If you want the code before this change you can access that code here 🔵OTHER🔵: Adding new exception handeling cases soon A Train Seat Reservation system program is still a work in progress License and […]

Read more
Transformer

Dense Prediction Transformers For Python

Vision Transformers for Dense Prediction This repository contains code and models for our paper: Vision Transformers for Dense PredictionRenĂ© Ranftl, Alexey Bochkovskiy, Vladlen Koltun Changelog [March 2021] Initial release of inference code and models Setup Download the model weights and place them in the weights folder: Monodepth: Segmentation: Set up dependencies: pip install -r requirements.txt The code was tested with Python 3.7, PyTorch 1.8.0, OpenCV 4.5.1, and timm 0.4.5 Usage Place one or more input images in the folder input. […]

Read more
Stock

Program to compare stock performance of Senator’s transactions vs when the sale is disclosed

Program to compare stock performance of Senator’s transactions vs when the sale is disclosed. Using to find if tracking Senator stock trades is a worthwhile investment strategy: it is. Calls SenateStockWatcher.com’s API to receive an aggregate list of Senator stock transactions. Then uses a for loop to cycle through the stock purchases and calls senator_performance and disclosure_performance functions to find buy prices and current prices of each to calculate performances. Senators have a statistically significant overperformance of the market average […]

Read more
Transformer

Reproduction of Vision Transformer in Tensorflow2. Train from scratch and Finetune

Tensorflow2 implementation of the Vision Transformer(ViT). This repository is for An image is worth 16×16 words: Transformers for image recognition at scale and How to train your ViT? Data, Augmentation, and Regularization in Vision Transformers. Limitations. Due to memory limitations, only the ti/16, s/16, and b/16 models were tested. Due to memory limitations, batch_size 2048 in s16 and 1024 in b/16 (in paper, 4096). Due to computational resource limitations, only reproduce using imagenet1k. All experimental results and graphs are opend […]

Read more
Discord

Pycord, a maintained fork of discord.py, is a python wrapper for the Discord API

A fork of discord.py. PyCord is a modern, easy to use, feature-rich, and async ready API wrapper for Discord written in Python. Key Features Modern Pythonic API using async and await. Proper rate limit handling. Optimised for both speed and memory usage. Supports Slash Commands, Context Menus and Message Components. Installing Python 3.8 or higher is required To install the library without full voice support, you can just run the following command:

Read more
Papers

The implementation for paper Joint t-SNE for Comparable Projections of Multiple High-Dimensional Datasets

This is the implementation for paper Joint t-SNE for Comparable Projections of Multiple High-Dimensional Datasets. abstract: We present Joint t-Stochastic Neighbor Embedding (Joint t-SNE), a technique to generate comparable projections of multiple high-dimensional datasets. Although t-SNE has been widely employed to visualize high-dimensional datasets from various domains, it is limited to projecting a single dataset. When a series of high-dimensional datasets, such as datasets changing over time, is projected independently using t-SNE, misaligned layouts are obtained. Even items with identical […]

Read more
1 … 320 321 322 323 324 … 916