Distributed faiss index service. A lightweight library that lets you work with FAISS indexes which don’t fit into a single server memory. It follows a simple concept of a set of index server processes runing in a complete isolation from each other. All the coordination is done at the client side. This siplified many-vs-many client-to-server relationship architecture is flexible and is specifically designed for research projects vs more complicated solutions that aims mostly at production usage and transactionality support. The […]

The official codes of our CVPR2022 paper: Exact Feature Distribution Matching for Arbitrary Style Transfer and Domain Generalization One Sentence Summary: EFDM outperforms AdaIN, which only matches first and second order statistics, by implicitly matching high orders statistics in an efficient manner. Fig.1: AdaIN vs. histogram matching vs. EFDM via Sort-matching. A brief introduction:Many real-world tasks (e.g., Arbitrary Style Transfer and Domain Generalizaiton) can be cast as a feature distribution matching problem.With the assumption of Gaussian feature distribution, conventional feature […]

rlmeta – a flexible lightweight research framework for DistributedReinforcement Learning based on PyTorch andmoolib Installation To build from source, please install PyTorch first,and then run the commands below. $ git clone https://github.com/facebookresearch/rlmeta $ cd rlmeta $ git submodule sync && git submodule update –init –recursive $ pip install -e . Run an Example To run the example for Atari Pong game with PPO algorithm: $ cd examples/atari/ppo $ python atari_ppo.py env=”PongNoFrameskip-v4″ num_epochs=20 We are using hydra to define    

Introduction Aiorq is a distributed task queue with asyncio and redis, which rewrite from arq to make improvement and include webinterface. See documentation for more details. Requirements redis >= 5.0 aioredis>=1.1.0 <2.0.0 Install pip install aiorq pip install aioredis Quick Start Task Definition

Distributed Computing for AI Made Simple This project is experimental and the APIs are not considered stable. Fiber is a Python distributed computing library for modern computer clusters. It is easy to use. Fiber allows you to write programs that run on a computer cluster level without the need to dive into the details of computer cluster. It is easy to learn. Fiber provides the same API as Python’s standard multiprocessing library that you are familiar with. If you know […]

A fast and reliable distributed task processing library for Python 3. Fork of dramatiq.io Installation If you want to use it with RabbitMQ $ pipenv install ‘remoulade[rabbitmq]’ or if you want to use it with Redis $ pipenv install ‘remoulade[redis]’ Quickstart Make sure you’ve got RabbitMQ running, then create a new file calledexample.py: from remoulade.brokers.rabbitmq import RabbitmqBroker import remoulade import requests import sys broker = RabbitmqBroker() remoulade.set_broker(broker) @remoulade.actor def count_words(url): response = requests.get(url) count = len(response.text.split(” “)) print(f”There are {count} […]