Bailando: 3D dance generation via Actor-Critic GPT with Choreographic Memory

Code for CVPR 2022 (oral) paper “Bailando: 3D dance generation via Actor-Critic GPT with Choreographic Memory” [Paper] | [Project Page] | [Video Demo] Driving 3D characters to dance following a piece of music is highly challenging due to the spatial constraints applied to poses by choreography norms. In addition, the generated dance sequence also needs to maintain temporal coherency with different music genres. To tackle these challenges, we propose a novel music-to-dance framework, Bailando, with two powerful components: 1) a […]

Read more

CLOOB training (JAX) and inference (JAX and PyTorch)

Pretrained models PyTorch from cloob_training import model_pt, pretrained pretrained.list_configs() returns: [‘cloob_laion_400m_vit_b_16_16_epochs’, ‘cloob_laion_400m_vit_b_16_32_epochs’] The models can be used by: config = pretrained.get_config(‘cloob_laion_400m_vit_b_16_16_epochs’) model = model_pt.get_pt_model(config) checkpoint = pretrained.download_checkpoint(config) model.load_state_dict(model_pt.get_pt_params(config, checkpoint)) model.eval().requires_grad_(False).to(‘cuda’) Model class attributes: model.config: the model config dict. model.image_encoder: the image encoder, which expects NCHW batches of normalized images (preprocessed by model.normalize), where C    

Read more

A simple tool to parse json logs and output them in a nice format with nice colors

sugarjazy is a simple tool to parse json logs and output them in a nice format with nice colors. Usually play nicely with https://github.com/uber-go/zap when using the “Sugar” logger output. As a tekton developer this works pretty well with tekton controllers and webhooks pods but the shoudld work as well with most knative package and other pods using go-uber/zap. Screenshot Default Stream from kail with sugarjazy sugarjazy-kail.mp4 Installation There is not many dependencies on this package but python-dateutil is   […]

Read more

Octoprint plugin for tracing lines and generating toolpaths

Introduction This plugin intends to enable direct generation of toolpaths from physical line following. This is illustrated in this video: This could be useful in cases where the object is not originating from a CAD drawing, but is coming from a physical object, like cutting a piece to fit into an existing odd-shaped hole. Installation This has only been tested on OctoPi. It has only been tested with the latest version of OctoPrint. It might work on earlier versions based […]

Read more

Previewer for VapourSynth scripts

Fork of Endilll’s vapoursynth-preview (not maintained anymore) This program is meant to be paired with a code editor with integrated terminal like Visual Studio Code. Python (3.9+ required) Make sure to install Python to your PATH. Vapoursynth (R57+ required) pip install -U git+https://github.com/Irrational-Encoding-Wizardry/vs-preview.git It can then be used by running vspreview script.vpy or your preferred way in your IDE. GitHub View Github    

Read more

Netflix API Metadata & Downloader for Windows and Linux

Python Netflix API Metadata & Downloader for Windows and Linux Features • Dependencies • How To Use • Community Features ❗ KEEP IN MIND THAT THIS LIBRARY IS STILL IN BETA Get Metadata (title, year, episodes, seasons…) with Shakti API Get medias (videos, audios, audio descriptions, subtitles…) Decrypt Widevine DRM protected content Automatically mux all your tracks Nice pre-made format for file names Very fast multi-connection downloads Dependencies How To Use First of all, install the library with pip install […]

Read more

Near Real Time monitoring of satellite image time-series

Python package for near real time detection of change in spatio-temporal datasets nrt provides a standardized interface for Near Real Time monitoring of disturbances on satellite image time-series. The package is optimized for fast computation and suitable for operational deployment at scale. A typical operational use case of such package would be a system constantly receiving new satellite based acquisitions and generating alerts when an anomaly is detected. Five monitoring frameworks from scientific litterature on change detection are implemented and […]

Read more

Easily visualize traffic simulations (made for the PSE course) via plain text data output

Script to easily visualize traffic simulations (made for the PSE course) via plain text data output. Requirements This script requires Python 3 and Pygame. Tested with: Python 3.8.10 Pygame 2.1.2 Ubuntu 20.04 You can install Pygame using pip3 install pygame or similar. Usage The script reads its data from stdin before launching the visualization. The text data format is described below. You can use the following command to pipe the output of your simulation to the visualizer (assuming ./trafficsimulation runs […]

Read more

Toolbox for solving CBFs in Python

Toolbox for implementing safety filters using Control Barrier Functions (CBFs) in python. Implemented functionality for CBFs and implicit CBFs that rely on a backup controller. Implementation of the solver is provided for control-affine systems (with bounded input constraints) using cvxpy. Defines Experiment class to efficiently run experiments with different (or none) CBFs The toolbox is compatible with batched inputs (torch or tf) and individual inputs (numpy or jax) Installation: Run pip install -e . to install this project Example available […]

Read more

Network theory of jazz scales version 2. Modularized and 100% python

This computational music theory project assigns a brightness score for all 28 modes derived from four jazz scales: major, melodic minor, harmonic minor, and harmonic major. I constructed scale networks to visualize the interrelations between the 28 modes. From these networks I found 18 “rules” for modulation that allow for maximally smooth voice leading. Other applications and experiments found in this code repository include characterizing and ranking the brightness of 1) all triad combos, 2) all 7th chords added to […]

Read more
1 168 169 170 171 172 914