EmBERT We present Embodied BERT (EmBERT), a transformer-based model which can attend to high-dimensional, multi-modal inputs across long temporal horizons for language-conditioned task completion. Additionally, we bridge the gap between successful object-centric navigation models used for non-interactive agents and the language-guided visual task completion benchmark, ALFRED, by introducing object navigation targets for EmBERT training. We achieve competitive performance on the ALFRED benchmark, and EmBERT marks the first transformer-based model to successfully handle the long-horizon, dense, multi-modal histories of ALFRED, and […]

Daft-Exprt – PyTorch Implementation PyTorch Implementation of Daft-Exprt: Robust Prosody Transfer Across Speakers for Expressive Speech Synthesis The validation logs up to 70K of synthesized mel and alignment are shown below (VCTK_val_p237-088). DATASET refers to the names of datasets such as VCTK in the following documents. Dependencies You can install the Python dependencies with pip3 install -r requirements.txt Also, Dockerfile is provided for Docker users. Inference You have to download the pretrained models and put them in output/ckpt/DATASET/. For a […]