Uformer – Pytorch Implementation of Uformer, Attention-based Unet, in Pytorch. It will only offer the concat-cross-skip connection. This repository will be geared towards use in a project for learning protein structures. Specifically, it will include the ability to condition on time steps (needed for DDPM), as well as 2d relative positional encoding using rotary embeddings (instead of the bias on the attention matrix in the paper). Install $ pip install uformer-pytorch Usage import torch from uformer_pytorch import Uformer model = […]

Official implementation for TransDA Official pytorch implement for “Transformer-Based Source-Free Domain Adaptation”. Overview: Result: Prerequisites: python == 3.6.8 pytorch ==1.1.0 torchvision == 0.3.0 numpy, scipy, sklearn, PIL, argparse, tqdm Prepare pretrain model We choose R50-ViT-B_16 as our encoder. wget https://storage.googleapis.com/vit_models/imagenet21k/R50+ViT-B_16.npz mkdir ./model/vit_checkpoint/imagenet21k mv R50+ViT-B_16.npz ./model/vit_checkpoint/imagenet21k/R50+ViT-B_16.npz Our checkpoints could be find in Dropbox Dataset: Please manually download the datasets Office, Office-Home, VisDA, Office-Caltech from the official websites, and modify the path of images in each ‘.txt’ under the folder ‘./data/’. The […]