Introduction Supervised Contrastive Learning paper claims a big deal about supervised learning and cross-entropy loss vs supervised contrastive loss for better image representation and classification tasks. Let’s go in-depth in this paper what is about. Claim actually close to 1% improvement on image net data set¹. Architecture wise, its a very simple network resnet 50 having a 128-dimensional head. If you want you can add a few more layers as well. Architecture and training process from the paper Codeself.encoder = […]