Blog Post··7 min read
Contrastive SSL: SimCLR, MoCo, and DINO
Contrastive learning teaches a model that two views of the same image should be close in representation space, and views of different images should be far apart. The details of how you enforce this determine everything.