BloomTech’s Downfall: A Long Time Coming

Emerging Properties in Self-Supervised Vision Transformers - Facebook AI Research Explained

Emerging Properties in Self-Supervised Vision Transformers - Facebook AI Research Explained

Yannic Kilcher via YouTube Direct link

- Intro & Overview

1 of 10
Next

1 of 10

- Intro & Overview

Class Central Classrooms beta

YouTube playlists curated by Class Central.

Classroom Contents

Emerging Properties in Self-Supervised Vision Transformers - Facebook AI Research Explained

Automatically move to the next video in the Classroom when playback concludes
  1. 1 - Intro & Overview
  2. 2 - Vision Transformers
  3. 3 - Self-Supervised Learning for Images
  4. 4 - Self-Distillation
  5. 5 - Building the teacher from the student by moving average
  6. 6 - DINO Pseudocode
  7. 7 - Why Cross-Entropy Loss?
  8. 8 - Experimental Results
  9. 9 - My Hypothesis why this works
  10. 10 - Conclusion & Comments

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free
Someone learning on their laptop while sitting on the floor.