Tensor Programs - Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer

Tensor Programs - Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer

Aleksa Gordić - The AI Epiphany via YouTube Direct link

uTransfer introduced

1 of 9

1 of 9

uTransfer introduced

Class Central Classrooms beta

YouTube playlists curated by Class Central.

Classroom Contents

Tensor Programs - Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer

Automatically move to the next video in the Classroom when playback concludes

  1. 1 uTransfer introduced
  2. 2 Previous work tensor programs IV
  3. 3 NTK - neural tangent kernel recap
  4. 4 abc parametrization
  5. 5 How does learning happen in NTK?
  6. 6 Connections to Central Limit Theorem
  7. 7 Maximal Update Parametrization in Practice
  8. 8 DeepNet paper connection
  9. 9 Results width is all you need?

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.