Almost-scaled dot-product attention
TL;DR: Scaled dot product attention isn't properly scaled, and that's a good thing!
Notebook: almost-scaled dot-product attention
TL;DR: Scaled dot product attention isn't properly scaled, and that's a good thing!
Notebook: almost-scaled dot-product attention