9 Likes
– you have earned Featured Contributor Badge 
Your exceptional post has been selected for our editorial column Staff Picks http://wolfr.am/StaffPicks and Your Profile is now distinguished by a Featured Contributor Badge and is displayed on the Featured Contributor Board. Thank you!
This is a great project. I’m curious to see how these phase transitions differ between quantization and model type.
I’d imagine that different models would have different ‘temperatures’ for their phase states. I imagine this is compounded by the noise introduced via quantization and even more so when discussing different transformer types.
1 Like