Message Boards Message Boards

[WSS23] Study of the possibility of phase transitions in LLMs

2 Replies

This is a great project. I'm curious to see how these phase transitions differ between quantization and model type.

I'd imagine that different models would have different 'temperatures' for their phase states. I imagine this is compounded by the noise introduced via quantization and even more so when discussing different transformer types.

POSTED BY: Nicholas Scott

enter image description here -- you have earned Featured Contributor Badge enter image description here Your exceptional post has been selected for our editorial column Staff Picks http://wolfr.am/StaffPicks and Your Profile is now distinguished by a Featured Contributor Badge and is displayed on the Featured Contributor Board. Thank you!

POSTED BY: EDITORIAL BOARD
Reply to this discussion
Community posts can be styled and formatted using the Markdown syntax.
Reply Preview
Attachments
Remove
or Discard

Group Abstract Group Abstract