[WSS25] Visual and statistical analysis of LLMs via problem complexity

HeroImage-WSS25.bmp (17.8 MB)

DOWNLOAD-DESKTOP-NOTEBOOK.nb (9.21 MB)

21 Likes

Interesting read!

2 Likes

news-congrads-kkluyshnik-02-04-19.jpg – you have earned Featured Contributor Badge 2015-11-02_10-07-11.png
Your exceptional post has been selected for our editorial column Staff Picks http://wolfr.am/StaffPicks and Your Profile is now distinguished by a Featured Contributor Badge and is displayed on the Featured Contributor Board. Thank you!

2 Likes

It’s surprising how you observed a 1D variance in so many models. Interesting, Good work Rakesh!

2 Likes

Interesting perspective and visualizations about AI LLMs capabilities!!!

Great work Rakesh!!!

2 Likes

Thank you, Daniel. You were awesome in guiding me through my ideas. It was so fun to work with you!

1 Like

Yup, the quality of the models should vary in one dimension.

1 Like

Thank you!

1 Like

Great post, Rakesh! Just for fun, I asked one of your questions to ChatGPT (specifically “Compute 5^100”), and it got it wrong. However, when I responded simply with the word “wrong,” it managed to correct itself. I think looking further into “LLMs correcting themselves” could provide some nice supplementary insights to what you’ve presented in this essay.

1 Like

Thank you for considering my work.
I have some thoughts on the same matter. I would love to discuss this further.

1 Like