Group Abstract Group Abstract

Message Boards Message Boards

Announcing Wolfram Notebook Assistant + LLM Kit

Posted 7 months ago

Wolfram Notebook Assistant + LLM Kit is now rolling out!

GET IT HERE»

enter image description here

(For Stephen Wolfram's full introduction, see his blog: https://wolfr.am/NotebookAssistant)

Notice: With this new subscription, we're rolling out updates to our notebook interfaces for version 14.1. When your system updates, you'll see new items on your standard toolbar.


We're excited to introduce this product that provides new interfaces for computational AI assistance and also provides LLM access for programmatic uses as well. Over the course of its development we've already found a lot of good (and fun) uses for it and we're sure you'll find many more. Let me give a quick summary of the product's two parts:

The Notebook Assistant is aimed at making working in Wolfram Notebooks easier. It provides context-aware suggestions to streamline your workflow based on the content of your notebook. Whether you're coding or writing, the assistant can help you with tasks such as auto-completing text, suggesting functions, and offering debugging tips.

The Wolfram LLM Kit lets you use Wolfram as your provider, letting you use Chat Notebooks and programmatic LLM functions as simply as possible. You won't need to set up accounts or give your email to third-party providers like Open AI or Anthropic. We take care of all of that.

Who is this subscription really for? If you use Wolfram Notebooks, then there's something in here for you.

  • Its not just for code! Like any good LLM, it can help with writing tasks by completing text or outlining documents. And unlike most, it can understand your data and computations while doing it.

  • If you're just starting with Wolfram Language code, tell the assistant what you're trying to do in plain language and it will help with the first steps toward coding your ideas. It isn't exactly a tutor but it can tell you to functions to use. If you hit problems on the way, it can help find alternatives.

  • If you're a veteran, it can help you by suggesting rarely-used functions or Options that you might not have thought of. It can access the stack while helping you debug your code. You can use the auto-complete to breeze through the drudgery of mundane code sections.

We encourage you to check out Stephen Wolfram's blog and the gallery of examples to get inspired. We can't wait to see how you use these new tools to enhance your creativity and productivity in Wolfram Notebooks. Please share your experiences with the Wolfram Community so we can learn new and different ways to use these tools.

POSTED BY: Bradley Ashby
38 Replies
POSTED BY: Peter Haggstrom

As an update to the issue which I posted recently I think the underlying problem was with the way NA dealt with the original query which was done by inserting an image in .png form. There must have been an extraction issue. When the Latex code (or raw input style ) is inserted after about 5 minutes or so the correct answer was output yet when I congratulated it on getting the correct answer it went into seemingly endless circle. So NA can get the right answer but it is also glacial.

POSTED BY: Peter Haggstrom
POSTED BY: Roger J Brown

It is likely that OpenAI's PDF import is using a combination of reading in PlainText as well as doing processing of the page images using its multi modal capabilities. It is also likely that is bringing a number of other programs to bear on the problem. When I use the gpt-4o model on a image of a PDF with equations it does a quite good job (with the correct prompting) to get the content of the page and include the equations with embedded LaTeX strings. As a general rule in work like this, which I've done a bunch of over the past year, if the image of the page has many equations that are themselves quite small, imagine a grid of equations were the equations have very small font sizes, the LLM will often make a number of errors on the content that has a small font size. Also, if there's a fair amount of very complex, two dimensional layout of equations, or different equations laid out next to one another that should be distinguishable from one another, then it will often times make such errors. I have not tested this on open AI's website, all of my work has been within Wolfram language itself. I suppose it's also worth remembering that the import of a PDF using the Import function has all of the restrictions of any other importing such as the various python packages, as far as I understand it. And in Wolfram language, the import function will import plane text and often times, if the text is laid out in a way that is not strictly linear be confused about which pieces of text relate to other pieces of text for example different pieces of text in a grid. Properly prompted vision models will be able, sometimes to make the distinction. But it all depends upon very sophisticated prompting. And for a sufficiently complicated layout of a PDFs page, as well as the level of detail of equations, and so on, will lead to errors.

POSTED BY: David Reiss

David - Thanks for that. And I get it, the bot can't be perfect. That is why they call it ARTIFICIAL intelligence. Whatever the situation I ALWAYS double- and triple-check for errors. It is just that the ChatGPT version is both very easy and very accurate. The window has the familiar clip icon ChatGPT interface Not only can one upload the paper but if you want to add data to test the theory the paper expresses, it is just another paper-clip-icon click and the data is uploaded!!!. This saves HOURS of tedious typing. These are ministerial, have been around for years, so it is hard to understand when Wolfram does not allow/adopt similar time-saving convenience.

POSTED BY: Roger J Brown
POSTED BY: Roger J Brown

It is not associated with the plan. It is a limit of the Model. Whenever you are carrying on a conversation with the LLM, for example, in a Chatbook, it sends the full history of the conversation to the model. At some point, the number of tokens that are being sent to the model exceeds the limit of the model. You can see the various context limits of the OpenAI models here OpenAI Models

From your messages I am guessing that you are using one of the older gpt-4 models which have a total context limit of 8192 tokens

POSTED BY: David Reiss
POSTED BY: Bradley Ashby
Posted 5 months ago

I'm curious whether the Notebook Assistant subscription applies to both PC's that I am able to run under my Wolfram Premium Plus subscription?

I'm a bit disappointed that my Wolfram Premium Plus subscription does not include Notebook Assistant. That means I have to have multiple subscriptions. Not only that, if I want to have an AI service on my phone and on my PC's, but I also have to have an additional subscription, in my case XAi/Grok. Grok isn't supported in the list of AI services on the Wolfram desktop app. No Chat Notebooks for Grok apparently? I've been a Wolfram customer since at least version 3...

POSTED BY: David G

Groq is supported.

enter image description here

POSTED BY: David Reiss
Posted 5 months ago

No. Grok is XAi (from Elon Musk). Groq is from a distinctly different vendor. I'm surprised this is not well known by now.

POSTED BY: David G

Actually, It's pretty well known here, but very easy to mistake. ;-) There is no ServiceConnect yet for XAI in the Mathematica distribution. It's worth making a suggestion that it be added and see whether the developers have it in their plans to add it or, if not, what the reason might be.

POSTED BY: David Reiss
Posted 5 months ago
POSTED BY: David G

Will do!

POSTED BY: David Reiss

Hi David. I can confirm that the Wolfram Notebook Assistant + LLM Kit will work on both of your computers where you have Wolfram desktop products installed. It's access is tied to your Wolfram ID, not your activation codes, so it will work on any computer where you sign in.

POSTED BY: Bradley Ashby

OK, found the place to get connected. Turns out it is all automatic. Magic!!

POSTED BY: Roger J Brown

Bradley -- I just found out about this and, late on a Saturday before Christmas, I excitedly purchased a year's supply. I have a license number for the product but do not find anywhere to register it. Chat enabled notebooks seem to work as usual. Should I imaging there is enough AI in it to connect my subscription to my license number. That brings up the question: Can I use it on my laptop with my Home License I get from Premier Support?

POSTED BY: Roger J Brown

I watched Stephen's introduction to the Notebook Assistant and I will have a play with it. The way it is marketed suggests I don't have to buy tokens from OpenAI for the lowest level of the product. It is USD 240 and that covers what the LLM is doing in the background. I assume you have done a behind the scenes deal based on assumed levels of non-industrial strength usage and if you want to really get serious you buy Wolfram's service credits. Have I got it right?

POSTED BY: Peter Haggstrom
POSTED BY: Bradley Ashby

Thanks Bradley. I have been a user of Mathematica since probably 2.0 and I was discussing the potential use of the NA with my oncologist daughter who will be doing some bioinformatics at Cambridge and Stockholm in 2025 as part of her PhD and the NA is just the sort of tool that could help her. By the way, I loved Stephen's warts and all presentation. I'll get playing with Notebook Assistant. Cheers Peter

POSTED BY: Peter Haggstrom

Bradley I bought the Notebook and it doesn't work. I have been a user since 2,0 at full commercial level and Stephen's minions have asked me to do book reviews for him on Amazon (and I did one on his book on CHATGPT). I have pursued this with the alleged "Premier Service" but what you don't realise is the commercial stuff I disclosed to them. I suggest you get in touch with them. But basically I think Wolfram has lost control of quality control - please pass that on to Stephen (the Premier service people can give you my background ) I would like to see this work but I am not hopeful. Peter

Update: NA wouldn't properly install on my Surface book. The 413 meg index file just did not want to properly extract and I messages which have an active link to GitHub - this had a real beta test vibe to it. After the 3rd attempt the index search term file downloaded and I was able to query. My frustration was doubled because 14.1 will not install on my Imac despite multiple attempts and this is the subject of a ticket.

POSTED BY: Peter Haggstrom

Peter I have the same impression. Take the more trivial case of Canvas which replaced the awful Drawing Tools. It's a step forward, yes, but needs some effort by senior developers in order to improve the design and sort out the bugs. I called Tech Support in April (2025) to register my frustration with canvas and was told my name would be added to the list of complainers. The funny thing was after the call I realized I was editing a sketch that I'd created in around 2020. I had similar problems then and am pretty sure I called to make the same compliant. Hopeless!

FYI - ten years ago Mike Horneychurch got frustrated with Wolfram and suggested they spend a year just sorting out the backlog of bugs instead of flitting from one flower to the next.

Posted 6 months ago
POSTED BY: Héctor Galaz

Hello Héctor, thanks for the question.

Yes, I can confirm that all of the Notebook Assistant and LLM Kit features and capabilities are included in both the Essentials and Pro subscriptions. The difference between the two subscriptions is only in the usage limits. The Pro subscription has double the usage limit of the Essentials subscription.

Hope that helps!

POSTED BY: Bradley Ashby
Posted 6 months ago

Thanks for the clarification! Regards

POSTED BY: Héctor Galaz
Posted 7 months ago
POSTED BY: Phil Earnhardt
Posted 7 months ago

Very excited. How will this work in the cloud offering?

POSTED BY: Michael Madsen
POSTED BY: Bradley Ashby
POSTED BY: John Cromwell

Great to hear from you, @John ! If you stumble on some neat examples - please share :-)

POSTED BY: Vitaliy Kaurov
Posted 7 months ago
POSTED BY: Patrice Turpin

There was a bug which I reported to the developers and I believe they have pushed out an update that should fix this. If you continue to have this issue, you should contact technical support.

POSTED BY: David Reiss
Posted 7 months ago

Thank you. Now it works . I still cannot get my DateListPlot with the sunrise time but it is another issue :-). What is fun is that the assistant produced the code and then corrected it without result. How human this trial, error ... Thanks again for your very fast answer.

POSTED BY: Patrice Turpin

You are welcome. It was something close to my heart because internally I was the first person to run across this :-). And the developers were very responsive in getting it fixed as quickly as possible.

POSTED BY: David Reiss

Thanks for bringing this up. We've found the issue and deployed and update that should fix this for you. You can use ResourceFunction["InstallNotebookAssistant"][] to update all of the relevant paclets and then you'll need to restart the app afterward.

POSTED BY: Bradley Ashby

Impossible not to enjoy the dinosaur story from Stephen :-) A quote from https://wolfr.am/NotebookAssistant

And that reminds me of the very first time I ever saw a computer in real life. It was 1969 and I was 9 years old (and the computer was an IBM mainframe). The person who was showing me the computer asked me: “So what do you want to compute?” I really had no idea at that time “what one might compute”. Rather lamely I said “the weight of a dinosaur”. So, 55 years later, let’s try that again:

enter image description here

enter image description here

POSTED BY: Vitaliy Kaurov
Posted 7 months ago
POSTED BY: Alan Mok
POSTED BY: Bradley Ashby
Reply to this discussion
Community posts can be styled and formatted using the Markdown syntax.
Reply Preview
Attachments
Remove
or Discard