Group Abstract Group Abstract

Message Boards Message Boards

Announcing Wolfram Notebook Assistant + LLM Kit

Posted 7 months ago

Wolfram Notebook Assistant + LLM Kit is now rolling out!

GET IT HERE»

enter image description here

(For Stephen Wolfram's full introduction, see his blog: https://wolfr.am/NotebookAssistant)

Notice: With this new subscription, we're rolling out updates to our notebook interfaces for version 14.1. When your system updates, you'll see new items on your standard toolbar.


We're excited to introduce this product that provides new interfaces for computational AI assistance and also provides LLM access for programmatic uses as well. Over the course of its development we've already found a lot of good (and fun) uses for it and we're sure you'll find many more. Let me give a quick summary of the product's two parts:

The Notebook Assistant is aimed at making working in Wolfram Notebooks easier. It provides context-aware suggestions to streamline your workflow based on the content of your notebook. Whether you're coding or writing, the assistant can help you with tasks such as auto-completing text, suggesting functions, and offering debugging tips.

The Wolfram LLM Kit lets you use Wolfram as your provider, letting you use Chat Notebooks and programmatic LLM functions as simply as possible. You won't need to set up accounts or give your email to third-party providers like Open AI or Anthropic. We take care of all of that.

Who is this subscription really for? If you use Wolfram Notebooks, then there's something in here for you.

  • Its not just for code! Like any good LLM, it can help with writing tasks by completing text or outlining documents. And unlike most, it can understand your data and computations while doing it.

  • If you're just starting with Wolfram Language code, tell the assistant what you're trying to do in plain language and it will help with the first steps toward coding your ideas. It isn't exactly a tutor but it can tell you to functions to use. If you hit problems on the way, it can help find alternatives.

  • If you're a veteran, it can help you by suggesting rarely-used functions or Options that you might not have thought of. It can access the stack while helping you debug your code. You can use the auto-complete to breeze through the drudgery of mundane code sections.

We encourage you to check out Stephen Wolfram's blog and the gallery of examples to get inspired. We can't wait to see how you use these new tools to enhance your creativity and productivity in Wolfram Notebooks. Please share your experiences with the Wolfram Community so we can learn new and different ways to use these tools.

POSTED BY: Bradley Ashby
38 Replies

I have a worrying observation about the accuracy of Notebook Assistant (NA). I was doing some work in Fourier theory and there is a reasonably well known result involving the equality of negative exponential and the integral on the half plane of a weighted negative exponential and a Gaussian. Without going into all the details you get a transformed integral which has a nice known solution which Mathematica correctly outputs - it is in Gradsheytn and Ryzhik and Watson’s tome on Bessel functions and involves Bessel’s function of the second kind K_(1/2)(b) where b>0. It is not amenable to naive approaches. I tested ChatGPT 4o , DeepSeek R1 and Notebook Assistant (NA) by asking how to perform the integration. I got the usual pattern recognition from ChatGPT with arithmetic errors and nonsense about how to integrate it which was just wrong. After some Socratic prompting it finally got the correct answer. DeepSeek R1 delivered similar stuff but did not make the arithmetic errors in the detail and I took it through a similar Socratic process and it got the right answer. I then tried out NA which at one stage invoked WolframAlpha but nevertheless produced a howler of an arithmetic error. It is as through the computational aspect went out to lunch. NA got the wrong answer so I tried again. It correctly made reference to the BesselK function but got the wrong answer and when I pointed out that Mathematica gave the correct answer it manfully stood its ground with an answer which was out by a factor of $ \frac{ \sqrt{\pi}}{2} $ . Both ChatGPT and DeepSeek R1 actually got the correct answer finally but NA did not change its “opinion” when contested. This is not commercially acceptable for a system embedded in Mathematica for a separate non-trivial charge. So to step back - the LLMs without actual computational functionality eventually got the integral right but NA didn’t despite being told that Mathematica delivers the correct answer AND along the way it made arithmetic errors. There is a LOT more work needed to make NA actually useful. Here is the howlerenter image description here

POSTED BY: Peter Haggstrom

As an update to the issue which I posted recently I think the underlying problem was with the way NA dealt with the original query which was done by inserting an image in .png form. There must have been an extraction issue. When the Latex code (or raw input style ) is inserted after about 5 minutes or so the correct answer was output yet when I congratulated it on getting the correct answer it went into seemingly endless circle. So NA can get the right answer but it is also glacial.

POSTED BY: Peter Haggstrom

Bradley - When I use ChatGPT through my browser, I can upload a PDF of a technical paper and the bot reads it instantly and communicates at near perfection to convert equations in the paper to Wolfram code. The problem is that after a bit the OpenAI link wants me to upgrade at a cost of $? or it shuts me off until tomorrow. Since I have a ChatGPT API key I presume that is what they want. I bought the Wolfram notebook assistant and assumed it - or a Chat Notebook - would provide the same functionality. Apparently not. In the Chat notebook I have selected OpenAI as the model and input my API Key. Even with that I am told to Import the pdf as plain text into the notebook. I can do that but the LaTex functionality is lost in the Plaintext conversion. Division signs are omitted and subscripts are ignored so differentials and exponents are not right unless I do a HUGE amount of tedious editing one character at a time. It seems like there is a LOOOOOONG step between what OpenAI offers directly and the version of it that comes through the notebook.

I would much prefer to go through Wolfram for these things. If I am doing something wrong, please advise. But the Wolfram Chat bot seems to be well below the OpenAI equivalent. I am happy to pay $20 a month to one or the other of you but it does not seem to make sense to do both since OpenAI will supply everything I need without the Notebook Assistant.

POSTED BY: Roger J Brown
POSTED BY: David Reiss
POSTED BY: Roger J Brown

Here is a message that is rather cryptic: enter image description here

From this I presume I am exceeding some sort of limit under whatever plan I am using. Since I am "logged in" (if that is the right term) to the model under my API Key through the notebook, is that where the restriction is being applied; or is the restriction on the Wolfram plan? Whatever, it is preventing me from completing my work...

POSTED BY: Roger J Brown

It is not associated with the plan. It is a limit of the Model. Whenever you are carrying on a conversation with the LLM, for example, in a Chatbook, it sends the full history of the conversation to the model. At some point, the number of tokens that are being sent to the model exceeds the limit of the model. You can see the various context limits of the OpenAI models here OpenAI Models

From your messages I am guessing that you are using one of the older gpt-4 models which have a total context limit of 8192 tokens

POSTED BY: David Reiss
POSTED BY: Bradley Ashby
Posted 5 months ago
POSTED BY: David G

Groq is supported.

enter image description here

POSTED BY: David Reiss
Posted 5 months ago

No. Grok is XAi (from Elon Musk). Groq is from a distinctly different vendor. I'm surprised this is not well known by now.

POSTED BY: David G

Actually, It's pretty well known here, but very easy to mistake. ;-) There is no ServiceConnect yet for XAI in the Mathematica distribution. It's worth making a suggestion that it be added and see whether the developers have it in their plans to add it or, if not, what the reason might be.

POSTED BY: David Reiss
Posted 5 months ago

I'm not sure how I can directly make suggestions to the developers (other than ones that may read this forum on an uncertain frequency). I would think that a platform on the level of XAi would be on their radar without users needing to make suggestions. Even the just announced DeepSeek from the CCP is in the list you posted. You and Bradley have Wolfram Research in your profiles, maybe you could pass it along?

POSTED BY: David G

Will do!

POSTED BY: David Reiss

Hi David. I can confirm that the Wolfram Notebook Assistant + LLM Kit will work on both of your computers where you have Wolfram desktop products installed. It's access is tied to your Wolfram ID, not your activation codes, so it will work on any computer where you sign in.

POSTED BY: Bradley Ashby

OK, found the place to get connected. Turns out it is all automatic. Magic!!

POSTED BY: Roger J Brown

Bradley -- I just found out about this and, late on a Saturday before Christmas, I excitedly purchased a year's supply. I have a license number for the product but do not find anywhere to register it. Chat enabled notebooks seem to work as usual. Should I imaging there is enough AI in it to connect my subscription to my license number. That brings up the question: Can I use it on my laptop with my Home License I get from Premier Support?

POSTED BY: Roger J Brown

I watched Stephen's introduction to the Notebook Assistant and I will have a play with it. The way it is marketed suggests I don't have to buy tokens from OpenAI for the lowest level of the product. It is USD 240 and that covers what the LLM is doing in the background. I assume you have done a behind the scenes deal based on assumed levels of non-industrial strength usage and if you want to really get serious you buy Wolfram's service credits. Have I got it right?

POSTED BY: Peter Haggstrom
POSTED BY: Bradley Ashby

Thanks Bradley. I have been a user of Mathematica since probably 2.0 and I was discussing the potential use of the NA with my oncologist daughter who will be doing some bioinformatics at Cambridge and Stockholm in 2025 as part of her PhD and the NA is just the sort of tool that could help her. By the way, I loved Stephen's warts and all presentation. I'll get playing with Notebook Assistant. Cheers Peter

POSTED BY: Peter Haggstrom
POSTED BY: Peter Haggstrom
Posted 6 months ago

Bradley, question here please:

regarding the Essentials and Pro Suscription to NoteBook Assistant+LLM Kit; I assume both functionalities are included on both type of suscriptions, but a comment on FAQs on https://www.wolfram.com/notebook-assistant-llm-kit/, makes me doubt it:

"Wolfram Notebook Assistant is intended for human users; LLM Kit is intended for programmatic use. Pro should be sufficient for light programmatic use".

Can you confirm both NoteBook Assistant and LLM Kit functionalities are included on both Essentials and Pro Suscriptions? If so, what is the difference between Essentials and Pro suscription? Are there different plan limits between suscriptions? Could you explain them?

Thank you for clarification.

POSTED BY: Héctor Galaz

Hello Héctor, thanks for the question.

Yes, I can confirm that all of the Notebook Assistant and LLM Kit features and capabilities are included in both the Essentials and Pro subscriptions. The difference between the two subscriptions is only in the usage limits. The Pro subscription has double the usage limit of the Essentials subscription.

Hope that helps!

POSTED BY: Bradley Ashby
Posted 6 months ago

Thanks for the clarification! Regards

POSTED BY: Héctor Galaz
Posted 7 months ago
POSTED BY: Phil Earnhardt
Posted 7 months ago

Very excited. How will this work in the cloud offering?

POSTED BY: Michael Madsen

The LLM Kit functionality is already available in the cloud. With the subscription you can use LLMFunction and Chat Notebooks in the cloud without configuring any third-party providers.

For Notebook Assistant functionality in the cloud, we make the same advanced computational AI available through Chat Notebooks as long as you're using Wolfram as the LLM Provider. You can ask it the same sort of questions, though it will be using only the current notebook as context. This is available now and we'll also be giving these interfaces more attention in the near future.

POSTED BY: Bradley Ashby

Well done with this! Within 10 minutes of using Notebook Assistant I was discovering improvements in coding a commercial solution that we're developing. Looking forward to all of the possibilities!

POSTED BY: John Cromwell

Great to hear from you, @John ! If you stumble on some neat examples - please share :-)

POSTED BY: Vitaliy Kaurov
Posted 7 months ago
POSTED BY: Patrice Turpin

There was a bug which I reported to the developers and I believe they have pushed out an update that should fix this. If you continue to have this issue, you should contact technical support.

POSTED BY: David Reiss
Posted 7 months ago

Thank you. Now it works . I still cannot get my DateListPlot with the sunrise time but it is another issue :-). What is fun is that the assistant produced the code and then corrected it without result. How human this trial, error ... Thanks again for your very fast answer.

POSTED BY: Patrice Turpin

You are welcome. It was something close to my heart because internally I was the first person to run across this :-). And the developers were very responsive in getting it fixed as quickly as possible.

POSTED BY: David Reiss

Thanks for bringing this up. We've found the issue and deployed and update that should fix this for you. You can use ResourceFunction["InstallNotebookAssistant"][] to update all of the relevant paclets and then you'll need to restart the app afterward.

POSTED BY: Bradley Ashby

Impossible not to enjoy the dinosaur story from Stephen :-) A quote from https://wolfr.am/NotebookAssistant

And that reminds me of the very first time I ever saw a computer in real life. It was 1969 and I was 9 years old (and the computer was an IBM mainframe). The person who was showing me the computer asked me: “So what do you want to compute?” I really had no idea at that time “what one might compute”. Rather lamely I said “the weight of a dinosaur”. So, 55 years later, let’s try that again:

enter image description here

enter image description here

POSTED BY: Vitaliy Kaurov
Posted 7 months ago

Can it be used in Country like Hong Kong ?

POSTED BY: Alan Mok

You shouldn't have any problem accessing our services from Hong Kong. We aren't restricting access there from our side. We also checked and someone in Hong Kong is currently able to reach our systems.

POSTED BY: Bradley Ashby
Reply to this discussion
Community posts can be styled and formatted using the Markdown syntax.
Reply Preview
Attachments
Remove
or Discard