Message Boards Message Boards

Announcing Wolfram Notebook Assistant + LLM Kit

Posted 1 month ago

Wolfram Notebook Assistant + LLM Kit is now rolling out!

GET IT HERE»

enter image description here

(For Stephen Wolfram's full introduction, see his blog: https://wolfr.am/NotebookAssistant)

Notice: With this new subscription, we're rolling out updates to our notebook interfaces for version 14.1. When your system updates, you'll see new items on your standard toolbar.


We're excited to introduce this product that provides new interfaces for computational AI assistance and also provides LLM access for programmatic uses as well. Over the course of its development we've already found a lot of good (and fun) uses for it and we're sure you'll find many more. Let me give a quick summary of the product's two parts:

The Notebook Assistant is aimed at making working in Wolfram Notebooks easier. It provides context-aware suggestions to streamline your workflow based on the content of your notebook. Whether you're coding or writing, the assistant can help you with tasks such as auto-completing text, suggesting functions, and offering debugging tips.

The Wolfram LLM Kit lets you use Wolfram as your provider, letting you use Chat Notebooks and programmatic LLM functions as simply as possible. You won't need to set up accounts or give your email to third-party providers like Open AI or Anthropic. We take care of all of that.

Who is this subscription really for? If you use Wolfram Notebooks, then there's something in here for you.

  • Its not just for code! Like any good LLM, it can help with writing tasks by completing text or outlining documents. And unlike most, it can understand your data and computations while doing it.

  • If you're just starting with Wolfram Language code, tell the assistant what you're trying to do in plain language and it will help with the first steps toward coding your ideas. It isn't exactly a tutor but it can tell you to functions to use. If you hit problems on the way, it can help find alternatives.

  • If you're a veteran, it can help you by suggesting rarely-used functions or Options that you might not have thought of. It can access the stack while helping you debug your code. You can use the auto-complete to breeze through the drudgery of mundane code sections.

We encourage you to check out Stephen Wolfram's blog and the gallery of examples to get inspired. We can't wait to see how you use these new tools to enhance your creativity and productivity in Wolfram Notebooks. Please share your experiences with the Wolfram Community so we can learn new and different ways to use these tools.

POSTED BY: Bradley Ashby
35 Replies

Bradley - When I use ChatGPT through my browser, I can upload a PDF of a technical paper and the bot reads it instantly and communicates at near perfection to convert equations in the paper to Wolfram code. The problem is that after a bit the OpenAI link wants me to upgrade at a cost of $? or it shuts me off until tomorrow. Since I have a ChatGPT API key I presume that is what they want. I bought the Wolfram notebook assistant and assumed it - or a Chat Notebook - would provide the same functionality. Apparently not. In the Chat notebook I have selected OpenAI as the model and input my API Key. Even with that I am told to Import the pdf as plain text into the notebook. I can do that but the LaTex functionality is lost in the Plaintext conversion. Division signs are omitted and subscripts are ignored so differentials and exponents are not right unless I do a HUGE amount of tedious editing one character at a time. It seems like there is a LOOOOOONG step between what OpenAI offers directly and the version of it that comes through the notebook.

I would much prefer to go through Wolfram for these things. If I am doing something wrong, please advise. But the Wolfram Chat bot seems to be well below the OpenAI equivalent. I am happy to pay $20 a month to one or the other of you but it does not seem to make sense to do both since OpenAI will supply everything I need without the Notebook Assistant.

POSTED BY: Roger J Brown

It is likely that OpenAI's PDF import is using a combination of reading in PlainText as well as doing processing of the page images using its multi modal capabilities. It is also likely that is bringing a number of other programs to bear on the problem. When I use the gpt-4o model on a image of a PDF with equations it does a quite good job (with the correct prompting) to get the content of the page and include the equations with embedded LaTeX strings. As a general rule in work like this, which I've done a bunch of over the past year, if the image of the page has many equations that are themselves quite small, imagine a grid of equations were the equations have very small font sizes, the LLM will often make a number of errors on the content that has a small font size. Also, if there's a fair amount of very complex, two dimensional layout of equations, or different equations laid out next to one another that should be distinguishable from one another, then it will often times make such errors. I have not tested this on open AI's website, all of my work has been within Wolfram language itself. I suppose it's also worth remembering that the import of a PDF using the Import function has all of the restrictions of any other importing such as the various python packages, as far as I understand it. And in Wolfram language, the import function will import plane text and often times, if the text is laid out in a way that is not strictly linear be confused about which pieces of text relate to other pieces of text for example different pieces of text in a grid. Properly prompted vision models will be able, sometimes to make the distinction. But it all depends upon very sophisticated prompting. And for a sufficiently complicated layout of a PDFs page, as well as the level of detail of equations, and so on, will lead to errors.

POSTED BY: David Reiss

David - Thanks for that. And I get it, the bot can't be perfect. That is why they call it ARTIFICIAL intelligence. Whatever the situation I ALWAYS double- and triple-check for errors. It is just that the ChatGPT version is both very easy and very accurate. The window has the familiar clip icon ChatGPT interface Not only can one upload the paper but if you want to add data to test the theory the paper expresses, it is just another paper-clip-icon click and the data is uploaded!!!. This saves HOURS of tedious typing. These are ministerial, have been around for years, so it is hard to understand when Wolfram does not allow/adopt similar time-saving convenience.

POSTED BY: Roger J Brown

Here is a message that is rather cryptic: enter image description here

From this I presume I am exceeding some sort of limit under whatever plan I am using. Since I am "logged in" (if that is the right term) to the model under my API Key through the notebook, is that where the restriction is being applied; or is the restriction on the Wolfram plan? Whatever, it is preventing me from completing my work...

POSTED BY: Roger J Brown

It is not associated with the plan. It is a limit of the Model. Whenever you are carrying on a conversation with the LLM, for example, in a Chatbook, it sends the full history of the conversation to the model. At some point, the number of tokens that are being sent to the model exceeds the limit of the model. You can see the various context limits of the OpenAI models here OpenAI Models

From your messages I am guessing that you are using one of the older gpt-4 models which have a total context limit of 8192 tokens

POSTED BY: David Reiss

Hi Roger. First let me say that we're hard at work implementing the ability to let Notebook Assistant access more sources. We're planning to add support for PDFs, text, CSVs, URLs, all sorts of potential targets. This has always been part of our roadmap and is now on the short list of near-term features. I just spoke with the primary developer and confirmed this is his next priority.

Second, I note that you mention that you use a Chat Notebook, select OpenAI as the model, and input your API key. When you select an LLM service provider other than Wolfram, you're no longer using our LLM Kit service or accessing the power of Notebook Assistant. This also means that the 'content length' error message you're getting is purely from OpenAI's systems.

POSTED BY: Bradley Ashby
Posted 5 days ago

I'm curious whether the Notebook Assistant subscription applies to both PC's that I am able to run under my Wolfram Premium Plus subscription?

I'm a bit disappointed that my Wolfram Premium Plus subscription does not include Notebook Assistant. That means I have to have multiple subscriptions. Not only that, if I want to have an AI service on my phone and on my PC's, but I also have to have an additional subscription, in my case XAi/Grok. Grok isn't supported in the list of AI services on the Wolfram desktop app. No Chat Notebooks for Grok apparently? I've been a Wolfram customer since at least version 3...

POSTED BY: David G

Groq is supported.

enter image description here

POSTED BY: David Reiss
Posted 3 days ago

No. Grok is XAi (from Elon Musk). Groq is from a distinctly different vendor. I'm surprised this is not well known by now.

POSTED BY: David G

Actually, It's pretty well known here, but very easy to mistake. ;-) There is no ServiceConnect yet for XAI in the Mathematica distribution. It's worth making a suggestion that it be added and see whether the developers have it in their plans to add it or, if not, what the reason might be.

POSTED BY: David Reiss
Posted 1 day ago

I'm not sure how I can directly make suggestions to the developers (other than ones that may read this forum on an uncertain frequency). I would think that a platform on the level of XAi would be on their radar without users needing to make suggestions. Even the just announced DeepSeek from the CCP is in the list you posted. You and Bradley have Wolfram Research in your profiles, maybe you could pass it along?

POSTED BY: David G

Will do!

POSTED BY: David Reiss

Hi David. I can confirm that the Wolfram Notebook Assistant + LLM Kit will work on both of your computers where you have Wolfram desktop products installed. It's access is tied to your Wolfram ID, not your activation codes, so it will work on any computer where you sign in.

POSTED BY: Bradley Ashby

OK, found the place to get connected. Turns out it is all automatic. Magic!!

POSTED BY: Roger J Brown

Bradley -- I just found out about this and, late on a Saturday before Christmas, I excitedly purchased a year's supply. I have a license number for the product but do not find anywhere to register it. Chat enabled notebooks seem to work as usual. Should I imaging there is enough AI in it to connect my subscription to my license number. That brings up the question: Can I use it on my laptop with my Home License I get from Premier Support?

POSTED BY: Roger J Brown

I watched Stephen's introduction to the Notebook Assistant and I will have a play with it. The way it is marketed suggests I don't have to buy tokens from OpenAI for the lowest level of the product. It is USD 240 and that covers what the LLM is doing in the background. I assume you have done a behind the scenes deal based on assumed levels of non-industrial strength usage and if you want to really get serious you buy Wolfram's service credits. Have I got it right?

POSTED BY: Peter Haggstrom

You won't to buy tokens from OpenAI for either level of the Notebook Assistant + LLM Kit product. Instead of using third-party providers, you connect directly to our server and we take care of the rest.

You're correct that we've set the plan limits based on non-industrial strength usage. And yes, you have it right that if you hit those limits, you can still buy Wolfram Service Credits which will allow you to keep going.

POSTED BY: Bradley Ashby

Thanks Bradley. I have been a user of Mathematica since probably 2.0 and I was discussing the potential use of the NA with my oncologist daughter who will be doing some bioinformatics at Cambridge and Stockholm in 2025 as part of her PhD and the NA is just the sort of tool that could help her. By the way, I loved Stephen's warts and all presentation. I'll get playing with Notebook Assistant. Cheers Peter

POSTED BY: Peter Haggstrom

Bradley I bought the Notebook and it doesn't work. I have been a user since 2,0 at full commercial level and Stephen's minions have asked me to do book reviews for him on Amazon (and I did one on his book on CHATGPT). I have pursued this with the alleged "Premier Service" but what you don't realise is the commercial stuff I disclosed to them. I suggest you get in touch with them. But basically I think Wolfram has lost control of quality control - please pass that on to Stephen (the Premier service people can give you my background ) I would like to see this work but I am not hopeful. Peter

Update: NA wouldn't properly install on my Surface book. The 413 meg index file just did not want to properly extract and I messages which have an active link to GitHub - this had a real beta test vibe to it. After the 3rd attempt the index search term file downloaded and I was able to query. My frustration was doubled because 14.1 will not install on my Imac despite multiple attempts and this is the subject of a ticket.

POSTED BY: Peter Haggstrom
Posted 26 days ago

Bradley, question here please:

regarding the Essentials and Pro Suscription to NoteBook Assistant+LLM Kit; I assume both functionalities are included on both type of suscriptions, but a comment on FAQs on https://www.wolfram.com/notebook-assistant-llm-kit/, makes me doubt it:

"Wolfram Notebook Assistant is intended for human users; LLM Kit is intended for programmatic use. Pro should be sufficient for light programmatic use".

Can you confirm both NoteBook Assistant and LLM Kit functionalities are included on both Essentials and Pro Suscriptions? If so, what is the difference between Essentials and Pro suscription? Are there different plan limits between suscriptions? Could you explain them?

Thank you for clarification.

POSTED BY: Héctor Galaz

Hello Héctor, thanks for the question.

Yes, I can confirm that all of the Notebook Assistant and LLM Kit features and capabilities are included in both the Essentials and Pro subscriptions. The difference between the two subscriptions is only in the usage limits. The Pro subscription has double the usage limit of the Essentials subscription.

Hope that helps!

POSTED BY: Bradley Ashby
Posted 23 days ago

Thanks for the clarification! Regards

POSTED BY: Héctor Galaz
Posted 1 month ago

Wow. My first thought was that the Wolfram Summer School will be dramatically different in 2025. With the Assistant, students can rapidly iterate over a sets of [wholly unexpected] ideas. The overused phrase quantum leap comes to mind...

MIT (and other schools) has held an Integration Bee during IAP for the past 40 years. Maybe MIT's new Schwarzman College of Computing could hold an annual IAP Computation Bee where competitors create a set of computations/visualizations in a set of 3-minute challenges. Creative genius arises from highly-constrained competitions, and participants could could definitely "stand on the shoulders" of their fellow competitors.

The Wolfram Demonstrations Project was launched with Mathematica 6 in 2007 (I found an announcement in the MathWorld Headline News). The Demonstrations Project continues to be an excellent tool for both accessing computational principles and ways to approach computational ideas. At the same time, the Demonstrations Project doesn't sparkle. It looks inwards, but it doesn't pull people from other communities with its vast dazzling capabilities. It also doesn't reflect the vast increase in computational capability available today: multi-core architectures with embedded GPUs and NPUs.

The Wolfram Demonstrations Project could be augmented with the

Wolfram Compelling Computations Project (WCCP).

The WCCP would be a curated list of computations. Each would be introduced by a 4K video; they would be dazzling computations. The computational parts would be available by Computable Document Format files downloadable (and playable) in the Wolfram Player App. The curated notebooks playing in this environment would be an open invitation for students, researchers, and businessmen to leap into the world of AI-generated computation. To borrow from the Cupertino fruit company's marketing, it would be demonstrations of Wolfram Intelligence.

We lack the tools to solve today's problems; we certainly lack the tools to thrive in our complex environment. If there is a "right" way to think about such problems, we don't seem to be thinking that way now.The team at Wolfram Research has made a vast leap to help bridge that gap today. Thank you.

One question I didn't see Stephen address: what impact will the Notebook Assistant have on Wolfram Research's own software development?

POSTED BY: Phil Earnhardt
Posted 1 month ago

Very excited. How will this work in the cloud offering?

POSTED BY: Michael Madsen

The LLM Kit functionality is already available in the cloud. With the subscription you can use LLMFunction and Chat Notebooks in the cloud without configuring any third-party providers.

For Notebook Assistant functionality in the cloud, we make the same advanced computational AI available through Chat Notebooks as long as you're using Wolfram as the LLM Provider. You can ask it the same sort of questions, though it will be using only the current notebook as context. This is available now and we'll also be giving these interfaces more attention in the near future.

POSTED BY: Bradley Ashby

Well done with this! Within 10 minutes of using Notebook Assistant I was discovering improvements in coding a commercial solution that we're developing. Looking forward to all of the possibilities!

POSTED BY: John Cromwell

Great to hear from you, @John ! If you stumble on some neat examples - please share :-)

POSTED BY: Vitaliy Kaurov
Posted 1 month ago

First try, first error message after having subscribed and relaunched (Wolfram or Mathematica. Who knows now ?) : **The service returned the following error message: Invalid 'tools': \ empty array. Expected an array with minimum length 1, but got an \ empty array instead.** The question was: "produce the code needed to plot the next 10 days sunrise time . On this plot the time should be on the Y axis while the date should be on the X axis . " I must confess that after more than 15 years of using Mathematica I can't get a DateListPlot so I had the insane hope that with an AI .. Funny how difficult sometimes it is to get something rather trivial...

POSTED BY: Patrice Turpin

There was a bug which I reported to the developers and I believe they have pushed out an update that should fix this. If you continue to have this issue, you should contact technical support.

POSTED BY: David Reiss
Posted 1 month ago

Thank you. Now it works . I still cannot get my DateListPlot with the sunrise time but it is another issue :-). What is fun is that the assistant produced the code and then corrected it without result. How human this trial, error ... Thanks again for your very fast answer.

POSTED BY: Patrice Turpin

You are welcome. It was something close to my heart because internally I was the first person to run across this :-). And the developers were very responsive in getting it fixed as quickly as possible.

POSTED BY: David Reiss

Thanks for bringing this up. We've found the issue and deployed and update that should fix this for you. You can use ResourceFunction["InstallNotebookAssistant"][] to update all of the relevant paclets and then you'll need to restart the app afterward.

POSTED BY: Bradley Ashby

Impossible not to enjoy the dinosaur story from Stephen :-) A quote from https://wolfr.am/NotebookAssistant

And that reminds me of the very first time I ever saw a computer in real life. It was 1969 and I was 9 years old (and the computer was an IBM mainframe). The person who was showing me the computer asked me: “So what do you want to compute?” I really had no idea at that time “what one might compute”. Rather lamely I said “the weight of a dinosaur”. So, 55 years later, let’s try that again:

enter image description here

enter image description here

POSTED BY: Vitaliy Kaurov
Posted 1 month ago

Can it be used in Country like Hong Kong ?

POSTED BY: Alan Mok

You shouldn't have any problem accessing our services from Hong Kong. We aren't restricting access there from our side. We also checked and someone in Hong Kong is currently able to reach our systems.

POSTED BY: Bradley Ashby
Reply to this discussion
Community posts can be styled and formatted using the Markdown syntax.
Reply Preview
Attachments
Remove
or Discard

Group Abstract Group Abstract