Group Abstract Group Abstract

Message Boards Message Boards

Using GPT-4 to generate Wolfram Language code

Yaroslav Bulatov, Together AI
Posted 2 years ago

POSTED BY: Yaroslav Bulatov
10 Replies
Sort By:

Here are related videos (discussing both code generation and narration):
POSTED BY: Anton Antonov
Cogni Curious
Cogni Curious
Posted 2 years ago

Hi Anton,

Can open AI mode be used with Wolfram Desktop?

POSTED BY: Cogni Curious

Yes.

  1. Install the paclets "OpenAILink" and "OpenAIMode".
  2. Follow the setup instructions in "OpanAILink".
  3. Run Needs["AntonAntonovOpenAIMode"].
  4. Run OpenAIMode[] in a desired notebook

More details are given in this discussion.
POSTED BY: Anton Antonov

The main challenge I have found is getting ChatGPT 4 to produce correct vectorized code. Even given quite short procedural code snippets, it fails in repeated attempts to vectorize them correctly.

This isn't a failing specific to the Wolfram language, however: the same thing occurs with Python and Matlab.

What I am hoping is that Wolfram will eventually provide api connectivity between ChatGPT 4 and the Wolfram documentation library, which is organized very systematically and is replete with examples of function usage. Given this, and an ability to test its own code, ChatGPT should be able to improve its performance with WL programming, over time.
POSTED BY: Jonathan Kinlay

I've had about 50% rate of success at correct vectorization. One of the issues is that transformer models use the same amount of compute per prompt. Hence, harder questions need several prompts to get right.
POSTED BY: Yaroslav Bulatov
POSTED BY: Sam Carrettie
Dave Middleton
Dave Middleton
Posted 2 years ago
POSTED BY: Dave Middleton

Another task I've had success with is "make this code faster". It's sometimes able to rewrite the inefficient For loops in terms of vectorized matrix expressions
POSTED BY: Yaroslav Bulatov
Ronnie M
Ronnie M
Posted 2 years ago

I attempted to use GPT-3 and the Codex family of models to generate Mathematica code, but I was not satisfied with most of the results. GPT-4 seems to be better. Using "You are a Mathematica programmer" as the system instruction and your prompt, I got a piece of code that was almost correct, only needing a change of := to =. However, when I used the prompt "Write a function that will compute the motion of a frictionless puck inside a square", the returned code was syntactically correct (it ran) but it computed the wrong thing. The code had hints of the Katok-Zemlyakov construction, but messed it up.
POSTED BY: Ronnie M

Indeed, it seems most useful when it's easy to check for correctness. IE, using it to generate visualization code that you can run.

I've asked to implement fast algorithm to compute Tr(A+B)^n for matrices A,B, and it made an algorithm which assumed matrix multiplication is commutative.
POSTED BY: Yaroslav Bulatov
Reply to this discussion
Community posts can be styled and formatted using the Markdown syntax.
Tag limit exceeded
Note: Only the first five people you tag will receive an email notification; the other tagged names will appear as links to their profiles.
Reply Preview
Attachments
Remove
or Discard