Group Abstract Group Abstract

Message Boards Message Boards

Set default Chat-Notebook Model to something other than base gpt-3.5-turbo and gpt-4?

Try as I might in digging through the LLM documentation, paclets and libraries for the LLMfunctionality and the chatnotebook stuff... i cannot find where I can change the default and/or the options of the Chat-enabled or Chat-Driven notebooks to use other models than the gpt-3.5-turbo or gpt-4.... in the UI specifically... on the chat bubble menu...

I know how to do this programmatically when using LLMConfiguration and what note... but i really want the default setting to gpt-4-32k... and to be able to add more model options to that chat bubble UI.

enter image description here
POSTED BY: Russell Foltz-Smith
8 Replies
Sort By:

looks like in this latest paclet update the bigger models are available in the chatbook menu now https://resources.wolframcloud.com/PacletRepository/resources/Wolfram/Chatbook/
POSTED BY: Russell Foltz-Smith

AFIK, gpt-4-32k is not currently supported by OpenAI's API. I'd love to have it but alas... My custom API calling code has the body of the HTTPRepsonse from a URLRead, the following:

{
    \"error\": {
        \"message\": \"The model: `gpt-4-32k` does not exist\",
        \"type\": \"invalid_request_error\",
        \"param\": null,
        \"code\": \"model_not_found\"
    }
}
POSTED BY: David Reiss

yes, you have to have access to it :). so if one does... one would very much like to set it as my default as many things one does in a Chatnotebook far exceeds 4-8k in tokens. :)

Thanks for checking on it!
POSTED BY: Russell Foltz-Smith
POSTED BY: David Reiss

oh this works very nicely! thank you for this.

that project we did together was so lovely and good. i also have some version of the code. one day, perhaps, i will revisit some of those concepts!
POSTED BY: Russell Foltz-Smith
POSTED BY: Russell Foltz-Smith

At the moment GPT 3.5 and GPT 4 are all you can choose from in v13.3. But if you look in the app's Settings/AI Settings you'll see that support for Claude and Bard are on their way.

enter image description here
POSTED BY: Arno Bosse

ya. i mean we already use Palm/bard with the LLMfunctions and PalmLink paclet in the paclet repository.

but there is a way to set the GPT based models... i just don't know the location that the front end is pulling it from.
POSTED BY: Russell Foltz-Smith
Reply to this discussion
Community posts can be styled and formatted using the Markdown syntax.
Tag limit exceeded
Note: Only the first five people you tag will receive an email notification; the other tagged names will appear as links to their profiles.
Reply Preview
Attachments
Remove
or Discard