Does anyone know how to set the OPENAI_API_BASE for a chat notebook? I have an OpenAI key that corresponds to a specific API base, not the default base https://api.openai.com/v1. This allows me to run it successfully. curl $OPENAI_API_BASE/models \ -H "Authorization: Bearer $OPENAI_API_KEY" \ -H "OpenAI-Organization: org-mvUSw9fFhNVVqQUesafVo0F6"

Now with OpenAI launching support for fine-tuning of GPT-3.5 it is becoming urgent to be able to set model names properly. Can we please get an ETA for when this will be added and how it will work?

Talking about this:

Wolfram badly needs a product manager!

Thanks

I am trying to create a resource definition notebook to set up a "Persona" prompt along with some LLMTools and config. First time I clicked "Install From URL..." I saw a pop-up dialog but then got an error. Now the dialog no longer appears and I just get an error when I invoke this menu option.

Something got "stuck"

How can I clean it up?

Apologies that it's not clear on https://resources.wolframcloud.com/PacletRepository/resources/Wolfram/Chatbook ! We should be able to make an update so it's more clear about SystemCredential usage

You can do: SystemCredential["OPENAI_API_KEY"] = "key" to reset what the current key is.

If you're still having an issue, my recommendation would be to check that the key is functional with the API using a curl command from the command-line (OpenAI has an example here: https://platform.openai.com/docs/api-reference/chat/create)

Here's an example OpenAI has documented

curl https://api.openai.com/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $OPENAI_API_KEY" \
  -d '{
    "model": "gpt-3.5-turbo",
    "messages": [{"role": "system", "content": "You are a helpful assistant."}, {"role": "user", "content": "Hello!"}]
  }'

If you still see an issue with your API key then there's something that has gone wrong with the API key generation and I'd recommend reaching out to OpenAI for a solution!

I'm having an issue that may be related. I have unfortunately two openai accounts. I had trouble with the first, opened a second, and then found out that there are no free credits with the second. I now know how to use the first account, but I had already logged into the second in Mathematica 13.3. Executing

chat = ChatEvaluate[chat, "What's the tallest mountain?"]

returns a "You exceeded your quota..." message. Is there a way to get Mathematica to "log out" of an openai account, so that I can log in again using the proper account? (I thought changing the API, as above would work, but it does not.)

Attachments:

screenshot.pdf

testLLM.nb

Thanks, Dave. I do have an OpenAI key -- in fact, two of them, one for each account. I think that one of these accounts does have some credit, but the second account has no credits (because OpenAI doesn't want people to use multiple accts to get around paying for more usage, which is reasonable). Anyway, executing

SystemCredentialKeys[All]

returns

{"wolframcloudconnect:www.wolframcloud.com&johnb@sfu.ca"}

The latter email address is also the user name of the "bad" account. I want to start over and use the "good" account, but I don't see how to do this. Executing

SystemCredential["OPENAI_API_KEY"] =.

does not work. (But maybe I didn't get your point -- does using any of the new LLM features in Mathematica require a paid subscription?)

John, Rohit answered the question on how to change or set your OpenAI key (Thanks Rohit).

For the OpenAI key to work within Mathematica you need an API key that can draw tokens from the OpenAI platform either through a trial or a pay-per-use account.

If your trial expired, you need to top-up your funds to continue drawing tokens with the existing key.

Apologies for not being able to respond sooner.

Mathematica will prompt for an API key upon first time use of certain services like OpenAI.

Yes, Wolfram Language will prompt you for an API key to access the OpenAI API that allows using the LLM in a Notebook.

one can verify which services have been registered in Mathematica e.g. through SystemCredentialKeys one can view which keys have been registered. Or specifically what key has been registered e.g. SystemCredential["OPENAIAPIKEY"]

Chat Notebooks and the LLMFunctions paclet (this includes functions like LLMSynthesize, ImageSynthesize, ChatEvaluate, etc.) use the API slightly differently internally. Chat Notebooks really only looks for SystemCredential["OPENAIAPIKEY"] where the LLMFunctions paclet can look at SystemCredential, an OpenAI service connection, an environment variable, and you can explicitly set your API key in the programmatic call.

How to manually set or change any API key required for a service like OpenAI i.e. SerrviceConnect["OpenAI","New"]. Some users may have clicked away the Key registration form at the initial start of a service.

If you're only using Chat Notebooks, the SystemCredential method is the way to go. If you have used or will use LLMFunctions paclet (this is new 13.3 symbols like LLMSynthesize, see: https://reference.wolfram.com/language/guide/LLMFunctions.html) then you will want to use ServiceConnect["OpenAI", "New"] to create a new connection. You can see a list of saved connections by doing ServiceConnections`SavedConnections[] and you can delete a specific connection by doing ServiceConnections`DeleteConnection[]

You only need to be able to create a valid API key from OpenAI for the services to work within Wolfram Language. OpenAI has documented what ChatGPT Plus gives you here: https://help.openai.com/en/articles/6950777-what-is-chatgpt-plus

Is the ChatGPT API included in the ChatGPT Plus subscription?

No, the ChatGPT API and ChatGPT Plus subscription are billed separately. The API has its own pricing, which can be found at https://openai.com/pricing. The ChatGPT Plus subscription covers usage on chat.openai.com only and costs $20/month.

when you sign up for a free account with OpenAI they give you a little quota so you can generate API keys and use apps that access OpenAI via API and ask for such key... This quickly runs out. at that point you need to start paying to OpenAI. I don't think you need to generate new key... I think you can keep using it. You can check usage at https://platform.openai.com/account/usage you can also see when a particular API key was last used at https://platform.openai.com/account/api-keys (well, if it doesn't work you will know very quick)