Group Abstract Group Abstract

Message Boards Message Boards

Local LLMs with Llama and Wolfram Language

Daniel Carvalho, WOLFRAM
Posted 1 year ago

Attachments:
DOWNLOAD-DESKTOP...nb
POSTED BY: Daniel Carvalho
4 Replies
Sort By:
Jacob Evans
Jacob Evans
Posted 1 year ago

I have this same question. I would be very useful to use the existing LLM “plumbing” with a local llamafile.
POSTED BY: Jacob Evans
POSTED BY: Daniel Carvalho

enter image description here -- you have earned Featured Contributor Badge enter image description here Your exceptional post has been selected for our editorial column Staff Picks http://wolfr.am/StaffPicks and Your Profile is now distinguished by a Featured Contributor Badge and is displayed on the Featured Contributor Board. Thank you!
POSTED BY: EDITORIAL BOARD

Thanks for posting the code and examples of hooking up LLaMA with WL !

Since LLaMA manuals say that its completions API adheres to the completions API of OpenAI's ChatGPT, how easy it is (or would be) to make LLaMA access configurations for use in WL's LLM* functions? (Like LLMSynthesize and LLMFunction.)
POSTED BY: Anton Antonov
Reply to this discussion
Community posts can be styled and formatted using the Markdown syntax.
Tag limit exceeded
Note: Only the first five people you tag will receive an email notification; the other tagged names will appear as links to their profiles.
Reply Preview
Attachments
Remove
or Discard