I've been trying out the new LLM features to explore the Mathematica API, and learn how to do new and interesting things. The only problem is the LLM continually lies to me, sometimes creating entirely fictional APIs. I've attached two examples. In the first notebook, I tried to get play counts of videos from YouTube. The LLM confidently returned code using a "YouTubeData" paclet that--as far as I've been able to determine--does not exist. I have to admit to spending quite a bit of time searching and reading documentation to try to get this code to work. The LLM provided helpful suggestions that did not help. It's comical.

I've been able to have the LLM write some simple code, but even then it seems it'll often be subtly wrong, or only get to the right code after a couple of correction rounds. In the second example, it makes a decent try to draw a map based on my admittedly vague request, but when I ask it to explicitly give me a 3d globe it again invents an api that doesn't appear to exist in mathematica. (Some google searching suggests that it might be from matlab?)

What am I doing wrong? Am I missing something and should this code actually work? Should I just assume that everything the LLM sends back is a hallucination?