I can replicate it and have reported it to the developers.
Google Gemini is supported when called from LLMSynthesize -- this works:
LLMSynthesize["Hello", LLMEvaluator -> <|"Model" -> {"GoogleGemini", "gemini-1.5-pro"}|>]
