I recently upgraded my GPU to an NVIDIA RTX 3060 to handle more local calculations. Therefore, I conducted a simple test to calculate the AbsoluteTiming using TargetDevice, considering "CPU", "GPU", and "CUDA" as an alternative to "GPU". I've included the code I used:
Clear[img]
img = RandomImage[]
AbsoluteTiming[
NetModel["Wolfram ImageIdentify Net V1"][img, TargetDevice -> "CPU"]]
(*0.0306286,"igneous rock"*)
AbsoluteTiming[
NetModel["Wolfram ImageIdentify Net V1"][img, TargetDevice -> "GPU"]]
(*0.0575578,"igneous rock"*)
AbsoluteTiming[
NetModel["Wolfram ImageIdentify Net V1"][img, TargetDevice -> "CUDA"]]
(*0.05472, "igneous rock"*)
Can anyone tell me why my GPU is running so slowly?