CUDA worls perfectly with Mathematica 2.2 AND CUDA Toolkit 11.2 . this is sure I just installed it and tested. I repeat Toolkit 11.2 . You can find it on nvidia web. Excellent :) Greetings to all members.

The update we pushed (MXNetLink and MXNetResources) updated the NetTrain GPU implementation to CUDA Toolkit 11.2, which was necessary to add support for the latest-generation Nvidia cards. However, it appears that CUDA Toolkit 11.2 is incompatible with the beta driver you're using, 465.21.

It appears Nvidia released an update yesterday that should help you: https://forums.developer.nvidia.com/t/new-cuda-on-wsl2-wip-driver-465-42-is-now-available-for-download/167166

We are pleased to inform you that WSL2 WIP driver 465.42 is now available for download. CUDA 11.2 toolkit will be functional for WSL v2 with this release. The soul of this driver release are some performance improvements we have made. Please let us know below what you think!

Where I am working we have

1) a Win 10 pc with GEForce GTX 1060 graphics card that works fine with CUDA on Mathematica 12.2

2) a Win 10 PC with two old GTX 660 cards that will only run CUDA on Mathematica 12.1 and not with Mathematica 12.2 (regardless of whether NVIDIA toolkit v10 or v11 is installed)

3) Two iMac running Win 10 with GTX 675 cards, neither of which will run CUDA with either Mathematica 12.1 or Mathematica 12.2 (earlier versions of Mathematica 11 work fine with CUDA)

Besides these kinds of inconsistencies various of the CUDA functions don't work as advertised, for example the CUDAFinancialDerivative with AsianArithmetic options, one of the examples in the documentation, just returns infinite values.

It's an unreliable mess.

CUDA Toolkit 11.x should work (but 10.x will not).

Thanks for the driver update suggestion! Mathematica is now back to working with the GPU, after I:

1) Uninstalled CUDA Toolkit v11.0 and installed v11.2 2) Updated the driver to v465.42 3) Uninstalled and reinstalled latest Mathematica paclets for MXNetLink and MXNResources (not sure how much this is necessary, I did it only because I was trying before to roll-back the updates)

Note that skipping step (1) above and keeping CUDA Toolkit 11.0 resulted in a working set-up, but I still got an error when running neural net computations after loading CUDALink (or the other way around). I'm guessing this was due to CUDALink and MXNLink being confused about toolkit versions, so I just updated everything to run on v11.2... but note that TensorFlow doesn't play nicely with v11.2, so this required extra tinkering on the side.

Could you please contact Wolfram Support (https://www.wolfram.com/support/contact/) with the details?

Hello. Here are the outputs for commands you asked:

In[2]:= CUDAQ[]

Out[2]= True

In[3]:= InstallCUDA[]

Out[3]= Success["CUDALinkLoaded", 
Association[
 "MessageTemplate" :> "CUDALink installation complete.", 
  "CUDAVersion" -> 11.2, "DefaultDevice" -> "GeForce RTX 2070", 
  "Toolkit" -> "C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\
\\v11.2", 
  "NVCC" -> "C:\\Program Files\\NVIDIA GPU Computing \
Toolkit\\CUDA\\v11.2\\bin\\nvcc.exe", 
  "LibrariesLoaded" -> {
   "C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v11.2\\bin\
\\cublas64_11.dll", 
    "C:\\Program Files\\NVIDIA GPU Computing \
Toolkit\\CUDA\\v11.2\\bin\\cublasLt64_11.dll", 
    "C:\\Program Files\\NVIDIA GPU Computing \
Toolkit\\CUDA\\v11.2\\bin\\cudart64_110.dll", 
    "C:\\Program Files\\NVIDIA GPU Computing \
Toolkit\\CUDA\\v11.2\\bin\\cufft64_10.dll", 
    "C:\\Program Files\\NVIDIA GPU Computing \
Toolkit\\CUDA\\v11.2\\bin\\cufftw64_10.dll", 
    "C:\\Program Files\\NVIDIA GPU Computing \
Toolkit\\CUDA\\v11.2\\bin\\curand64_10.dll", 
    "C:\\Windows\\System32\\nvcuda.dll"}]]

Yes CUDAFourier[[] is now working. However CUDAFold was not working before but strangely enough it is now working! so is CUDAFoldList. I don't know what changed.

Dear Stefan,

Is there an update to this issue?

Thank you, Gianni

We installed CUDA 11.2 successfully (Windows 2019 Server + Quadro GV100 and Windows 10 + Titan V) but, in both machines, CUDA functionality in Mathematica 12.2 is broken.

CUDAQ[] returns True, and CUDADriverVersion[] returns 465.21 but CUDADot[Table[i, {i, 10}, {j, 10}], Table[i, {i, 10}, {j, 10}]] returns CUDADot::nopaclet: CUDAResources was not found. Make sure that you are connected to the internet and Mathematica is allowed access to the internet.

We have invested heavily on Mathematica CUDA software and supporting hardware, so this functionality is vital for us. I hope this can be fixed asap.

The CUDAResources paclet is no longer needed as of Mathematica 12.2, and will no longer distribute CUDA libraries from now on. As such, CUDAResourcesInformation[] no longer returns any relevant information. CUDALink should now use the CUDA Toolkit libraries installed on your machine. If it is not doing so, more information would be appreciated : OS version, CUDA Toolkit version, Nvidia driver version, for example.

The latest version of NVIDIA Toolkit is 11.2 I try to install but there a incompability with another software on my comp'. I try...I will let you know. Jean-Michel

Okay so newest CUDA 11.6 added support for Visual Studio 2022. Nice.

And it fixes the fatal error:

**********************************************************************
\

** Visual Studio 2022 Developer Command Prompt v17.0.6
** Copyright (c) 2021 Microsoft Corporation
**********************************************************************
\

[vcvarsall.bat] Environment initialized for: 'x64'
C:\Program Files\NVIDIA GPU Computing \
Toolkit\CUDA\v11.5\include\crt/host_config.h(160): fatal error C1189: \
#error:  -- unsupported Microsoft Visual Studio version! Only the \
versions between 2017 and 2019 (inclusive) are supported! The nvcc \
flag '-allow-unsupported-compiler' can be used to override this \
version check; however, using an unsupported host compiler may cause \
compilation failure or incorrect run time execution. Use at your own \
risk.
CUDAFunction-9936.cu

Everything works.

**********************************************************************
\

** Visual Studio 2022 Developer Command Prompt v17.0.6
** Copyright (c) 2021 Microsoft Corporation
**********************************************************************
\

[vcvarsall.bat] Environment initialized for: 'x64'
CUDAFunction-4715.cu

Is using Visual studio 2022 compiler going to be a problem? P.S. That was a problem had to force 2019 compiler. Alas.

CUDALink stopped working for me since around Mathematica 12 or so. I've recently upgraded to Windows 10 21H1 and Mathematica 12.3.1. CUDA Toolkit 10.2 was uninstalled and CUDA Toolkit 11.4 was installed. CUDALink still did not work. I found that the CUDA Toolkit 10.2 uninstall leaves the empty directory

C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v10.2\bin

Once I deleted it, Needs["CUDALink`"] finds the

C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.4\bin

directory and the CUDA functions like CUDAToolkitCompatibilityInformation[], CUDAQ[] (returns true), SystemInformation[] (shows driver and GPU status), CUDAInformation[], and CUDADriverVersion[] work as documented. I had also created and set CUDA_PATH to

C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.4

because CUDA Toolkit 11.4 creates CUDA_PATH_V11_4 instead. This did not seem to help Mathematica find the correct toolkit when Needs["CUDALink`"] is evaluated. It worked only when the empty v10.4\bin directory was removed.

Jonathan,

Sorry for the late reply, I didn't see your comment and then got pretty busy. My PC succeeds with your code. See the attached image.

I noticed you're on CUDA 11.2. I'm on 11.3. Maybe that's it?

-Greg

Attachments:

CUDA Screenshot ...png

CUDA Screenshot ...png

Jonathan,

depending on batch size, I've had the GPU crunch over 100k samples per second, but 85-90k is typical. 3-5s GPU time is typical, 5-6MIN CPU time is typical.

I'm running an EVGA RTX 3090 air cooled at 1995Mhz stable OC. My RAM is 3600Mhz, which probably also helps. There's about 35-37% CPU utilization still showing during those 3-4 seconds of GPU training.

-Greg

Attachments:

CUDA Screenshot ...png

Gregory,

Do you want to post (a link to) some WL code that I can benchmark on my Ryzen 3090 machine, to confirm your findings?

Jonathan

The current situation of Mathematica CUDA support for recent NVIDIA GPUs is really terrible. Try to compare with recent MATLAB R2021a support, where overall CUDA performance on similar tasks (discussed here) is far more better.

Wolfram Research should really solve this situation as high priority task!!! Especially in a case of new Apple M1 HW, where the NVIDIA GPUs are completely discontinued.

Stefan,

I updated the latest driver and toolkit, so I am now on 466.11 and 11.3, all latest paclets from Wolfram, NetTrain works.... kinda... 3090 core count isn't being recognized, max BatchSize is limited to 10000 batches, and when I run NetTrain, it shows my GPU utilization at 10-15% at all times. So I'm using a 10th of the CUDA power I have available. NetTrain on CPU correctly shows 98-99% utilization, though seems like 10k batches is still too small even for CPU, given the very fast RAM and PCIe4 bus speeds.
Most curiously, I'm showing +/-50% CPU utilization while NetTrain is targeted to use GPU! Why? Either way, 16s GPU time vs 19-20s CPU time is absolutely a TERRIBLE result, given the power of this GPU.

Attachments:

CUDA Screenshot ...png

Your problem is separate from most of the discussion here, which is specific to changes and updates made in Mathematica 12.2.0. Please contact Wolfram Technical Support (https://www.wolfram.com/support/contact/email/?topic=technical), and include all of these details.

NB: CUDA no longer works on older iMACs as the graphics card support for the GTX 660 is limited to CUDA ver 10.1 by NVIDIA.

You would have to revert to Mathematica V11.x to run GPU functionality on one of these cards.

I just installed Cuda from Nvidia on my Windows 10 Lenovo X1 no problem:

 In[1]:= Needs["CUDALink`"]

In[2]:= CUDAInformation[]

Out[2]= {1 -> {"Name" -> "GeForce GTX 1650 with Max-Q Design", 
   "Clock Rate" -> 1245000, "Compute Capabilities" -> 7.5, 
   "GPU Overlap" -> 1, "Maximum Block Dimensions" -> {1024, 1024, 64},
    "Maximum Grid Dimensions" -> {2147483647, 65535, 65535}, 
   "Maximum Threads Per Block" -> 1024, 
   "Maximum Shared Memory Per Block" -> 49152, 
   "Total Constant Memory" -> 65536, "Warp Size" -> 32, 
   "Maximum Pitch" -> 2147483647, 
   "Maximum Registers Per Block" -> 65536, "Texture Alignment" -> 512,
    "Multiprocessor Count" -> 16, "Core Count" -> 1024, 
   "Execution Timeout" -> 1, "Integrated" -> False, 
   "Can Map Host Memory" -> True, "Compute Mode" -> "Default", 
   "Texture1D Width" -> 131072, "Texture2D Width" -> 131072, 
   "Texture2D Height" -> 65536, "Texture3D Width" -> 16384, 
   "Texture3D Height" -> 16384, "Texture3D Depth" -> 16384, 
   "Texture2D Array Width" -> 32768, 
   "Texture2D Array Height" -> 32768, 
   "Texture2D Array Slices" -> 2048, "Surface Alignment" -> 512, 
   "Concurrent Kernels" -> True, "ECC Enabled" -> False, 
   "TCC Enabled" -> False, "Total Memory" -> 4294967296}}

In[3]:= InstallCUDA[]

Out[3]= Success["CUDALinkLoaded", 
Association[
 "MessageTemplate" :> "CUDALink installation complete.", 
  "CUDAVersion" -> 11.2, 
  "DefaultDevice" -> "GeForce GTX 1650 with Max-Q Design", 
  "Toolkit" -> "C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\
\\v11.2", 
  "NVCC" -> "C:\\Program Files\\NVIDIA GPU Computing \
Toolkit\\CUDA\\v11.2\\bin\\nvcc.exe", 
  "LibrariesLoaded" -> {
   "C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v11.2\\bin\
\\cublas64_11.dll", 
    "C:\\Program Files\\NVIDIA GPU Computing \
Toolkit\\CUDA\\v11.2\\bin\\cublasLt64_11.dll", 
    "C:\\Program Files\\NVIDIA GPU Computing \
Toolkit\\CUDA\\v11.2\\bin\\cudart64_110.dll", 
    "C:\\Program Files\\NVIDIA GPU Computing \
Toolkit\\CUDA\\v11.2\\bin\\cufft64_10.dll", 
    "C:\\Program Files\\NVIDIA GPU Computing \
Toolkit\\CUDA\\v11.2\\bin\\cufftw64_10.dll", 
    "C:\\Program Files\\NVIDIA GPU Computing \
Toolkit\\CUDA\\v11.2\\bin\\curand64_10.dll", 
    "C:\\Windows\\System32\\nvcuda.dll"}]]

In[4]:= CUDADot[Table[i, {i, 10}, {j, 10}], 
  Table[i, {i, 10}, {j, 10}]] // MatrixForm


Out[4]//MatrixForm= \!\(
TagBox[
RowBox[{"(", "", GridBox[{
{"55", "55", "55", "55", "55", "55", "55", "55", "55", "55"},
{"110", "110", "110", "110", "110", "110", "110", "110", "110", "110"},
{"165", "165", "165", "165", "165", "165", "165", "165", "165", "165"},
{"220", "220", "220", "220", "220", "220", "220", "220", "220", "220"},
{"275", "275", "275", "275", "275", "275", "275", "275", "275", "275"},
{"330", "330", "330", "330", "330", "330", "330", "330", "330", "330"},
{"385", "385", "385", "385", "385", "385", "385", "385", "385", "385"},
{"440", "440", "440", "440", "440", "440", "440", "440", "440", "440"},
{"495", "495", "495", "495", "495", "495", "495", "495", "495", "495"},
{"550", "550", "550", "550", "550", "550", "550", "550", "550", "550"}
},
GridBoxAlignment->{"Columns" -> {{Center}}, "Rows" -> {{Baseline}}},
GridBoxSpacings->{"Columns" -> {
Offset[0.27999999999999997`], {
Offset[0.7]}, 
Offset[0.27999999999999997`]}, "Rows" -> {
Offset[0.2], {
Offset[0.4]}, 
Offset[0.2]}}], "", ")"}],
Function[BoxForm`e$, 
MatrixForm[BoxForm`e$]]]\)

I figured it out. CUDA works on Mathematica 12.2 with NVIDIA Toolkit ver 11.1, but not with ver 11.2 (which is what I had installed originally).

I tested on my dell precision 7750 with RTX3000 + Win 10 + WL12.2. Your code works for me.

It returns:

True

and:

CUDADot::allocf: A CUDALink memory allocation failed.

On the iMACs running Windows 10 and Mathematica 12.2 with CUDA tool 11.2 installed, we have:

 Needs["CUDALink`"]
 CUDAInformation[]

 {1->{Name->GeForce GTX 660M,Clock Rate->950000,Compute Capabilities->3.,GPU Overlap->1,Maximum Block Dimensions->{1024,1024,64},Maximum Grid Dimensions->{2147483647,65535,65535},Maximum Threads Per Block->1024,Maximum Shared Memory Per Block->49152,Total Constant Memory->65536,Warp Size->32,Maximum Pitch->2147483647,Maximum Registers Per Block->65536,Texture Alignment->512,Multiprocessor Count->2,Core Count->384,Execution Timeout->1,Integrated->False,Can Map Host Memory->True,Compute Mode->Default,Texture1D Width->65536,Texture2D Width->65536,Texture2D Height->65536,Texture3D Width->4096,Texture3D Height->4096,Texture3D Depth->4096,Texture2D Array Width->16384,Texture2D Array Height->16384,Texture2D Array Slices->2048,Surface Alignment->512,Concurrent Kernels->True,ECC Enabled->False,TCC Enabled->False,Total Memory->536870912}}

 InstallCUDA[]
 Success[]

Then:

 CUDADot[Table[i,{i,10},{j,10}],Table[i,{i,10},{j,10}]]//MatrixForm

 CUDADot::notinit: CUDALink is not initialized.

What does InstallCUDA[] return?

What is the output or error messages you're seeing in your setups that aren't working?

Same problem here as above. CUDAResourcesInformation[] gives error, while CUDAQ[] returns true. CUDA functions do not execute. CUDA Version 11.2. Mathematica version 12.2. OS Version Windows 10 (Insider Build), GPU : Nvidia 2070 RTX. Can't get to work any of the functions like CUDAFold, CUDAFourier etc.

good to know. thank you.

This is great news. Thank you. I'm guessing this does not fix the MxNET issue and Neural Network functionality is still an issue with these new GPUs?

I tried the command

cudaFun = CUDAFunctionLoad[code, "addTwo", {{_Integer, _, "Input"}, {_Integer, _, "Output"}, _Integer}, 256]

from the documentation, but it returned the error message "CUDAFunctionLoad::instl: The compiler installation directive "CompilerInstallation" -> $Failed does not indicate a usable installation of NVIDIA CUDA Compiler (executable: CCompilerDriverCCompilerDriverBaseBaseDriver[ResolveCompilerName][Automatic])."

I have CUDA 11.2 installed and the latest Nvidia drivers, CUDA works with Visual Studio as well as Mathematica 12.1. and 12.0. CUDA seems to be broken only in Mathematica 12.2.

<< CUDALink`

CUDAQ[]
True

CUDAInformation[]
{1 -> {"Name" -> "Quadro M1200", "Clock Rate" -> 1148000, 
   "Compute Capabilities" -> 5., "GPU" ....

CUDADriverVersion[]
460.89

vec = Range[1., 10];
CUDAFourier[ vec]

CUDAFourier::internal: CUDALink experienced an internal error.
CUDAFourier[{1., 2., 3., 4., 5., 6., 7., 8., 9., 10.}]

Thank you for the feedback! We are investigating and will push out fixes as soon as possible!

Hello, I am on Windows 10 Pro edition, Mathematica 12.2, RTX 3090 GPU and I have installed NVIDIA's CUDA Toolkit 11.2.

CUDAQ[] returns True and CUDAInformation correctly recognises my GPU system. However whenever I run any GPU call the calculation will simply run forever up to the point where mathematica tells me it's not responding any more. I attach a snaposhot to demonstrate. I should mention that the same system on mathematica 12.1 run perfectly on my previous RTX 2080Ti GPU.

Attachments:

Captura2.PNG

I am getting the exact same issue.

"As of Version 12.2, CUDA on macOS is no longer supported."

Seriously?! Is there any workaround to run NetTrain[] on macOS + NVIDIA GPU + MMA 12.2?

https://reference.wolfram.com/language/workflow/UseCUDAOnAnExternalGPUOnMac.html

Please keep us informed here for any solutions...