UPD: I re-installed Mathematica and it fixed the problem. Maybe the cause was that I installed CUDA Toolkit after the previous Mathematica installation downloaded GPU libraries and threw an error.