So at the end I got it working.
I removed all 11.x versions an deleted the wolfram and mathematica directories in the
C:\Users\lvveen\AppData\Roaming directory.
After re-install I received an installation error:

I decided to ignore it and move on..
I went to the ImageRestyle documentation and started the example
Then it started to reload the GPU libraries

After this a restart was asked:

After the restart back on the page and a download was started again (this did not happen with previous installs)

Now it works for ImageRestyle:

and also for NetTrain:

I'm still a bit worried about the install error message but it seems to have no effect. Would love to hear if this is indeed save to ignore or not.