I believe that if you want to use the GPU for a calculation like this, you basically have to program it yourself in C. Mathematica cannot do such things automatically for you.
