Mathematica is possibly a 10GB installed application on a Win PC. And you want the engine as standalone app on USB thumb drive? Nice.
You can google if VNC can be installed as portable app on USB flash drive. You'd still need mobile internet with VNC.