Another question, does Mathematica kernel work on both machines independently?
Yes, Mathematica works perfectly locally on each machine. In fact, this is an issue with this particular local Windows machine : i have another local computer, a Mac, which can use the remote Linux machine without any problem...
Does that happen any cell or just one with a specific command?
It happens with any cell, no matter its content it seems...