Use AppearanceElements. This removes it from both the full Manipulate and from next to the slider.
Manipulate[u, {u, 0, 1, AppearanceElements -> {}}, AppearanceElements -> {}]
and this just the full Manipulate:
Manipulate[u, {u, 0, 1}, AppearanceElements -> {}]