Yes i was testing if it had to do with those settings.
It persists after rebooting.
All my other applications look perfectly fine.
I set my scale of mathematica to 75% else it is even worse the normal font then is way to large compared to the rest of my screen. But the relative small scaling of these labels in manipulate seem to be not affected by that.
If I set my system scale and layout to 100% everything is correctly in proportion. However than everything is so small i cant even read anything. So it seems that everything in the mathematica application is scaled correctly by the system scaling but not the manipulate labels.