In the above interface dragging the slider is tardy and rough due to slow content evaluation. In this case it is advisable to set ContinuousAction → False so the dragging of the slider is smooth and evaluation happens only on the slider release.
Communication between controls and contents is done entirely though variable values. So if you want a control’s display to update but some content to not change, then they’ll need to be attached to different variables. Here’s an example of a single control that changes two local Manipulate variables -- one continuously as the control changes, and another only when the mouse button is released: