How to control the Image Assistant Toolbar?

(Cross-posted from MMa.SE.)

When we select an Image in the FrontEnd, the Image Assistant Toolbar appears attached under it:

toolbar

How can we temporarily prevent the toolbar from appearing when an Image is selected?

Maybe using this:

image = RandomImage[];
SetOptions[RasterBox, RasterBoxOptions -> {ImageEditMode -> False}];
image

Not sure if this is the “recommended way”, but it seems to work for me.