f[x_, y_] := Piecewise[{{1, 4 < x < 6 && 4 < y < 6}, {0, True}}]
Plot3D[f[x,y],{x,0,10},{y,0,10}]
I am presuming you mean that x should be between 4 and 6 AND y should be between 4 and 6 rather than x should be between 4 and 6 OR y should be between 4 and 6