It sounds like you want a tighter packing, so you might try
GraphLayout -> {"PackingLayout" -> "ClosestPacking"}
or
GraphLayout -> {"PackingLayout" -> "ClosestPackingCenter"}
But yeah, if you want fine-grained control over placement, you'll probably end up specifying your own vertex coordinates.