Easiest just to generate all of them and then cull out a “canonical” set of coset representatives. One way is to enforce that the top left corner be less than the other three corners (a rotation would give one such representative) and that the top right be less than the bottom left (a reflection would give that).
This is rather neat - the question and the answer. The only thing I could come up with was explicitly defining symmetry operators, explicitly generating symmetries subset and then excluding that from the original permutation set. That would be terribly cumbersome - Danny’s answer is so simple.