Wonderful! It's a really good idea to use group stabilizer!
In addition, I think
Permute[CharacterRange["A", "E"], #] & /@ GroupElements@GroupStabilizer[pg, {1, 2}]
may help simplify the code in part "Using group stabilizer".