Hi,
To remove the axis add Frame -> False option.
Here is how you can  determine the location and use it:
DynamicModule[
    {pt={0,0}},
    ClickPane[
       Dynamic[
         Set[POINT,pt];
         Graphics[{White,Rectangle[{-1,1}],Yellow,Disk[],Black,Point[pt],Text[POINT,{1,1}]}]
       ],
       (pt=#)&
    ]
]
Here the most resent clicked position is saved into variable POINT. 
POINT    
(* {0.301814, -0.12529}*)
Note, that it is possible to use your function : point -> contry instead of Set[].
I.M.