I found out how to do this
test[[All,"location"]]
Then using the following
Normal[test[[All, "location"]]]
will return the values of the chosen column