I might be mistaken, but I think if you implement LSA using a principal components methodology (PCA), that will use the singular values decomposition (SVD) under the hood. When the dust settles from all those acronyms, you end up using a Euclidean metric, because that's what SVD gives you. So this flavor of PCA is a least-squares method.