Thanks for your reply. Your solution works for 3x3 matrices, but hangs on 4x4 matrices. It aborts on TimeConstrained[ svdInverse[m] ], 180]; in any case it is slower than Inverse and qrInverse.
However, the point is moot, since on my computer with version 14, it has stopped working for 4x4 (and presumably larger) matrices.
I tried SingularValueDecomposition because Weisberg seems to mention it here (Weisberg, Sanford. Applied Linear Regression (Wiley Series in Probability and Statistics) (p. 309). Wiley. Kindle Edition), although I cannot immediately find where he actually recommends its use.
The singular value decomposition is useful and effective for floating-point matrices. It is hardly surprising that it bogs down already for 4x4 matrices in the exact case. Try this with a 20x20 matrix: