So, as I understand now, you have an overdetermined system of linear equations and thus you probably can't solve them exactly. So, I believe you should explicitly use functions which are designed to find approximate solutions for such systems, like LeastSquares (https://reference.wolfram.com/language/ref/LeastSquares.html).
This function requires explicit matrix of the system and vector of the right part. In order to construct them I suggest using CoefficientArrays function (https://reference.wolfram.com/language/ref/CoefficientArrays.html). Suppose you have a list of equations eqns and a list of variables vars; then calling CoefficientArrays[eqns, vars] will yield a list of two SparseArrays where the first one will correspond to the right part and the second - to the matrix of your linear system.
I am not sure if it will reduce the computational time, but as far as I understand, it is always better to give a computer all hints of what you are solving that you can give. Good luck!