Look very carefully for each of the very tiny changes made to what you wrote.
In[1]:= sol = FindFit[{{171.29, 6}, {171.63, 12.1}, {171.86, 24.2}, {172.06, 48.3}},
(((Sqrt [a^2 + 8 a y] - a) (b - c))/(4 y)) + c, {a, b, c}, y, MaxIterations -> 10^4]
Out[1]= {a -> 324223., b -> -8925.88, c -> 8.45726*10^6}
In[2]:= Show[Plot[(((Sqrt [a^2 + 8 a y] - a) (b - c))/(4 y))+c/.sol, {y, 171.29, 172.06}, PlotRange->{0,50}],
ListPlot[{{171.29, 6}, {171.63, 12.1}, {171.86, 24.2}, {172.06, 48.3}}]]
In[3]:= sol = FindFit[{{171.29, 6}, {171.63, 12.1}, {171.86, 24.2}, {172.06, 48.3}},
a y^2 + b y + c, {a, b, c}, y, MaxIterations -> 10^4]
Out[3]= {a -> 94.8838, b -> -32524.8, c -> 2.78726*10^6}
In[4]:= Show[Plot[a y^2 + b y + c /. sol, {y, 171.29, 172.06}, PlotRange -> {0, 50}],
ListPlot[{{171.29, 6}, {171.63, 12.1}, {171.86, 24.2}, {172.06, 48.3}}]]