I'm not aware that Mathematica supports gradient boosting regression but like many specialized analyses that Mathematica doesn't do, you can call the gbm package (and a few others) in R from Mathematica to perform that analysis. (Of course, if you aren't using any features of Mathematica, then doing such analyses directly in R might be preferable.)
