Hi Ehud,
I don't think there is a way to do that without rasterizing the column and adding the lines. If combining the plots is acceptable
Show[p1, p2,
Graphics@InfiniteLine[{1.1, 0}, {0, 1}],
Graphics@InfiniteLine[{-1.4, 0}, {0, 1}],
PlotRange -> All]

or
Show[p1, p2,
GridLines -> {{{1.1, Black}, {-1.4, Black}}, None},
GridLinesStyle -> Directive[Black, Thickness[0.003]],
PlotRange -> All]