Thanks Guys for the replies. Yes, I ended up doing Arrowheads and Arrow.

Table[{Graphics[
   Table[{Arrowheads[Tiny], 
     Arrow[{2*quadrantsize*ijtablelens[[i, j]] - quadrantsize, 
       2*wmlenslet[[n, i, j]]*ijtablelens[[i, j]] - 
        quadrantsize}]}, {i, 1, numoflens}, {j, 1, numoflens}], 
   PlotRegion -> {{0, 1}, {0, 1}}, PlotRange -> All, 
   ImageSize -> Small, PlotLabel -> n  , Frame -> True, 
   AxesOrigin -> {0, 0}], 
  MatrixPlot[wavefr265[[n]], ImageSize -> Small , PlotLabel -> n], 
  ArrayPlot[specklesraw[[n]], ImageSize -> Small , 
   PlotLabel -> n]}, {n, 900, 950}]

The ListVectorPlot in place of Graphics was very similar to this. When I Showed the two on the same canvas I could see clearly that ListVectorPlot was plotting something totally different, although according to documentation the starting point of the vectors should have been the same.

I'm not sure I know what you mean. Can you give an example?

ListVectorPlot is often confusing because it tries to smooth out data and show vectors at even intervals. It's very often the case that someone uses the function when they really don't want to be using that function.

Sometimes the answer is to use the option VectorPoints->All:

http://reference.wolfram.com/language/ref/VectorPoints.html

Sometimes it's easier to build your plot with Arrows and Graphics:

Graphics[{Arrowheads[0.02], Flatten@Table[ Arrow[{{x, y}, {x, y} + 0.1 {y, y}}], {x, -3, 3, 0.5}, {y, -3, 3, 0.5}]}, Axes -> True]