I want to solve the Laplace equation with Neumann boundary conditions
on all boundaries, The solution seems random when I do not include any
DirichletConditions though.
You can't have Neumann boundary conditions on all boundaries. This is ill-posed problem as there is no unique solution in this case. One of the boundaries must be Dirichlet.