In the second order case DSolve provides conditions on the parameters:
DSolve[{yy''[x] + Mu^2*yy[x] == 0,
  yy[0] == 0, yy[l] == 0},
 yy[x], x]
In the fourth order case, we may impose the initial conditions first and the final conditions later:
sol0 = DSolve[{yy''''[x] + Mu^2*yy''[x] == 0,
   yy[0] == 0, yy''[0] == 0}, yy, x]
conditionsAtL = {yy[l] == 0, yy''[l] == 0, Mu > 0, l > 0} /. sol0[[1]]
paramConditions = conditionsAtL // Solve
finalSols = yy[x] /. sol0 /. paramConditions