I was not able to make it work without DynamicModule. I was getting errors.
Have not tried your code, but there is no need to use DynamicModule inside Manipulate. What is the reason for doing so? Manipulate itself is DynamicModule to start with.
DynamicModule
Manipulate