Right now when I open a notebook and first evaluate a cell, I'm prompted if I want to evaluate all the initialization cells. How can I set up Mathematica so this evaluation happens automatically when I open the notebook?
You can use the Option Inspector interface to set the desired behaviour:
Be aware that this is a global setting and potentially dangerous if you are working with notebooks from an untrusted source.