All I needed to do to remove the water pump was to use a 10mm socket on these bolts:
After those bolts were removed, I just pulled it right off:
Be careful when you pull it off though, you might drop one of these:
Those are water pump gaskets. There's one on each side, so be sure to label them correctly and remember how they go on.
To remove the oil dipstick, first remove the oil dipstick bracket bolt:
Then, just pull the dipstick tube straight up and out.
Next I'll talk about removing the heads.