I've been asked to automate regression testing. i.e. script the testing needed to make sure that any and all customizations continue working as they should after an upgrade and/or big cross-module deployment.
With 35 custom modules and counting, and practically every stock module modified from APIs to logic hooks to controllers... I'm not sure how to approach this.