This article “Make your WordPress powered Website load with Lightning Speed” is a comprehensive discussion that starts with the Why and then goes on to give you a long checklist of items to review for your site.
Even if all aren’t applicable, this page is a great resource to get a lot of website clutter on the way out the door.
The BEST reseller hosting for busy web designers
