To a point. However, it's also rather painful to add after the fact in many architectures, and you've ever been up against that wall once, you'll never want to be in that situation again.

Plus, almost all of these techniques will also speed up page generation on a lightly-loaded server, so that's a win in any circumstance.