Watch this video:
Scott Meyers: Cpu Caches and Why You Care
. Enough said