One concern for page speed is when a user comes to your website using a CPC ad or affiliate ad. Those links usually have tracking parameters on them (ie: utm_content) and as a result can slow down a page being sent to the end user. What is worse, is that those links are usually dynamically generated, so each subsequent link will have to be rebuilt from the cache.
If your hosting is slow, this can be a killer situation.