Magento Hosting Performance Study

Why is Magento slow? Is Full page caching helping and is there anything else we can do to make them faster?