How do I compile some application from sources inside a VPS? It does not seem to have gcc installed.

If gcc is missing, it means the development package is not installed on your vps. Please open a support ticket and we can install it for you.