Can't Access Web site but can access Central Admin via VPN on cloud server

I'm using SP Foundation 2010 on a cloud web server via VPN on Server 2008 R2 platform with IIS 7.5 as a preconfigured image. When I use RDC to access the web server I can access Central Admin and the site I created with it OK from the server itself. When I try and access these sites from my local machine I find I can access Central Admin OK, but accessing the site gives me Error 404. The cloud support isn't much help with this problem.

Can anyone help with this?

Simon Kravis