Yes, from your service overview in the client area you will see two options. Console and noVNC Console.
We recommend using noVNC console, however if you prefer to use Console you will need Java. We also find this works best on Internet Explorer
* May need to add a security exception to your server's IP Address (Control Panel -> Programs -> Java -> Security -> Edit Site List -> Add -> Enter your VPS Main IP) and try again.