To connect to your Windows VPS or Dedicated server, you use Remote Desktop Connection. Go to: Start > All Programs > Accessories > Remote Desktop Connection. Then you will be brought to this:
Under Computer:, enter your server IP. Then you will be brought to the Windows login page. Login with the details you got in the email, then you should be all set!