Do I need to give myself specific access through the shared firewall for remote access to my VM?

No. Any time you access a server via the WMS control panel, your IP address is automatically and transparently permitted temporary access to all ports on that specific server. When you leave the control panel, those ports are automatically closed behind you.