Windows Remote Desktop only works in lan.. Stopped working through external ip

[krone6]

This is driving me nuts. Randomly window's remote desktop stops working through my external ip. The last thing i did was turn a port off then turn it back on, now it stopped working. I restarted the service, restarted the computer, did an ipconfig/renew but nothing works... The port's right as well. I am out of ideas and google hasn't returned anything.

Wow, now it works again. As said, it's random.