Thing you're missing is that this still has conductivity, but since the system is on, the circuity is already active, but if you turn it off, no current goes, and the oil is not conductive enough to short it in front of you. If you turn it off, there's no current. Turn it on, and it'll short.