Technically it would.
But you can go around all live being scared of things that are very unlikely. That's not recommended.
Just be careful online, and have your programs like Java, your AV, your browser and the operation system itself updated.
I have bluetooth enabled 24/7 in order to connect to my smart watch, and i am not worried.
You are way more likely to have your computer hacked. So don't worry too much about your phone.