If you don't want to pay for it then by all means move. If you don't move then you're stealing the service provided by the military without paying for it. And no, you don't get to claim you didn't consent to the service. The United States and its military were here long before you were. If you buy property in America you do so knowing full well what American residency entails.
And that's kind of the problem. Even before we go into the specific ways this policy might anger other countries, you're resting the security of your country on the assumption that it definitely won't, that everything will always go right. Your planning is based on a best-case scenario, not a worst-case scenario. You're making an investment while ignoring the risk. You're engaging in wishful thinking.
Now, as for those specific ways other countries might find reason to wage war against you, the first and most obvious is that if everything does go right for you and you get rich off of trade, then you're rich. Attacking rich lands and taking their wealth is one of the oldest reasons for warfare there is. Your invader might just want to plunder you and leave, they might make you a tributary, or they might try to conquer you so they can control and tax this wonderful trade hub directly. That's one reason. Reason two is that your invader is another trading power and wants to shut down your trade, rendering theirs more valuable. States can engage in monopolistic practices just as easily as companies can. Reason three is that in your neutrality you're trading with both sides in a war, and one side decides that your trade is benefiting the other side too much to be allowed to continue unabated. Reason four is that your land is strategically valuable. Reason five is that you're just plain the wrong religion. Reason six... reason seven... I can go on and on. Human beings don't exactly need a lot of excuse to go to war.
And before you dismiss these scenarios as not likely, remember that, between the two of us, I'm the one drawing his arguments from the historical record, and you're the one repeatedly face-planting into that same record. Not only can I provide examples of all these things actually happening, I can provide examples of all these things actually happening without leaving the freaking Netherlands.
Washing your hands of moral responsibility for the consequences of your actions is not a good way to convince us that libertarianism is the morally superior system.