It's not just the company, but also the Haven

One of the better and more concise arguments against tax havens, appealing to something other than anger at corporations:

Tax havens should be illegal in international law. They are patently unfair. […] They bear few of the costs of the modern nation state, while sucking those states dry of the revenue needed to sustain them.

Simon Jenkins, in the Guardian.