to leave a situation in which you are involved because you are dissatisfied with the way things are going. The use of this expression suggests that you are wrong to do this.
Many people regard a U.S. presence as a desirable counterweight. No one wants the U.S. to pick up its marbles and go home.