If you say that the odds are stacked against someone, or that particular factors are stacked against them, you mean that they are unlikely to succeed in what they want to do because the conditions are not favourable.
The odds are stacked against civilians getting a fair trial.
Everything seems to be stacked against us.