hold something against someone/something
— phrasal verb with hold us/hoʊld/verb past tense and past participle held /held/
to consider something as a reason to have a bad opinion about someone or something:
He made a mistake, but I don’t hold it against him – we all make mistakes.