Collins COBUILD Advanced Learner's English Dictionary 4th edition Aticle 16516
hold against
If you hold something against someone, you let their actions in the past influence your present attitude towards them and cause you to deal severely or unfairly with them.
Bernstein lost the case, but never held it against Grundy.
