It becomes a problem if you do not apply the letter of the law universally.

If you turn a blind eye to the behaviour of someone you agree with, even if they're doing something that is against the rules (or the spirit of the rules) but you come down hard on someone else for actions that are the same (or lesser); then it's a problem for me.