I think that he meant that it may be hard to face your enemies, people you hate, yet it may be even harder to face your friends, because you care about them.
I think it is hard to face your friends because you know them. You usually want to please them. If they want you to do something they are not comfortable with , and you do not want to that is called " peer pressure ".
