being annoyed feels evil

I wonder if people only annoy and aggravate me to the extent that evil still resides in my heart?