Reactive attitudes are distinctively moral emotions that occur when a moral harm has occurred. Recent studies in moral psychology suggest that our reactive attitudes may be influenced by factors extraneous to moral evaluation, such as hunger, sleep deprivation, and negative moods. I argue that these influences lead us to sanction unfairly. Even though reactive attitudes may be a natural response to perceived moral wrongdoing, we cannot justifiably inflict undeserved harm. However, if we can learn to recognize and eliminate the effects of these irrelevant influences, then we can use our reactive attitudes productively in holding others morally accountable.