I don't know. It was my impression that people don't always feel the same way they think, so maybe he only sees one side of the whole story.

[He pauses as he thinks back to what happened.]

.....Maybe it bothered him because he couldn't pretend he didn't see it.