Totally understandable!! My first reaction would be to be offended as well!

If it was a constant comment made than for sure I'd be miffed and would feel the need to "toot my own horn" lol. If it's occasional, I'd chalk it up to guilt!