Shagun doesn't affect him, even her words didn't stay back in his mind. It was Ishita and his turmoil related to her that had him occupied. And the fact that in all the pain in his life, she finds happiness and has no complains, it makes him more guilty. It was all about Ishita not Shagun.