I am not sure though if he loved Saroj. He certainly wasnt in a monogamous relationship with him and grieved for him briefly before moving on. Not that we expect him to grieve for years like RNJ did for Sona and possibly having multiple partners was a way of life for members of the royal family. I feel Saroj was around to take care of Laksh's needs and for moral support so it might have been convenience turned to friendly affection.
About the outrage, Bertie made a great post.
Interesting info on Shakuntala Devi. TFS.