Sanki has always had a problem with Raghav. Maybe for hik that first impression is the last wala saying works and moreover it's his nature to dominate that he's transfered onto his son. And hence when Raghav refused to bow down to him his ego was badly bruised. That is why all the hatred for Pallavi came in too when she got associated with Raghav.
Mansi too was brainwashed by her mother like we had Amrutha in the initial days until she got the clarity. Amrutha was not aware of the truth around her, she was living in a bubble that her mother made out for her filled with negativity until she walked out of it but unfortunately Mansi walked in.
Both Mansi and VD do have humanity in them and some old love for Pallavi but their anger, ego, senseless brain is overpowering all of it. They've wanted to be against her but not in favor of something that physically hurts her. Same goes for Sulo, she has her own differences with Pallavi which we're truly not aware of maybe there is something more to their relationship story that's yet to unfold but Sulo never wanted to harm Pallavi physically. It was always emotional torture and nothing more.