And we do know that Voldemort had always wanted to be unique and the 'lord' of everything, which he ultimately did become. But this is also true that a child, whatever hopes he has for the future, can be abandoned if he is treated, and up raised well in their childhood, which Voldemort wasnt...so maybe, it isn't actually Voldemorts fault, overall!