Why would Voldemort care about Harry’s mistreatment? He’s happy when Harry is miserable. If he killed them it would be because they’re Muggles.

Voldemort had no reason to go after the Dursleys.

There’s no reason but I don’t like the Dursley’s, they make me want to burn the tv.