One of the reasons many people, including myself, ship Drarry is because if you notice, everything Draco says from the 4th book up could be taken as a Compliment or a insult, and as we see the scene or chapter from Harry's oblivious prospective, he doesnt notice this and takes it As a insult, anyway it's all just our opinions