I was reading the Sorcerer's stone and it just crossed my mind that Harry and Hermione and all other people were able to see the Potters' hiding spot. The strange thing is that the house was protected by the Fidellius Charm and can only be seen by the people to whome the secret keeper has revealed its location; in this case, Wormtail. He was alive when Harry and Hermione visited Godric's Hollow and they both saw the house in ruins.
I don't think the charm was broken because the same charm was cast at the House of Blacks and it was not broken when Sirius died.
Does anyone has any explanation to this or is it just a plot hole?