Windsor Castle

Windsor was not used as a royal residence from the beginning.

An excerpt from the article 36 facts about Windsor Castle

The kings of that time preferred to use the former palace of Edward the Confessor (one of the last Anglo-Saxon English kings) in the village of Old Windsor for this purpose.