(While I was writing this others have said similar things, but I'll post this anyway without further editing.)
It's an interesting concept, and I think others too have mentioned feeling drawn to certain places or finding that completely unintentionally they have moved to live where their ancestors did.
I believe it has been shown that traumatic experiences can have an effect on a person's DNA, which can then be transmitted to future generations. So is it possible that more benign experiences and connections to a place also have an effect, and be hard-wired into us in some way that we can't yet explain?
I wonder if feeling "at home" in a particular environment (eg latitude, earth's magnetic field etc - the kind of thing that Rattus mentions) might be similar to whatever it is that migratory species rely on. As humans we are generally able to make choices that override instinctive behaviours and adapt to the consequences of doing so, but it doesn't seem beyond the realms of possibility that we might have some kind of default setting that connects us with a particular habitat.
I'm not a scientist, but I'm also no fan of pseudo-science. The migration of other species is a fact, though we don't fully understand how they do it. All I'm trying to say is that there might be scientific reasons for human behaviours that we don't understand either.