Sean,
Thankyou for replying. I am staggered at how quickly I got a response and for my first ever posting!
I have Thomas Gurr, his wife and 2 children Alfred and Thomas William living in the parish of Rye Foreign, and in Lea Farm, Rye in the 1841 & 1851 censuses respectively. The birth record you found seems correct and certainly fits with names.
I haven't actually had sight of the removal order just knew of its existance. Does it have any detail that would help me? Your mention of a Joseph as a possible sibling could be a clue.
One more thing I wonder if you could let me know your sources as I am trying to be thorough and not fall into the trap of running up the wrong branches of the tree!