He is living in Durham in the records I have him in -
In 1881 - at 5 Cowsley Row, Cornsay, Durham, with wife Jane Raine and children. Class RG11 piece 4946 folio 11 page 18
In 1891 census, living at Front Street, Lanchester, Durham - Class RG12, piece 4095, folio 11 page 15,
He is with his wife Jane and family. His mother who has re married - Sarah Wardle, and two half brothers are listed with him.
I think this is him in the 1861 census, where he's listed as T. Wardle (not Raine) - Washington, Durham, Class RG9, piece 3763, folio 14 page 21