Census
1851 St Paul's Bedford
George Gray born Eaton Socon, Bushmead, Bedford 1812 - Draper
Eliza Gray Daughter born Bedford 1840
1861 St Paul's Bedford
George Gray born Eaton Socon, Bushmead, Bedford 1812 - Tailor & Clothier
1871 St Paul's Bedford
George Gray born Eaton Socon, Bushmead, Bedford 1812 - Tailor
1881 13 Green Hill St ST paul's Bedford
George Grey born (as above) 1812 - Tailor
1891 St Paul's Bedford
George (GRACE - incorrect transcription) Gray born as above - Tailor
Eliza Gray daughter unmarried born Bedford 1840
George Gray died 1892 March ¼ Bedford vol 3b p261
1901 Broomfield St Paul, Bedford
Eliza (GADY - incorrect transcription) Gray Head born 1840 Bedford unmarried living on own means
Julia (GADY - incorrect transcription) Gray sister born 1845 Bedford unmarried living on own means
Eliza Gray died 1906 March ¼ Bedford vol 3b p191
Looks like this could be your George Gray from Julia's return to the fold in 1901 census.
Couldn't locate Eliza in 1861, 1871, 1881 yet and Julia has only appeared in 1851, 1861 so far.
Good luck
Heidi