I see no reason to doubt that this was correct and the number exists in the 1851 census.
1864 was the date of the marriage of Lizzie Bayley and 35 Spencer Street was given as her residence