Using Ancestry, and for 1861 census:
Click on Search and then Census & Electoral Rolls.
From the panel on the right, select 1861 Census Collection.
Scroll down, and select 1861 England Census.
Enter "Upper Norwood" in the "Lived In" box.
Enter "Palace Road" in the Keyword box - you'll need the speech marks

Then you should get a list.