This looks like him in 1871
RG10 Piece 1348 Folio 87 Page 14
Burton Lane Cheshunt
Charles Burgess 36 agricultural labourer born Cheshunt, Hertfordshire
Agnes Burgess 36 Greenwich, Scotland
James Burgess 5 Chatham, Kent
Emma Burgess 3 Chatham, Kent
Maria Burgess 11 Months Cheshunt, Hertfordshire
I wonder if he married in Scotland. Now we know he left the service after the 1861 and before the 1871 census.