Mothers maiden name on the GRO's own birth index is Barge. A Henry Burford married Celia Barge 1884 Barton Regis Registration District (same district where their children including HF were registered.
I - too - would think the 1881 birth year given in 1939 was an error and should have been 1891 which ties in with the death entry and birth reg'd Mar.1891. The 1891 census is definitely the right family - surname mistranscribed by Ancestry and should read Burford (the 'f' is quite clear). Young Henry was just 2 months old on 1891 census which ties in with his birthday of 28th Feb.
HF was born in Henbury, Glos. and was born it would seem on 28/2/1891 and was baptised at Henbury on 29/8/1891 - father Henry David Burford and mother Celia.
Henry David Burford was baptised 7/4/1860 Grosmont, Monmouthshire son of Esau Burford and Ann (Gwilliam) but a tree on Ancestry indicates Esau was born in Gloucestershire.
Annette
