Hi Jan,
I hope you are keeping well and thanks for your kind offer to help.
I've been going over this string and like the look of the following theory-
Extracts-
John Henry Marsh was baptised All Saints 8 April 1804 parents John and Sophia
a John Henry Marsh, son of John Marsh of Chichester entering into articles of clerkship (i.e. training as a solicitor) under James Bennett Freeland of Chichester, 31 May 1821.
It looks from the 1833 death duty register (though faint and barely decipherable) as though John Henry Marsh died intestate, his administratrix being Mary Marsh (perhaps she was his widow?).
Preston Chronicle, 5 November 1832
On 24 ult., at St Michael's, Toxteth Park, John Henry Marsh, Esq, of Chichester, to Mary, eldest daughter of Wm Hurry, Esq., of Toxteth-park.
A son, John Henry Pakenham Marsh, was baptised in 1834 after his father's death:
Conclusion-
Could Joseph have been a second son to Mary and a new aquantance, (possibly Mr Pakenham?) although Mary would be getting on by 1853.
Could Joseph have been JHPM's son?
Maybe Joseph went by the name Joseph Pakenham in his early years? Or Joseph Hurry?
1883 Joseph returns to Chichester to marry Emma in St Peter the GT church which Emma was also christened in.
Regards Eddie