Just as a little postscript. We can see from Joseph's will that he had children from a previous relationship. His first wife was Elizabeth Skeels, although no trace of a marriage could be found initially for her and Joseph where it might be expected. Joseph married his second wife Emma on the 12th September 1826 in Chatteris. I'm assuming that Joseph's first wife had by that time died; I have still to track down a burial for her. Imagine then, my surprise, when a marriage for Joseph and Elizabeth did get uncovered, on the 27th February 1825, at, of all places, Gretna Green
although, Elizabeth has become Henrietta somewhere along the way. Joseph and Elizabeth's first son was born in 1815, and their youngest in 1818.
The marriage entry can be seen at Ancestry in the Gretna Green, Scotland, Marriage Registers, 1794-1895. There can't be too many Joseph Saberton Sabertons, so I'm sure we have the right groom.
All of which, of course, raises a few questions. Why didn't they marry earlier? Was Elizabeth ill? Why didn't they marry by licence somewhere closer? If she was ill, how did she manage the journey to Gretna? Would the fact that Elizabeth's name was registered as Henrietta affect the validity of the marriage? I need to check the marriage law at the time, but would the marriage legitimise their children?