Thanks heywood
I know that James and Elizabeth were married at Godalming. Elizabeth had two brothers Edward and Thomas Milton who were also in Brighton in 1841, as was their sister Eliza and I believe James Elizabeth's daughter Harriett. (found all them in the censuses)
I know that James died in 1851, his death certificate states age 45 but I cannot be sure of that as the person reporting the death was not a relative, maybe just a neighbour or friend.
So I have been investigating all James Wallers born around 1800 in Surrey, all to no avail at the moment ! Have managed to rule a few out by later census entries.
Waller/Valler/Voller also adds to the confusion
As James was a carpenter, I wondered if his father was too, but that's not necessarily the case.
Of course, there is the possibiity that James is from Brighton, met Elizabeth there, but why married in Godalming ?