Hi Tazzie
I couldn't see James in Woburn in 1841. However found the following:
HO107/005-39-2 Folio 14A
Bedford St, Woburn
William Coleman 35 ag lab
Mary Coleman 35
Jane 15; Elizabeth 10; Eliza 5; John 4; George 1
Folio 16b
Bedford St, Woburn
Fanny Coleman 75
All born in county
HO107/005-39-3 folio 11B
Thomas Favell 15 born in county
one of a number of males aged 15-9 living in the schoolmasters house. He may be a complete red herring, but was the only Favell in town.
In 1861 James gave his birthplace as Biggleswade Beds. Don't go away, I'll have a look there in 1841, but it's a bit bigger so may take a while.
Regards
David