There is also an 1841 census in Mansfield for a James Hurst, age 60 (rounded down from nearest 5)
He is a frame work knitter.
Possibly a widower, as a big jump down in ages to:
Mary Hurst 30
Thomas Hurst 20
Sarah Hurst 15
George Hurst 13
Selina Hurst 10
Henry Hurst 3 (GRO show illegitimate)
Census details:
Where born: Nottinghamshire, England
Civil parish: Mansfield Hundred: Broxtow (North Division)
County/Island: Nottinghamshire
Registration district: Mansfield
Sub-registration district: Mansfield
Piece: 859 Book: 6 Folio: 25 Page 10
What are the names of the children for your Mr. James?
We need an accurate starting point.