Anita - Welcome to Rootschat from me also.
You mention his age in 1841 and then it changing on subsequent census records. Just in case you don't know (and please forgive me if you do) -- in 1841 the ages of people over 15 were rounded DOWN to the nearest 5 years. The ages of children 15 and under - should be correct, at age last birthday.
This is the ONLY census were the rounding down occurred. On all others the ages should be 'age last birthday'.