if you give me a little more info on your james, i will find him on the census for you? what was his employment? did he marry in scotland?
in the meantime
1841 census; mid street, keith, bannfshire
peter...age 55...army H.P
helen...age 50
eliza...age 20
peter...age 20...watch maker
hugh...age 15 clerk
margaret...age 15
all born bannf
1851 census; mid street, keith
peter...age 71...lieut H P...born keith
helen...age 70...born london
1851 census; bridge street, keith
peter...age 34...watch/clock maker
helen...age 36
elizabeth...age 9
peter...age 17
magdalene...age 6
alexander...age 4
charles...age 1
all born keith
1861 census; kirkton street, mortlach bannfshire
peter...age 44...clock/watch maker
helen...age 48
magdalene...16
alexander...age 14...app watch maker
helen...age 9
margaret...age 3
all born keith
1851 census; lintmill, rathven, bannfshire
hugh...age 26... writer factory clerk insursance agent
eliza...age 26
helen...age 6
john...age 5
eliza...age 3
susan...age 1
all born keith
1861 census; wester windy hills, grange, banffshire
hugh m...age 35...former farmer/writer...born keith
eliza...age 35...born keith
john m...age 15...born keith
eliza...age 13...born keith
susan...age 11...born keith
margaret...age 9...born cullen
ann...age 7...born cullen
jessie...age 5...born cullen
isabella m...age 3...born cullen
james...age 7 months...born grange
1861 census; 5 craigellachie, aberlour, bannfshire
francis w g...age 43...bank civil servant (retired)...born keith
mary ann...age 31...born england
isabella s...age 5...born keith
Joe