1841 English Census in Leeds says he was born Ireland (aged 40) with three children living with him -- John, aged 15, born Yorkshire; Jane, aged 13, born Yorkshire, and Mary, aged 9, born Yorkshire. All of the kids work in a flax mill.
By the time of the 1851 census, he is alone in Nottinghamshire, aged 54. And by 1861, he is married to Catherine Kelly, living in Nottinghamshire, with daughters, Catherine and Ann, aged 16 and 15.
You should be able to find his marriage record in about 1841-45 in England which should at least give you his father's name.