Well they weren't married, for one thing and in 1879 Agnes might still have been with him, so he could be trying to hide an "indiscretion." His partner Annie Elias is in residence in 1881 and 1891, and has her first child with him in 1880. No idea if Annie and Martha are the same person. Joseph Smith could have given any sort of incorrect information
