There is an Arthur Smith born Yarmouth in Pentonville prison in 1871, but his age is given as 20 and as there is another Arthur Smith baptised in Yarmouth in 1849, your Arthur is probably not the prisoner.
Interestingly Freereg has a baptism for your Arthur 30th April 1856 and gives his dob as 27 Sept 1847. I can't find a marriage or death record for him in Yarmouth.
An Ancestry tree for him also fizzles out with the 1861 census, so no help there.
I can only think he either called himself Charles or he gave a more general place of birth such as Norfolk. Either way it's hard to be certain what became of him, sorry not to have been more help, Jan