I don't see anyone on the 1850 U.S. census with a surname similar to Asher, with the following information: George, male, white, born in England within 5 years of 1816.
I don't see him in 1860, but my search wasn't as thorough, due to the amount of results (I didn't use a surname when I ran the search...I did check all surnames starting with "A").