Hi Youngtug and Elise,
I also had a ggrandfather who was a serial bigamist, married under at least three different names (that I can find thus far) and was not consistent with details of father or age either, his age could vary as much as 15 years (younger!!). I always thought he must have been an incredibly charming and youthful character to get away with what he did.
The reason I say this is because after having a look at your post, I would be more inclined to believe that the Alfred Brier Goudy who married Lucy Georgina Bayliss is the same as the Frederick Bryer Goudy who then married Bathsheba in 1882.
Frederick 1848 is easily traced throughout every census, always with his family 1851 - 1861, then with Laurina in 1871 (next door to parents) then with with wife Anna Maria through 1881-1911. This then fits perfectly with the death in 1920. There is nothing in those records to indicate he is anything other than he seems.
Alfred on the other hand.....
1851 living with George and Charlotte May as a visitor
1861 boarding at an Inn at Willisham
1871 living with Uncle Robert Barker in Ipswich. He is single at this time.
1881 with brother Frederick and wife Anna Maria.....if not for this census they would probably never be connected. He is married at this time but wife Lucy is in Gloucestershire with their two sons.
Not to be found again in England after this Time.
Lucy still lists herself as married/widowed in censuses up to 1911.
A Frederick Bryer Goudy arrived in America in 1889. Source bibliography: "Naturalization Applications for Montgomery County Indiana 1850-1930" Notes - Gives full details on the persons acquiring citizenship including date of immigration.
It would definitely be worthwhile trying to access this record.
Given that the Frederick Bryer Goudy in Indiana was a tailor, was born in England and his age varies from 1848 (from death certificate) to 1860 on census records, I would seriously consider him as the best candidate for your Alfred.
Jo