Barker of Swaby or Scawby

[Rod In Sussex]

Help! I have traced a line back to Richard Barker (b c.1829 d 1891) who married Dinah Hackney (b c.1833 d 1888) in Spilsby in 1848. I think his father was Richard Barker of Legbourn, Swaby or Louth (b c.1799 d 1876) who married Mary in 1820. The (1829) Richard may have had a brother William Barker (b c.1824) and a sister Sarah (b c.1830). My problem is that the 1881 census show his place of birth as Scawby, while the 1871 show Swaby,  both having Barker connections. Can anyone help with a 1861 or earlier census to firm up this possible link?
Rod