I know you've got this but for the sake of clarity:
1819, 14 March: Thomas Hunt married Ann Gilbert at Leicester St Margaret, by banns. Witnesses Richard Stringer (who witnessed a lot of marriages so was probably the church warden or similar), and William Worth (made his mark).
You say that Esther was born in Loughborough but I can't see a Loughborough baptism. There is a poss St Margaret baptism:
26 April 1919; Esther Hunt; parents Thomas and Anne, of York St; Thomas a woolsorter.
However, Esther Hunt of York St was buried age 1 at St Nicholas on 8 Oct 1820.
There were also baptisms at St Margaret for Sarah Hunt, same parents and details, Sept 1 1823 (buried 6 days later)
and John Hunt, same parents and details, bapt 7 Nov 1820 (buried 10 june 1821)
Esther was a less common name and the fact that the first child was given this name makes me wonder about this for Thomas's baptism:
14 Dec 1786, Leic St Nicholas, Thomas Hunt son of Thomas and Easter Hunt (they had several other children b between 1781 - 1797).