Going back to the beginning.
Have you found Luke Broadie and Mary on the Census?
What place of birth do they give? (they may have died before 1841/1851 of course).
Do you KNOW Mary came from Almondsbury? or have you just assumed this because they got married there?
Ashton in Makerfield is some 45 miles to Almonsbury. I assume you mean Almonsbury in Yorkshire as you've posted this on the Yorshire Board - there are other places called Almonsbury in the uk, most notably the one in Bristol.
Ashton in Makerfield came under the historic county of Lancashire, now part of Greater Manchester.
Some ideas to help with verification of Mary Booth.
Have you looked at all the names of the children of Luke Broadie and Mary Booth?
You're lucky in that 'Lydia' is a relatively uncommon name.
I'd say if there was a Lydia amongst them, there's a very good possibility you have the correct parents.
If no Lydia it doesn't necessarily mean the wrong family though.
Look at all the other names you have. Do any of them match up? What about grandchildren even. Maybe they called a girl Lydia after her grandmother.
Is there a marriage for another Mary Booth around the same place around the same time? Does SHE have a daughter called Lydia? There may be more than one Mary Booth you'll need to eliminate, possibly tracking them through the censuses.
Have you looked for any wills for the family?
Did Luke leave a will? If so he may mention other members of his wife's family - nephews nieces etc, who may be called Booth. Or his executor may be a Booth; or one of the witnesses.
What about Luke's father? Have you found him and checked if he left a will? Same looking for clues apply.
Same thing for Mary's father John Booth. Did he leave a will? Also look for a will for the father of the other Mary Booth. You may be lucky and find one of them mentions his daughter 'Mary Broadie'