Hello
Hopefully, I can give you some ideas to help you on your way.
The parish of St Bees covered a very large area which includes the town of Whitehaven.
Gins is an area of Whitehaven and was the site of the Whitehaven pottery.
The Gins pottery was established in 1819 by Sir William Lowther who leased it to Woodnorth, Harrison, and Hall. There may have been an earlier pottery on the same site.
It is possible that your ancestors may have manufactured pottery, but I would suggest this is not so.
Someone described as a "Potter" at that time, was usually a Traveller or Gypsy, and this is more likely.
Try joining the Facebook group "Cumberland Travelling Families" I'm sure someone there may be able to help