Hi! I was browsing family history and came across the Rootschat site and your question. I realize that you asked your question some time ago and have probably gotten all the information you need but .... I was born and raised in Clay End for 20 years and couldn't resist adding my 10 cents
My father worked at Walkern (Clay) Hall for approx 50 years. Clay End would be described as a hamlet and, for a time, the houses were all 'tied' houses. That means that the workers at the farm lived in the houses for as long as they worked on the farm. (These days, that is not necessarily the case.) The farm, which is located right across the road from Walkern Hall, was a full working farm when I was a kid, with a dairy herd and acres and acres of wheat fields which were harvested late every summer. It was a very busy and productive farm. I have fond memories of the countryside indeed.
I never met any of your family members with last name Aylott. If your family member lived in Clay End, there is a strong possibility that he worked either on the farm or in the 'big house' as it was known. If so, your ancestor would've worked on the farm as an agricultural laborer or in the Hall as a groundsman/groom/house staff.
My aunt used to live in what used to be the public house you mention. In the days of coaches and horses, it was a public house and a place to stop for the night. The house is now a listed building with a description of its past as a coach house with hayloft. It was called the Kings Cross public house and my aunt used to answer the door many a time to people with historical maps looking for the place
We used to dig around in the garden and find so many treasures and artifacts .... clay pipes, old coins, pottery.
People made comments about a windmill. I have no idea where that windmill may have been located. There are no ruins or any other suggestion as to where it might have been located and I knew Clay End very well so ..... no idea on that one. Let me know if you'd like any more info on the place!