Not sure of you got any further with this - it's a while since you posted?
I follow Ayletts in general (not just my own branch), so I'd noted this marriage and subsequent children, but intrigued that you say there is an Albury connection. I have sons John, Richard, Matthew, James, and wondered which was your ancestor?
For the marriage in 1669 I have checked out Essex Richard Ayletts of a 1640 vintage - there aren't so many in my database. There is one bap to a Richard Aylett in Takeley in 1664, but also a burial there for a Richard in 1687, so it probably isn't the same guy.
There is a baptism in White Notley in March 1640 to an Arthur and Margaret; this one is a little bit old for the marriage, but a possible. The third Richard reference is one born at some point after 1640, probably in Braintree, to Robert Aylett and Mary Wall. This is a well-to-do family, and may be plausible given a) the second of the Little Canfield Richard's sons is called Robert; b) elsewhere at least the Bretts were also well-to-do and there is at least one earlier Aylett-Brett marriage.
The Herts Ayletts are a bit of a nightmare because of the Aylott thing - not at all sure they are the same family in spite of the closeness of the names, but of course who knows? And Aylett is misspelled so much, even in Essex where the name was better known, that morphing to/from Aylott may well take place. The habit in 16th/17th writing of writing an 'e' as an'o' with a bar across it has led to some mistranscription too, but in general Aylott isn't found in Essex.
Anyway, if you are still tracking this stuff, it would be good to talk over your Albury trail, and of course if I have any other useful data, happy to help.