Following up trish's reference to Robert and Caroline Bailey they are often living next door to Frederick Hutton and his wife Ann, and Frederick is a master bricklayer. And Arthur Hutton, a lodger with Robert and Caroline on the 1851 census, was a bricklayer. Are Caroline, Arthur and Frederick siblings? Frederick's age fluctuates a bit but seems to be about 1820 (give or take a few years).
So looking at the various couples, and Caroline's niece and nephew, we get some possible GRO references. Obviously you'd need to look into it the further to double check the marriages are as they seem. Marriage certificates would determine whether or not these Huttons are the children of John (the miller).
GRO BMDs references:
1846 Q3 Marriage - Robert Bailey & Caroline Hutton; Newport Pagnell 5 585
1848 Q2 Birth - John Bailey (mmn: Hutton); Woburn 06 118
1851 Q1 Birth - Frederick Robert Bailey (mmn: Hutton); Woburn 06 151
1854 Q2 Birth - Betsy Sarah Bailey (mmn: Hutton); Woburn 03b 369
1856 Q1 Birth - Caroline Bailey (mmn: Hutton); Woburn 03b 386
1859 Q4 Birth - Walter Bailey (mmn: Hutton); Woburn 03b 367
1849 Q2 Marriage - Frederick Hutton & Ann Samwell; Woburn 6 177
1851 Q1 Birth - Caroline Hutton (mmn: Samwell); Woburn 06 145
1853 Q1 Birth - Frederick Hutton (mmn: Samwell); Woburn 03b 373
1855 Q3 Birth - John Hutton (mmn: Samwel); Woburn 03b 355
1857 Q3 Birth - Fanny Edith Hutton (mmn: Samuel); Woburn 03b 349
1861 Q2 Birth - Laura Annie Hutton (mmn: Samwell); Woburn 03b 391
1864 Q2 Birth - Henry Arthur Hutton (mmn: Samwell); Woburn 03b 382
1849 Q4 Marriage - Henry Hutton & Ruth Pettitt; Wellingborough 15 872
1850 Q2 Birth - Elizabeth Hutton (mmn: Pettit); Newport Pagnell 06 410
1852 Q3 Birth - William Henry Hutton (mmn: Pettit); Newport Pagnell 03a 403
1854 Q1 Birth - John Hutton (mmn: Pettitt); Wellingborough 03b 132
1856 Q2 Birth - Emma Jane Hutton (mmn: Pettitt); Wellingborough 03b 144
1851 Census - Wavendon
Henery Hutton; Head 30 (est b1821); Aspley; Farmer
Ruth Hutton; Wife 21 (est b1830); Wellingborough
Elizh Hutton; Daughter ?m (est b1851); Wavendon
James Hutton; Visitor 55 (est b1796); Aspley
John Pain; Servant 14 (est b1837); Wavendon; Labourer
Emily Garner; Servant 16 (est b1835); Wavendon; Servant
Ref HO107; Piece 1723; Folio 211; Page 19;
Also, on the 1861 census Robert Bailey is listed as a publican of Weathercock Inn, which seems to have a long connection to Huttons...
The Weathercock Inn
http://www.mkheritage.co.uk/wsc/docs/Weathercock.htmlThe Weathercock Public House Aspley Guise
http://bedsarchives.bedford.gov.uk/CommunityArchives/AspleyGuise/TheWeathercockAspleyGuise.aspx