bother, hadn't spotted the other marriage. Birth certs for the children should show which family is which. Births would show mother as formerly Williams for one, and formerly Williams late Wilson for the other. Rachael's birth is a less common first name.
Although I think the one with the John as father looks more likely.
1841 census Notage Lane HO107/1424/23 folio 20 pg 4
John Edwards 50 ag lab
Mary 49
Mary junr. 19
William 15
Ann 13
Sarah 11
Margaret 7
/
Ann 79
all born in county
1861 Nottage RG9/4108 folio 34 pg 9
John Edwards head mar 70 farmer of 20 acres
Mary wife 67
Mary dau 38
William son 35
Margaret dau 27
all born Oystermouth
next house
John Edwards head mar 44 fisherman
Mary wife 46
Ellen dau 17
Mary A dau 14
all born Oystermouth
baptisms to John & Mary Edward in Oystermouth, John either labourer or farmer, address Newton
John 19 June 1816, born 8 June - no occupation or address listed
Elizabeth 3 April 1819, born 22 March
Mary 13 Dec 1821
William 20 Nov 1825
Ann 20 Oct 1827
Sarah 11 Aug 1830
Margaret 2 Feb 1834
Ellen 29 May 1836 - possible burial as Eleanor age 2, 5 May 1838
Marriage of John Edward & Mary Morgan 26 Nov 1815, witnesses William Jenkins & John Tovey, the latter witnessed more than one marriage on the page and may be the parish clerk.
Possible burial in Oystermouth 15 April 1790 for John senior aged 79 of Newton
Possible baptism in Oystermouth 24 Oct 1790, born 17 Oct son of George
Possible marriage in Oystermouth George Edward, mariner, and Ann Thomas 14 Sep 1789, witnesses David Lloyd & Christopher Lewis.