Matthew COULSON and Jane ARMSTRONG were married at St Mary the Virgin Stamforham, a note on the Bishop's Transcripts says there was no date on the register but that occured between 25 March 1789 and 25 March 1790.
These children were baptised at St Mary the Virgin Stamfordham:
William 21 Nov 1789
Robert (infant, son of Matthew Coulson) buried 5 June 1792 (abode Hawkwell B End)
Anne 3 May 1795 (abode Bridge End)
Robert 19 Nov 1797
Mary 30 Nov 1800
Jane 6 Aug 1818 (born 21 Nov 1804)
Elizabeth 26 March 1825 (born 24 May 1807)
Margaret 26 Mar 1825 (born 30 March 1810)
Why the last 3 were baptised later is hard to say, especially as their father was Parish Clerk. Often children in non-conformist families were baptised later, but this wouldn't seem to apply here.
No John that I can see?

(All these records are available free to search on FreeReg)