I don't have a lot of time to read through all the replies properly now but thanks everyone for the information so far. Is there a way to access Drumbo Presbyterian Church and Church of Ireland baptism and marriage records? I think that would help me in finding out more about these Pattersons and other relations from that area if I had access to those records.
Heywood, I read the first post of the Census extract and I hadn't seen that before, but the name Maxwell as Josephs mothers name, looks like there is a connection as checking my DNA results on Ancestry, I got a match to a man with the surname Maxwell and another who has an Elizabeth Maxwell from Drumbo and a John Dorman born 1813 as their direct ancestors.
I was told by my granny that my 2nd great grandmother, Margaret Elizabeth Patterson, wife of Samuel Warnock Patterson, when they lived in Tullyard, Drumbeg, she helped a nearby neighbour who was very ill and had tuberculosis. She then she caught it of him and died from it. Perhaps there is a connection to that Dorman and my Patterson family.
Death record of Margaret Patterson:
https://civilrecords.irishgenealogy.ie/churchrecords/images/deaths_returns/deaths_1909/05464/4529236.pdf I think the person she was helping was that Robert John Dorman mentioned on that record sheet who died with Phthisis as those Dormans lived in Tullyard also. Dormans on a 1901 Irish Census:
http://www.census.nationalarchives.ie/pages/1901/Down/Ballymacbrennan/Tullyard/1239385/aghadowey, thanks for the record of Elizabeth's death after giving birth to William Henry Marshall. I also didn't know about the first Sarah Patterson birth but I looked again at the documents I was given on the Patterson research and it made a mention of James Patterson but no information so the James Patterson you found who went to Scotland, looks like him.
I found this:
https://alison-stewart.blogspot.com/2011/07/reid-wilson-and-agnes-leveletlavalade.html it says
In his brother Reid Wilson's will of 1890, Reid only mentions Joseph's son, John Wilson. John Wilson had been born somewhere in England in about 1868 - this according to the census returns of 1901 and 1911.
On 30th January 1892 in Great Victoria Street Church in Belfast, John Wilson of Moira, Co. Down, son of commercial traveller Joseph Wilson, married Jane Patterson of Belfast, the daughter of publican Samuel W. Patterson. This wedding was witnessed by Thomas Agnew and Elizabeth Bertha Hogg.
Jane Patterson was the daughter of Samuel Warnock Patterson, son of James Patterson, and of Elizabeth Dornan, daughter of William Dornan, who had married in Belfast on 4th October 1861. Samuel Warnock Patterson was a publican at 71 May Street in Belfast, but he died young on 31st May 1874. His wife, Elizabeth , was pregnant when he died, and a son, Samuel Warnock Patterson, was born a few months later on 18th October 1874 at 71 May Street. As well as Samuel Warnock and Jane Lemon, Samuel Warnock Patterson and Elizabeth Dornan also had a daughter, Sarah Patterson, who was living with her sister Jane Lemon Wilson, in 1911 at 40 Beechfield Street.
John Wilson and Jane Lemon Patterson had a daughter, Edith Jane Wilson, at 88 Bryson Street on 24th May 1895.