Welcome to Rootschat!
I haven't spotted a baptism for James as yet, but there is a family of Richard & Elizabeth Gibby baptising children in Wiston around that time.
Elizabeth bp 4 Dec 1771 dau of Richard & Elizabeth Gibby Elizabeth buried 4 Dec 1771
John bp 19 Dec 1773 son of Richard & Elizabeth Gibby
The NLW has the will of Richard Gibby of West Diary,Wiston written 9 Nov 1802 proved 1804
http://cat.llgc.org.uk/cgi-bin/gw/chameleon?skin=profeb&lng=enHe made bequests to his wife Elizabeth, daughter Mary, daughter Frances wife of John James, daughter Hannah wife of William Walters, son James and his sons William & John, the executors, received the bulk of the estate including the farm, West Dairy, rented from Lord Cawdor.
Richard Gibby buried 22 Nov 1804 in Wiston
John Gibby married Elizabeth Lloyd 20 Jan 1805 in Wiston
Hannah Gibby married William Walters 26 May 1796 in Wiston
Is your James the farmer of Windmill Park with children Sarah, George, Elizabeth, Wiliam, Catherine & Edward? if so, his will is also on the NLW site.
There's also a will from 1777 for a Morris Gibby of Wiston who made bequests to his 5 children including a son Richard so he could be your next generation but I think I need to search further to be sure.