Hi there Tom
Went over Winchelsea Church this afternoon (I married my second wife there some 20 years) and had a look around for your Edward Whitehead.
On a board to the left of the Alter was the list of Winchelsea Vicars and yes he was there
Edward Whitehead MA 1872 - 1883
To the right of the main altar and within a small chapel was a White Marble Tablet attached to the Wall with the following Inscription in Black:
To the Dear Memory of
Charlotte
Gentle & Loving Wife of
The Revd Edward Whitehead MA
Rector of this Parish
She died November 6th 1878
Aged 61 Years
Also in Loving Memory of
Rev Edward Whitehead MA
Eleven Years Rector of this Parish
Died August 19th 1883
Aged 70 Years
So from the above I would suggest that they are both buried there
Hope that helps
Chris in 1066