I'm on shaky ground here, but despite what it says on that entry, I don't think there was any such parish as Hedley, Northumberland. Hedley refers to the modern Hedley on the Hill. Although it is south of the Tyne, it was part of the historic county of Northumberland and was in the parish of Ovingham (see below). So putting all of that together, yes, I think the two baptisms match.
At that time anyone from Hedley who visited the church in Ovingham (on the north bank of the river) would have travelled 4 miles to Prudhoe and taken the ferry across the river. The bridge there wasn't built until the 1880s. There is also a ford marked on old maps.
History, Topography, and Directory of Northumberland, Whellan, 1855
(from Genuki)
OVINGHAM is a parish comprising the townships of Dukeshagg. Eltringham, Harlow-hill, Hedley, Hedley-Woodside, Horsley, Mickley, Nafferton, Ovingham, Ovington, Prudhoe, Prudhoe Castle, Rouchester, Spittle, Welton, Whittle, and Wylam. It is bounded by the parishes of Stamfordham, Heddon-on-the-Wall and Bywell St. Andrew and St. Peter, except on the south-east, where it is separated from the County of Durham by the Stanley and Milkhouse Burn. It is about seven miles in length by five in breadth, and comprises an area of 15,740 acres. Its population in 1801, was 2,628; in 1811, 2,810; in 1821, 2,742; in 1831, 3,019; in 1841, 3,418; and in 1851, 3,962 souls. The parish is interesected by the river Tyne, and is beautifully diversified by gentle elevations.