For older marriages by diocesan or archidiaconal licence, the allegation and/or bond often survive, in the relevant County Record Office (which need not be the county of the place of marriage, since dioceses and archdeaneries were not all neatly aligned with administrative counties).
I do not know when this series of records comes to an end and whether it continued past 1909 ... perhaps somebody else can advise.
My own marriage licence (a Special Licence from the Archbishop of Canterbury) is framed, and hangs on the wall in my hall.