Green’s Dictionary of Slang

abbey-croaker n.

[SE abbey, as generic for prison + croaker n.1 (2)]

[mid-19C] (UK Und.) the ‘ordinary’ or chaplain of Newgate.