Green’s Dictionary of Slang

vanilla fudge n.

[rhy. sl.]

(Aus.) a judge.

[Aus]R. Aven-Bray Ridgey-Didge Oz Jack Lang 10: The vanilla fudge had hit him up for fifty Oxford scholars. It was a hefty blow on his whippy at that time.