Green’s Dictionary of Slang

ruffer n.1

a rough person, a thug.

[UK]J. Shirley Triumph of Wit (5th edn) 186: Not suffering them to be abused by any strange Pallards, Ruffres, Hookers, Swadlers, Irish Toyls, Dummerers, Jarkmen, Whipjacks, Glimmerers, Maunders, or the like, or any other Out-lyers.
[UK]Scoundrel’s Dict. 15: A stout Rogue – Ruffer.
[UK]J. Ware Passing Eng. of the Victorian Era.