Green’s Dictionary of Slang

fiddler n.2

a coachman.

[UK]P. Egan Key to the Picture of the Fancy going to a Fight 9: The drag Fiddler can toss off a quartern of ‘Max’ without making a wry mug.
[UK]Egan Life in London (1869) 74: He was a perfect hero with the whip; a first-rate Fiddler.