Green’s Dictionary of Slang

bay horse n.

(US tramp) bay rum, a hair tonic; thus bay horse jockey, a drinker of bay rum.

Social Problems V 314: Dehorns [...] are habitual drinkers of [...] bay rum (‘bay horse’) and canned heat. A man on bay rum is referred to as a ‘bay horse jockey’ [HDAS].
[US]S.E. Wallace Skid Row 203: Bay horse—bay rum. Bay horse jockey— one who drinks bay rum.