Green’s Dictionary of Slang

duck n.5

[? its spout resembles a duck’s neck]

(US) a container used to bring back beer from the saloon.

[US]Monteleone Criminal Sl. (rev. edn).

In phrases

rush the duck (v.) (also chase the duck)

to bring home beer in a bucket or pail.

[US]World (N.Y.) 21 July 31/1: Mr. Roosevelt having declared that the ‘growler’ shall not be ‘rushed’ or the ‘duck chased’ on the first day of the week commonly called Sunday.
[US]A.H. Lewis ‘Red Mike’ in Sandburrs 60: Mike gets d’ tip that Emmer’s got two bits [...] Mike wants her to spring her plant an’ chase d’ duck.
[US]Pensacola Jrnl (FL) 6 Oct. 6/3: He’s been hittin’ the can — chasin’ the duck.
[US]H. Green Actors’ Boarding House (1906) 2: I told yuh boys onct yuh couldn’t rush no duck in this house!