Green’s Dictionary of Slang

down adv.3

[abbr. go down the river under river n. or down the river under river n.]

[mid-19C; 1930s+] (US Und.) serving time in prison.