Green’s Dictionary of Slang

(orig. US tramp) a male homosexual; available cits. suggest both active (1975) and (unwillingly) passive (1950, 1972).

1950		Goldin et al. DAUL 161/1: Poger. (Among hobos and traveling thieves) A passive pederast. [...] Pogey. [...] 3. A poger.
1972		B. Rodgers Queens’ Vernacular 161: sexually oppressed, constantly raped victim; usually straight [...] pog [poger, pogie, pogue].
1975		E. Torres Carlito’s Way 43: Pretty soon you don’t know who’s the poger and who’s the pogee.