Green’s Dictionary of Slang

(US) a telling advantage, e.g. a hidden weapon.

1903		T.W. Jackson Slow Train 70: ‘Yo’ is twice as big as him.’ ‘Yes, but Charlie carries de diffunce ’round in his pocket.’.
1938		W. Pegler in Nevada State Journal (Reno) 21 Dec. 6/2: A gun was also known as the difference [...] denoting the margin of power and courage between the man who had one and the man unarmed.
1947		N. Algren Neon Wilderness (1986) 219: Even if a guy got the difference on him he don’t want to get too close to no man with broken glass in his hand.
1950		Goldin et al. DAUL 58/1: Difference. A pistol, revolver, or any weapon used in crimes of violence. ‘Don’t spring (exhibit) the difference on this score (theft) until everyone’s at his spot (post).’.
1975		E. Torres Carlito’s Way 18: He pulls out the difference, size .38.