Green’s Dictionary of Slang

charlie n.9

also charley
[abbr. Mr Charlie n. (1)]

(US black) a derog. term for a white man, also attrib.

W.G. Smith Stone Face 87: [of a Parisian policeman] ‘Jus’ playin it cool, jus’ playin it cool, man, man, tryin to keep ole Charlie off my back.’ Ole Charlie paced the street, waving his submachine gun.
[US]L. Hairston ‘The Winds of Change’ in Clarke Harlem, USA (1971) 323: They all was beaming like they had Charley’s number.
[US]C. Brown Manchild in the Promised Land (1969) 327: I never knew they had all those bad niggers in the South, I thought the baddest cat down there was Charlie.
[US]R. Conot Rivers of Blood 36: ‘Them Charley bastards won't even give you no water’.
[US]B. Malamud Tenants (1972) 95: He was a tall stringy Charlie with long legs and a big prick.
[US]J.L. Gwaltney Drylongso 21: Chahlie don’t know that.