Green’s Dictionary of Slang

café au lait n.

[the beverage; orig. coined to describe the women chosen for the chorus line of Harlem’s Cotton Club; thus ? pun on café]

(US black) a light-skinned woman.

1980

(con. 1920s–30s) cited in C. Major Juba to Jive (1994).