Green’s Dictionary of Slang

plain people n.

[a deliberate play on the SE white term, coloured people]

(US black) white people.

[US]Schele De Vere Americanisms 281: It is said that the freedmen, in the first glow of their rights, proposed to call the Whites Plain People, in return for the term Colored People, by which they were designated themselves .