Green’s Dictionary of Slang

(US) a band or member of a band that makes discordant so-called ‘music’ by playing a number of instruments, either in an unlikely combination or conjured up from unlikely objects, such as washboards, tin kettles etc.

c.1830		G. Furman Customs 17–18: The streets of the City that night were absolutely thronged with watchmen, so that it was impossible for the Callithumpians to effect any meeting [DA].
1842		Whip & Satirist of NY & Brooklyn (NY) 17 Dec. n.p.: Calathumpian (or in other words, making the damnedest racket ever heard out of the infernal regions).
1848		Bartlett Dict. Americanisms 61: callithumpians. It is a common practice in New York, as well as other parts of the country, on New-Year’s eve, for persons to assemble with tin horns, bells, rattles, and similar euphonious instruments, and parade the streets making all the noise and discord possible. This party is called the Callithumpians, or the Callithumpian Band.
[1872		Schele De Vere Americanisms 589: Callithump, seems [...] to be of American origin. It represents the French charivari, the German Katzenmusik].
1881		Reinbeck Times 30 June 3/1: All who wish to join the calithumpians are requested to meet at Cremer’s blacksmith shop Friday night [DA].
1902		Bulletin (Sydney) 5 Jul. 13/4: The ordinary fool [...] would not expect that the figures for the sect of the Calithumpians would differ much from those of the United Mumbo-Jumbos: but they do.
1913		G.D. Chase ‘Lists From Maine’ in DN IV i 4: callithumpian band, n. A noisy crowd playing on tin horns and pans which serenaded a newly married couple, thus callithumpian serenade, n. A serenade by a callithumpian band. It was often a token of disapproval.