Green’s Dictionary of Slang

(orig. US) sensitive to, usu. with hostile overtones, e.g. Sorry, but I’m absolutely allergic to religion.

1937		New Yorker 23 Jan. 20: [caption] He’s allergic to Philadelphia scrapple [OED].
1942		Punch 26 Aug. 169/3: Colonels have a curious effect on me. Quite frankly, I am allergic to them [OED].
1958		Observer 5 Oct. 19/4: Allergic as I am to opera on television [...] I cannot be relied on for an objective opinion of the B.B.C.’s two-hour presentation [OED].