Green’s Dictionary of Slang

(US) nonsense, rubbish.

1936

‘Virginia Expressions’ AS XI:4 372: ‘Stop that fairydiddle!,’ i.e., stop that flattering complimentary talk. To tell someone he ‘talks fairydiddle’ is to tell him, in a light refined way, that he talks nonsense.