Green’s Dictionary of Slang

stupid, dull-witted.

1877		J. Greenwood Dick Temple I 91: A duffle-headed beadle like they all are.
1893		Reynolds Newspaper 18 June 1/1: They tickle their trout under the gills and the duffle-headed fish swim calmly into the net.