Green’s Dictionary of Slang

broom n.3

[broom v. + ? play on dust v.2 (1)/brush v.1 ]

(US black) an act of walking, of movement.

[US]D. Burley Orig. Hbk of Harlem Jive 12: I nixes my pad, drops the twister on the keep, and collars a light broom down the cruncher to the lushpad on the three pointer.
[US]T.M. Kochman ‘The Kinetic Element in Black Idiom’ in Kochman Rappin’ and Stylin’ Out 169: ‘Broom,’ meaning ‘fast getaway’.

In phrases

knock a broom (v.)

(US black) to walk away.

[US]D. Burley Orig. Hbk of Harlem Jive 78: ‘Knock a broom’ is found to mean a quick walk or brisk trot away from something.
[US]D. Burley N.Y. Amsterdam News 22 Mar. 13: ‘I’m in a hurry and must [...] knock a fast broom’.