Green’s Dictionary of Slang

belly up adj.2

[resembling a dead fish]

1. [late 19C+] failed, finished, esp. bankrupt; usu. prefaced by go.

2. [20C+] (also belly upwards) dead; often as float belly-up(wards) v.; thus knock belly-up v., to kill.