Green’s Dictionary of Slang

tally n.1

In phrases

live tally (v.) [SE tally, one of two corresponding parts; compare earlier tally-husband n.]

[mid-19C+] (UK, mainly northern) to cohabit, to live as man and wife without an actual marriage; thus tally-ho, living in this manner.