Green’s Dictionary of Slang

tally n.1

In phrases

live tally (v.) [SE tally, one of two corresponding parts; compare earlier tally-husband n.]

(UK, mainly northern) to cohabit, to live as man and wife without an actual marriage; thus tally-ho, living in this manner.

[UK]Hotten Sl. Dict. 253: tally ‘to live tally,’ to live in a state of unmarried impropriety.
[UK]Bradford Obs. 8 Dec. 4/3: He ‘used to live “tally” with his daughter,’ and that she (the daughter) had borne a child to him.
[UK]Dly Gaz. for Middlesborough 22 June 2/5: The defendant’s housekeeper struck her, and said rather than she would return she would live tally with him.
[UK]Five Years’ Penal Servitude 376: She found her with an infant in her arms, the result of a connection with a man she was then living ‘tally’ with.
[UK]S.O. Addy Sheffield Gloss. 251: To ’live tally’ with a woman is to live in concubinage with her.
[UK]N&Q Ser. 7 X 297: [...] To live tally is quite a common expression amongst the working classes in all parts of Lancashire, as is also tally-woman.
[UK]Sheffield Eve. Teleg. 12 Mar. 4/2: His objection was that prisoner was 14 or 15 years older than his daughter, and had previously lived tally with another woman.
[UK]Yorks. Eve. Post 7 June 6/6: The two could not get married so they agreed to ‘live tally’.
[UK]Nottingham Eve. Post 1 Apr. 8/6: Scores of couples live together without benefit of clergy or registrar. They call it ‘living tally’.
[UK]P. Barker Union Street 194: Even if she’d lost Ted, she didn’t think she’d ’ve married again. Live tally, her name on the rent book, yes. But marriage ... no.