Green’s Dictionary of Slang

temple n.

1. a brothel.

1775

‘Miss Adams’ in Ranger’s Impartial List of the Ladies of Pleasure in Edinburgh n.p.: This Lady keeps also a genteel Temple, and is extremely well calculated for her business.

2. the lavatory.

1856		B.H. Hall College Words (rev. edn) 455: temple. At Bowdoin College, a privy is thus designated.
1900		E.H. Babbitt ‘College Words and Phrases’ in DN II:i 66: temple, n. Water-closet.
1949		Monteleone Criminal Sl. (rev. edn).

In phrases

temple of Venus (n.)

(Aus.) an assignation house.

1907

C.W. Chandler Darkest Adelaide 41/1: [A] big policeman was stationed outside the Temple of Venus [i.e. the ‘Dovecot’, Pirie-street, Adelaide] to keep the crowd a-moving.