tally-wife

noun
An unmarried woman living with a man. A man and a woman who live together without being married are living tally.