William Huddleston, 12th Lord of Millom - Elizabethan polygamist?

From his History of Parliament biography:

Family and Education 1st s. of Anthony Huddleston of Millom by Marie, da. of Sir William Barentyne† of Little Haseley, Oxon. m. Mary Bridges of Glos., 7s. 8da. suc. fa. 1598.

Huddleston died in 1628, and was buried on 25 Mar. in the chancel of Millom church. He hoped his family would live together in Christian harmony.3

Apparently there was a good reason for him to say this. He had two wives with children by both: the one mentioned, Mary Huddleston and after her death in 1601, Lady Elizabeth Knipe

Elizabeth Hartrpoole was his mistress before Mary’s death, and had several children with him before marriage, and more after.

OK, not so unusual, perhaps. But: they all lived together.

From “Marie Barentyne & Anthony Huddleston marriage 1541.” By Roy Huddleston July 22, 2004. < genealogy.com >

William, his wife Mary, and mistress Elizabeth had a "menage a trois" at Haseley, until his father Anthony died , when they moved to Millom.

Was this common-enough in Elizabethan England, Anne Brannen