Lewes was married to Agnes Jervis, but they had agreed to have an open marriage, and in addition to the three children they had together, Agnes had also had two children by Thornton Leigh Hunt. Since Lewes was named on the birth certificates as the father of these children despite knowing this to be false, and was therefore considered complicit in adultery, he was not able to divorce Agnes.