Henryetta

appears once in current research (Nov. 2022, MMvB) as "wife" of Joseph Elliott in 1850. Harriet "becomes" his wife in 1860. East Coventry had a known polyamorous community in the 1830s - 1850s (see project)

In my appraisal, Joseph married Harriet, took up with Henryetta and then returned to live out his life with Harriet once he may well have 'come to his senses'.
Joseph's will left his estate to Harriet and, using his son Jesse as trustee, to his grandchildren. (MMvB Nov 26,2022)
Note that Joseph left nothing to his children but remembered Henrietta and all his grandchildren in his will which was administered by one son, Jesse.