James Brown

James Brown (1806 - 23 November 1889): Husband of Mary Lovecraft, whom he married on 2 March 1854. While in Ireland, James had two sons, Isaac and Adam, by Margaret Rountree, who died in 1836. James then moved to the United States, settling in Rochester by 1839, and finding work with the railroads. In 1846 he married Sarah Hurlburt, with whom he had four more children, Mary Jane, James, Saragh Anne (1851), and Saragh Anne (1853). When he finally met Mary Lovecraft, who was twenty-two years his junior, he was raising at least four children on his own.

source: http://www.hplovecraft.com/life/family.aspx