Caswell name . Looking for more information

Ephraim H Downs married Mary B Caswell in 1862 The Caswells lived on The Isle of Shoals. My GGG grandparent Gr. Grandparents of John W Downs author of Sprays of Salt.
Came From England. Would like to find location in England or could be Scotland

babyruth281@Geni