Ancestor: Charles Carroll of Carrollton?

Family lore states that Alyce O'Toole's ancestor was one of the US signors of the Declaration of Independence by way of:

Mother: Jane Mulreed O'Toole,
Jane's mother: Alice Hartford Mulreed,
Alice's mother: Eleanor (Ellen) Morresey Hartford,
Eleanor's mother: Alice Dunn Morresey,
Alice's mother: Eleanor Farrell Dunn,
Eleanor's mother: Jane Carroll Farrell,
Jane's father: Charles Carroll of Carrollton.

This does not seem possible, since:

1) Charles Carroll of Carrollton only had three children who survived to adulthood, none of whom were named Jane or whose spouse's surname was Farrell.

2)Alyce's grandmother, Eleanor (Ellen) Morresey Hartford's birthplace in multiple US Census records is shown as Ireland, not in the USA, as one might expect of the great, great granddaughter of Charles Carroll of Carrollton.

Is there any documented connection? Did one of CC of C's daughters, granddaughters or great granddaughter return to Ireland to start a family who would one day return to the USA?

So far, I cannot find any link.