It had to go through female lines too, as some of the male desendents never had any heirs, e.g Harold's sons never produced any offspring still around today, so the line wouldve gone back up through a female branch, I'll make a chart about it if it helps illustrate