What about his brother:
John Garrett V
I know sometimes folks back then did name sons the same name in case one died, but I've found info on John V who married Frances Dudley. And I have a nagging question forming because I saw on Wiki that Frances Scott's mother was a Dudley by birth. I'm wondering if there weren't two brothers name John and one married Frances Dudley and the other Frances Scott but if they're maybe the same John and the fact that Frances' mother was a Dudley got confused as the maiden name for Frances (Dudley) Garrett. But I may just be over-thinking it, because this site lists her father as Robert Dudley, indicating she wasn't born a Scott.
https://www.werelate.org/wiki/GARRETT_FAMILY_OF_ISLE_OF_WIGHT,_VA
GENERATION FIVE
JOHN GARRETT V (c1698 VA-Will 23 Oct 1784) m. FRANCES DUDLEY d/o ROBERT DUDLEY
Otheriwse, it 'seems' John Garrett and Frances Buckner had two sons named John IV and John V. ?