There's no supporting record that James ever used the middle name "Allison." The middle name likely comes from a marriage record of a James Allison Love born 1749 and Mary Ingram born 1755. The couple was married in North Carolina. Though not an impossible marriage location, it's curious that preceding and following life records are in Virginia.
https://www.ancestry.com/discoveryui-content/view/757540:7836?ssrc=...
This couple can't work and also be parents of at least sons John born 1762 or James born 1764 as Mary Ingram would only be 7 and 9 respectively.
See also https://rockyrivernc.com/2014/03/08/james-allison-love-and-grandsir...