
I don't know a lot about it, and can certainly understand the confusion. But I think Boulogne was indeed a hotly contested territory and source of contention within the "Pale" of Calais. Pale meaning the area of France under English governance at the time. The first siege of Boulogne was in 1492, with later sieges occuring in 1544-46. Assuming that there probably was a lot of almost constant fighting in that place (between the two major historic sieges, his death in battle in 1527 makes sense to me).
https://en.wikipedia.org/wiki/Pale_of_Calais