The bug

A banner within the area represented on the outermost pixel of a map can not be marked. With a freshly crafted map, this is only one block on each side, but as you zoom out it becomes as much as sixteen (thirty-two, when you consider that the next map over has the same problem!)

Code analysis and fix

Decompiled code analysis on 1.19.4:

net.minecraft.item.map.MapState

The logic and range used to determine if a banner falls within the current map bounds is incorrect.

line 294 in private void addIcon and
line 386 in public boolean addBanner

if (f >= -63.0F && g >= -63.0F && f <= 63.0F && g <= 63.0F)

Range >=-63 and <=63 is too narrow and will miss a row of 1 block on each side of the map. This is compounded once the scale is calculated as up to 16 blocks on each side will be missed once the banner coordinate is converted to a float on the 128 block scale of the map. The logic should be >=-64 and <64, this will ensure all positions in all scales are included on the map. The range of blocks on the map if the center of the map is 0,0 is -64 to 63 in both axes.

Solution:

if (f >= -64.0F && g >= -64.0F && f < 64.0F && g < 64.0F)

I've made a fabric mod using mixins that fixes this server side if devs are interested.