When raiders arrive though, they have stopped attacking my gate and just stand in a group outside the walls while I harpoon them to death. If I open both gates they will try to run in.
Now I'm kinda not complaining as it's a fairly regular source of free loot for me, but I don't think it is working as intended