Softlocked black legion/geode side quest in gate of swords

[elmer-plox]

First time in this area there was a RTS section. So of course I wanted to raise my pop cap by building farms. But I managed to build one farm above one of the armor pieces or geode and dont know how to remove the farm because it is in neutral mode. Any help?
https://steamcommunity.com/sharedfiles/filedetails/?id=3077992872