Raven Raid Colonization bar doesn't fill back up if raven is defeated

Was playing a 3v3 multiplayer game as goat. Raven raided my main tile, and it was 95% to being taken over when we killed the raven and the mercenaries on my main tile disappeared. Later on, there was the event with ghosts that came to my main tile. As soon as I pulled everyone off my main tile, it was instantly taken over and I lost. It appears that if you kill raven when mercenaries are on your tile, it despawns them but your colonization bar won't refill.