Multiplayer P2P and NA Server game issues

When playing multiplayer specifically with my friend, we're getting constant and progressive stuttering issues as the match goes on. Eventually the game becomes unplayable. If I host the game, and I select P2P (his name) he gets the stuttering issue and I get no problems. If I host the game and select P2P (my name) I get the stuttering issues and he gets no problems. We've tried hosting both ways. We've only tried conquest together so far, I'm playing stoat, he's playing squirrel. The stuttering unfortunately really does become so bad that it's not even playable as the match goes on. I've also tried hosting on NA server and the lag is so bad that the game eventually crashed and couldn't reconnect. The stuttering issue has never been a problem before, and him and I usually come and go from this game every couple months or so, but it's currently unplayable like this which is very sad. We're both running Windows 10. Run the game using OpenGL. (We've also tried multiple conquest games)