If you can see a way forward and it will settle down, keep buggering on. (this is what I used to do and it was eventually ok)
If you don't think it will settle, personally, I would have to leave. Life is just too short to have to deal with sh!t from bands. I folded my last band due to the idiot guitarist bullying the new drummer. Band mates wouldn't listen to my solution (which was to get my wife on the bass and me switch to guitar and everything would have improved, she does BVs and plays like me) So I folded it