It's taken me 30 years to find the right band, and in doing so I've realised how much I need a band, and how much shite was going on in my bands previously. I've joined around 30 bands, left 28 of them for the same reasons as you, and the other because had I stayed I'd have ended up a junkie. My current thing started as a way to catch up with mates, have a beer or two, and play some tunes, but it's working beautifully.
Bands are like relationships, you just never know which one's going to work 👍