I left my band at the end of last year. No issues with them at all, but I just felt the time had come (as the OP said, it was weighing me down). Since then I have enrolled on SBL, and I must say that it's a long time since I have enjoyed playing the bass as much as I do now.
As far as joining another band in the future goes - if it happens, it happens.