I was up to 5 bands earlier this year and it wasn't actually the conflict that people might think. Upon reflection, it had potential to get difficult but I think with a bit of juggling three is perfectly manageable, depending upon home life, work etc.
If you are straight with people, I don't see a problem. Plus it's easier to forget that playing with other people actually makes you a better player.