I like quite differing tones for different styles of music, and no one bass can do that for me. If you think one is limiting then of course, indulge yourself. But if they're all fairly similar in feel or sound I don't see the point.
As for improving your playing - sticking with one will stop you focusing on the tone you're hearing and looking to improve that, rather than your musical ability or technique.