You should a chat with the guy about this and see if you can resolve it, but if you're not happy with the situation then something obviously has to change.
If you get on with the drummer, trumpet and other keys player personally & creatively, then consider dropping the sax/keys/vocals guy and either find a replacement or just carry on without him.