no, a sidechain is used to compress one signal, based on the dynamics of another. For example, put a compressor on a bass guitar, side chain in a kick drum, and every time the kick drum kicks, the bass will be compressed.
I'm not sure what the problem is. Are you saying that when you use it as a vocoder, it's fine, but when in the "gender bender" mode, it's too loud?