Keep practicing, and perhaps work on your fretting hand fingerings. Apply enough pressure until you produce a clear tone, then you don't need to press any harder, the lighter your touch the faster you can change position, plus it will help with your intonation.
Don't be too hard on yourself, listening to yourself play is always tough at first, but it shows you where you need to focus.