I went through the same thing.
The roundwounds mark the fingerboard a bit but nothing else. I like the sound of round wounds so i tried to comprimise with ground wounds and i was never happy. I now use roundwound on both my fretless basses both ahave rosewood boards and i dont think it has done anything but mark the board no damage as such if you get what i mean.