When the nav lady talks, just press the volume buttons on the steering wheel and it will adjust the nav volume instead of the music volume on the fly.
If it's that bad you may want to consider normalising the volume across your music library using PC software.
Bookmarks