Welcome to the wonderful world of audio engineering... setting levels is a huuge part of it :-)
A decent compressor can make your life a lot easier. (It can also suck badly, but speech is fairly
tolerant of gobs of compression.)

Finished listening... great show, more please!