Todd Maffin suggests doing your final editing of podcasts with speakers and not head phones. 

I do use headphones to do my final editing but then I listen to my podcast using speakers at home to make sure they sound OK.  I compensate for what Todd says via trying to match levels visually in Audacity.