Published is better than perfect. Listen to great podcasts and analyze what makes them so.  Worry about serving your audience more than growing your audience. Make your goal to make each episode better than the last.  Edit and mix for ear buds and check final mix in a car.  If you are not having a BLAST producing your podcast, then you are not doing it right!  Make sure the topic fires up your passions personally.  Go back a month or more later and listen to your podcast episode and note what you could have done better.  Interact and learn with other podcasters from the Podcast Collective.