He's got a good point; several of them!
I'm not a believer and one of the reasons why I came to that view is that I knew I didn't need the threat of punishment (or the enticement of reward) to behave honestly, treat people decently and so on. Further, I really have a problem with the evangelical notion of "saved by grace" - i.e., you can literally be Hitler or Stalin, have murdered millions and been a sadist you're entire life, but so long as you "accept the Lord" 5 minutes before they hang you, you're "forgiven."
That doctrine makes me want to puke.