Pennsylvania:

Article 1, Section 4

"No person who acknowledges the being of a God and a future state of rewards and punishments shall, on account of his religious sentiments, be disqualified to hold any office or place of trust or profit under this Commonwealth."

I don't see any discrimination against atheists here.