So... almost all religous groups have some type of symbol?

For atheists I would say use the circle with the line through it symbol, the one used on street signs that means "No" like No Dogs Allowed. For agnostics, I'd use a question mark.