It was an analogy.
I am an a-stamp-collector. I do not collect stamps. This does not necessarily mean I still collect something.
I am also an atheist. I do not believe any claim I have heard about a god. This does not necessarily mean I still believe something (about a deity, or indeed about anything else).