to believe in something means you must hold the belief that something is superior to all other options.
as for the abolishment of the government, sure, some want a minarchy instead, the issue is that a weak government is literally as good as none at all, or may even be worse, as for example a government that only cares about policing will just become the paid thugs of the powerful