I thought the issue you had was with the information itself. Why does it "being a program" matter? That said, it is; "symptom checker" specifically and "page rank" more generally.

its too much of the wild west

And? There seems to be this assumption that "wild West" == bad/dangerous/scary/harmful. The modern Internet is certainly far less of the "wild West" it used to be. I would also argue it is also far more dangerous, harmful and nefarious than the "wild West" web.

the amount of people that have committ suicide after interacting with LLMs rather than seeing a mental health professional would be a fairly relevant example though.

Anecdotes aren't useless, but they need to be contextualized. Is it higher than the baseline? Is it greater then those who didn't commit suicide because when the mental health institutions failed them they at least had some sort of backup?

Navigating healthcare while dealing with a mental health issues is a paradox. Is the damage caused greater than the damage prevented from allowing access to a tool that can help lower that barrier to entry?

Looking at general trends I find that the harms outweighing the benefits very hard to believe. Do you have anything non-anecdotal, on that specific point, to back it up?