I am sorry you get tossed out with the bathwater.
It absolutely is something I struggle with. To me, I know LLMs are just called AI but aren't, and machine learning is not LLM. I've actually developed a neural network based program for a previous company before and know it can be useful in certain cases.
But how do I know the person I'm talking to knows that? How do I know the person is one of the minority who is trying to do it ethically and responsibly? How do I express just how truly damaging the current mainstream "AI" methods are succinctly and strongly without getting bogged down in that discussion and sidetracked from the bigger picture (which is exactly what's happening here in this comment for example).