In my experience they're a great tool to wrap and unwrap knowledge in and from language envelopes with different characteristics and I wouldn't at all be surprised if they replace certain jobs which deal mostly with communicating with people (for example, I suspect the kind of news reporting of news agencies doesn't really need human writters to compose articles, just data in bullet point format an LLM to turn it into a "story").
What LLMs are not is AGI and using them as knowledge engines or even just knowledge sources is a recipe for frustration as you end up either going down the wrong route by believing the AI or spending more time validating the AI output than the time it would take to find out the knowledge yourself from reliable sources.
Whilst I've been on and off on the whole "might they be the starting point from which AGI comes" (which is really down to the question "what is intelligence"), what I am certain is nobody who is trully knowledgeable about it can honestly and assuredly state that "they are the seed from which AGI will come", and that kind of crap (or worse, people just stating LLMs already are intelligent) is almost all of the hype we get about AI at the moment.
At the moment and judging by the developments we are seeing, I'm more inclined to think that at least the reasoning part of intelligence won't be solved by this path, though the intuition part of it might as that stuff is mainly about pattern recognition.