LLM, emphasis on the Large. A standard LLM will take up A LOT of storage space to the point where the user won't have much left. Let alone the continuous processing power needed.

Siri + local "Small" Language Model. It could have full access to on device data, but more generalized quires are done remotely.