Hah!
I am doing this on a Steam Deck, running Bazzite.
I keep it 'docked', powered up, when running an LLM on it... but yeah... anybody can do this.
Its really not that hard, you do not need a battle station.
A battle station would obviously help with more complex tasks.
But its uh ... not necessary.
I imagine the GabeCube would be even better at this.
At one point I sat down and worked out the math, and yeah, I could get a solar power station thingy, and... just actually be able to run the whole setup off of sunlight.
Its not instantaneous, it takes some time to generate complex answers/responses, but it does work.
So... yeah, I functionally could have a local LLM that is mostly kinda portable, if you carried a battery pack / dock on your person in a backpack with the Deck, or in your car, maybe along with said solar power station.