Yes, I installed an LLM at home. I use it for many useful things:
- reading novels by translating them from English to my language on the fly via machine
- for communicating on lemmy by translating posts and comments
- For HomeAssistant
- And very rarely for development and searching the internet
I have a RX9070XT and llama-swap to switch models on the fly. I'm thinking about installing a second RX9070XT so that I don't take away the translation capability from my lemmy instance while I stress the other neural network with other tasks.