It actually already does work that way, there are plenty of local models you can run on an ordinary offline computer. I use them myself, I just finished having one do a big analysis of my old email archives to ensure the headers were well formatted and nothing was corrupted and since it was personal mail I didn't want any of it leaving my computer.