AI inference is doable on home equipment. AI training is less feasible, but nobody builds their whole Debian distro from source either. It's enough that the source is available and you can rebuild any component if you want ot do so.