so perhaps the AI will have to be tuned down based on the hardware they run on…

Yes, similar to Raytracing which still needs a traditional pipeline, with AI you will have "enhanced" (Neural Nets) and "basic" (if statements).