In an ideal scenario for sure, but in implementation you're going to run into issues like network throughput and resource access distribution optimization (i.e. feynman parallarity). I got out of the house without a whiteboard or a single grad student (you just never remember the important things) so I can't confirm more than napkin math, but you may indeed be right that it's at worst quadratic.