But if the LLM stays in the V-RAM or even just stays in normal RAM does it still benefit from zram? I thought that only helped when the ram was not enough.
So I'd say it is more likely the bore scheduler + better drivers.
But if the LLM stays in the V-RAM or even just stays in normal RAM does it still benefit from zram? I thought that only helped when the ram was not enough.
So I'd say it is more likely the bore scheduler + better drivers.