This may take the award for dumbest thing I've read all day and it's barely after lunch.
These models are just lossy compression for text. Copying them like this is like repeatedly re-encoding a jpeg until it looks like a deep fried meme from a decade ago.
They're also not recreating anything, they're just creating a "fine tune" or secondary training corpus for a totally unrelated pre-existing model.
