195
The West Forgot How to Build. Now It's Forgetting Code
(techtrenches.dev)
Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!
Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.
Hope you enjoy the instance!
Rules
Follow the wormhole through a path of communities !webdev@programming.dev
It's mad easy to build your own Linux from scratch in comparison to building an LLM. You can have your own distro running in like an hour. With buildroot you can have it in even less than that.
That doesn't sound like "from scratch"
I agree, but given the context of the discussion and the commonly accepted definition of Linux from Scratch, what else do you think they could have meant other than building a complete Linux based operating system from source?
The thing that literally everything other than apparently Linux means when someone says building it from scratch?
Does that actually match with the discussion in your opinion? The discussion about building open source projects? Does the information I provided not help in understanding my response?
Are you being serious or just trying to be pedantic..?
Yes it does match the discussion. They were discussing creating an LLM, from scratch, and no one was implying hitting a button and having it get created automatically for them as being the level of difficulty that the process would entail.
So really you're the one who took this off on a tangent.
We seem to have a very different view of the discussion of "open source" and "open source models" above. I don't entirely see how you arrived there, but that's OK. I don't think I took it on a tangent at all. No biggie I guess it's just a forum.
I have no idea what you're talking about
... Then why did you use it as an example?
Because the average person is not building Linux from scratch nor would they know how to
The average person wouldn't be building an open source LLM either. I don't think I follow. I was just saying that your comparison wasn't going to hit correctly at all due to how easy it actually is to build Linux and a full Linux distribution.
Yeah that's why I'm saying:
The OP is basically saying it's not really open source unless I can personally build it! Which I am saying I don't think is a requirement of open source software (your personal ability to compile software does not negate from it it's open sourceness)
tbh I wouldn't have an idea on how to build either, they are way above my skill level, i have no idea how to make a linux distro either, but i'm certain most are open source
https://unsloth.ai/docs/new/studio
This was only recently released, maybe in the future we'll have training material uber compressed down in an open source format that anyone with the skill and knowledge can use and different 'distro' releases of LLM's, we already have tons of smaller models especially from European Universities and others
https://digital-strategy.ec.europa.eu/en/policies/ai-factories
We are only like 3-4 years into AI going mainstream if that, afaik the heat death of the universe is at least 1000 years away, we have lots of time to work and improve on them, I can only wonder where they will be at in 100 years, so I try not to make any damning facebook boomer tier statements about the future