▲ 210 ▼ Other AI Companies Should Be Very Afraid of What Just Happened to Character.AI, According to Its Own Bankruptcy Documents: Be afraid. (futurism.com) submitted 8 hours ago by eicker@lemmy.world to c/technology@lemmy.world 65 comments fedilink hide all child comments
[–] radieschen@slrpnk.net 15 points 6 hours ago (6 children) anyone who wants to use AI will be able to continue using it Anyone who's privileged enough to have the hardware. permalink fedilink source parent hideshow 6 child comments replies: [–] rebelsimile@sh.itjust.works 4 points 2 hours ago The kind of specs that would enable local LLM usage were available on laptops since 2020. The floor for acceptable performance for LLMs stopped literally just before 24+gb of VRAM would have become pretty common in consumer applications. The reason this technology isn’t more ubiquitously available is because ‘they’ thought it would be more profitable to hoover up literally every byte of RAM and GPU in the world rather than let the technology continue to naturally evolve to a place where any consumer could have run useful models on their home computers. In other words, your anger is misplaced. permalink fedilink source parent [–] FaceDeer@fedia.io 8 points 5 hours ago Open models will still be available via API from third-party hosts. The bigger ones like Kimi K3 or GLM 5.3 don't fit on conventional desktop computers to begin with, most non-institutional users of those would already be doing that (eg via OpenRouter). permalink fedilink source parent [–] Pratai@piefed.ca 4 points 6 hours ago (3 children) Anyone who lacks the skill to to it themselves… permalink fedilink source parent hideshow 3 child comments replies: [–] Wildmimic@anarchist.nexus 2 points 4 hours ago (2 children) There's not much skill to be had there - It is literally just downloading an app nowadays if you do not want to do anything special, especially on Linux (Newelle is great stuff!). But I am sure there are similar packages available for Windows too. permalink fedilink source parent hideshow 2 child comments replies: [–] jay@pie.zerojay.com 1 point 19 minutes ago (1 child) Excuse my ignorance - I don't have much experience with AI to this point - but what does Newelle have that something like Unsloth or LMStudio does not? What makes it great stuff? permalink fedilink source parent hideshow 1 child comment replies: [–] Wildmimic@anarchist.nexus 1 point 11 minutes ago* honestly? ease of use. I like Unsloth too, but Newelle is really an easy solution if you just want to use LLMs on you own hardware (or use inference providers) that requires practically no knowledge at all - it is focused on providing something to use LLMs without anything else interfering. Unsloth does well too, but if i hadn't learnt as much as i already did when i started using it, i would probably have been overwhelmed (outside of it crashing pathetically when following symlinks for local model selection - you can define these directories, but the quick selection then just makes it crash) permalink fedilink source parent
[–] rebelsimile@sh.itjust.works 4 points 2 hours ago The kind of specs that would enable local LLM usage were available on laptops since 2020. The floor for acceptable performance for LLMs stopped literally just before 24+gb of VRAM would have become pretty common in consumer applications. The reason this technology isn’t more ubiquitously available is because ‘they’ thought it would be more profitable to hoover up literally every byte of RAM and GPU in the world rather than let the technology continue to naturally evolve to a place where any consumer could have run useful models on their home computers. In other words, your anger is misplaced. permalink fedilink source parent
[–] FaceDeer@fedia.io 8 points 5 hours ago Open models will still be available via API from third-party hosts. The bigger ones like Kimi K3 or GLM 5.3 don't fit on conventional desktop computers to begin with, most non-institutional users of those would already be doing that (eg via OpenRouter). permalink fedilink source parent
[–] Pratai@piefed.ca 4 points 6 hours ago (3 children) Anyone who lacks the skill to to it themselves… permalink fedilink source parent hideshow 3 child comments replies: [–] Wildmimic@anarchist.nexus 2 points 4 hours ago (2 children) There's not much skill to be had there - It is literally just downloading an app nowadays if you do not want to do anything special, especially on Linux (Newelle is great stuff!). But I am sure there are similar packages available for Windows too. permalink fedilink source parent hideshow 2 child comments replies: [–] jay@pie.zerojay.com 1 point 19 minutes ago (1 child) Excuse my ignorance - I don't have much experience with AI to this point - but what does Newelle have that something like Unsloth or LMStudio does not? What makes it great stuff? permalink fedilink source parent hideshow 1 child comment replies: [–] Wildmimic@anarchist.nexus 1 point 11 minutes ago* honestly? ease of use. I like Unsloth too, but Newelle is really an easy solution if you just want to use LLMs on you own hardware (or use inference providers) that requires practically no knowledge at all - it is focused on providing something to use LLMs without anything else interfering. Unsloth does well too, but if i hadn't learnt as much as i already did when i started using it, i would probably have been overwhelmed (outside of it crashing pathetically when following symlinks for local model selection - you can define these directories, but the quick selection then just makes it crash) permalink fedilink source parent
[–] Wildmimic@anarchist.nexus 2 points 4 hours ago (2 children) There's not much skill to be had there - It is literally just downloading an app nowadays if you do not want to do anything special, especially on Linux (Newelle is great stuff!). But I am sure there are similar packages available for Windows too. permalink fedilink source parent hideshow 2 child comments replies: [–] jay@pie.zerojay.com 1 point 19 minutes ago (1 child) Excuse my ignorance - I don't have much experience with AI to this point - but what does Newelle have that something like Unsloth or LMStudio does not? What makes it great stuff? permalink fedilink source parent hideshow 1 child comment replies: [–] Wildmimic@anarchist.nexus 1 point 11 minutes ago* honestly? ease of use. I like Unsloth too, but Newelle is really an easy solution if you just want to use LLMs on you own hardware (or use inference providers) that requires practically no knowledge at all - it is focused on providing something to use LLMs without anything else interfering. Unsloth does well too, but if i hadn't learnt as much as i already did when i started using it, i would probably have been overwhelmed (outside of it crashing pathetically when following symlinks for local model selection - you can define these directories, but the quick selection then just makes it crash) permalink fedilink source parent
[–] jay@pie.zerojay.com 1 point 19 minutes ago (1 child) Excuse my ignorance - I don't have much experience with AI to this point - but what does Newelle have that something like Unsloth or LMStudio does not? What makes it great stuff? permalink fedilink source parent hideshow 1 child comment replies: [–] Wildmimic@anarchist.nexus 1 point 11 minutes ago* honestly? ease of use. I like Unsloth too, but Newelle is really an easy solution if you just want to use LLMs on you own hardware (or use inference providers) that requires practically no knowledge at all - it is focused on providing something to use LLMs without anything else interfering. Unsloth does well too, but if i hadn't learnt as much as i already did when i started using it, i would probably have been overwhelmed (outside of it crashing pathetically when following symlinks for local model selection - you can define these directories, but the quick selection then just makes it crash) permalink fedilink source parent
[–] Wildmimic@anarchist.nexus 1 point 11 minutes ago* honestly? ease of use. I like Unsloth too, but Newelle is really an easy solution if you just want to use LLMs on you own hardware (or use inference providers) that requires practically no knowledge at all - it is focused on providing something to use LLMs without anything else interfering. Unsloth does well too, but if i hadn't learnt as much as i already did when i started using it, i would probably have been overwhelmed (outside of it crashing pathetically when following symlinks for local model selection - you can define these directories, but the quick selection then just makes it crash) permalink fedilink source parent