Apologies if this is the wrong comm, I'm not Matrix verified so probably can't post in [email protected]

Just thought I should mention this before admins end up doing the upgrade. Most federated instances, including lemmy.ml and Lemmygrad have already upgraded by now.

转发自: https://rss.ponder.cat/post/161841

Will a 486 run Crysis? No, of course not. Will it run a large language model (LLM)? Given the huge buildout of compute power to do just that, many people would scoff at the very notion. But [Yeo Kheng Meng] is not many people.

He has set up various DOS computers to run a stripped down version of the Llama 2 LLM, originally from Meta. More specifically, [Yeo Kheng Meng] is implementing [Andreq Karpathy]’s Llama2.c library, which we have seen here before, running on Windows 98.

Llama2.c is a wonderful bit of programming that lets one inference a trained Llama2 model in only seven hundred lines of C. It it is seven hundred lines of modern C, however, so porting to DOS 6.22 and the outdated i386 architecture took some doing. [Yeo Kheng Meng] documents that work, and benchmarks a few retrocomputers. As painful as it may be to say — yes, a 486 or a Pentium 1 can now be counted as “retro”.

The models are not large, of course, with TinyStories-trained  260 kB model churning out a blistering 2.08 tokens per second on a generic 486 box. Newer machines can run larger models faster, of course. Ironically a Pentium M Thinkpad T24 (was that really 21 years ago?) is able to run a larger 110 Mb model faster than [Yeo Kheng Meng]’s modern Ryzen 5 desktop. Not because the Pentium M is going blazing fast, mind you, but because a memory allocation error prevented that model from running on the modern CPU. Slow and steady finishes the race, it seems.

This port will run on any 32-bit i386 hardware, which leaves the 16-bit regime as the next challenge. If one of you can get an Llama 2 hosted locally on an 286 or a 68000-based machine, then we may have to stop asking “Does it run DOOM?” and start asking “Will it run an LLM?”

From Blog – Hackaday via this RSS feed

This is what an actual feminist triumph looks like, not space tourism

@[email protected] in shambles rn

Echoing reminders of Tumblr's ban on adult content in December 2018, Texas internet users are once again feeling their sexuality erased as PornHub makes a deal with third-term governor Greg Abbott to reopen the website in the state with strictly safe for work content. Starting in March 2024, the website was previously banned in the state, as a result of the threat of heavy fines during a lawsuit by the Texas attorney general over non-compliance with a recently enacted age verification statute. The statute has been appealed to the Supreme Court, expected to give a final decision on the case in late June.

Supporters of the move included evangelical churches, and online groups such as the anti-sexual celibate group known as the "Volcel Police". A spokeperson for Texas attorney general Paxton referred us to the attorney's previous Tweet reading: "In Texas, companies cannot get away with showing porn." Reached for comment, the Volcel Police reportedly thanked the attorney general for support of their mission.

Far-left Internet users reached out to condemn the Volcel Police with the anti-police slogan "ACAB", popularized during the George Floyd protests. The move was also contentious in the LGBTQIA+ community, including among sex-repulsed asexuals, some of which watched videos on the site for the first time, even while holding sex-positive views wishing that others should be able to safely express their sexualities on the Internet. At press time, users reportedly wondered if the safe-for-work videos were an April Fools' joke.

National security adviser Michael Waltz invites a journalist from The Atlantic into a Signal chat group and reveals advance information on US attacks, seemingly by accident.