Apparently Gemma 4 (by deepmind) are very energy-efficient for their capabilities.

The post itself seems to recommend a company (neuralwatt.com) but it's unrelated to project wagtail (an open source CMS made with django) so I consider it legit, they're just vouching for this new approach that shows users their ecological footprint basically.

(Of course, running these at a homelab is possible. hence the relevance of this info for the community)

cross-posted from: https://programming.dev/post/51407459

Check what can you use and at what rate of token per seconds would it be... It has examples of many models and quantization levels. Huge resource!

cross-posted from: https://programming.dev/post/51407459

Check what can you use and at what rate of token per seconds would it be... It has examples of many models and quantization levels. Huge resource!

cross-posted from: https://programming.dev/post/51407459

Check what can you use and at what rate of token per seconds would it be... It has examples of many models and quantization levels. Huge resource!

cross-posted from: https://programming.dev/post/51407459

Check what can you use and at what rate of token per seconds would it be... It has examples of many models and quantization levels. Huge resource!

Check what can you use and at what rate of token per seconds would it be... It has examples of many models and quantization levels. Huge resource!

Examine a GH user's profile, to help quickly decide how much to invest in their contributions. - ehmatthes/gh-profiler

I've just found the project. And it seems very interesting take. I am adding a link to their blog entry discussion on a system to combat LLMs abuse via a web of trust.

From their site:

We envision a place where developers have ownership of their code, communities can freely self-govern and most importantly, coding can be social and fun again.

AT Protocol enables federated code-collaboration. Submit pull-requests or bug-reports to any repository hosted on any server.

[...]

OpenClaw [AI] simultaneously addresses two massive psychological needs in China today: for the employed, it’s a perceived “cure” for overwork; for the unemployed, it’s a new opportunity outside of the usual delivery and ride-hailing grind.

[...]

I just like the ring of these two words. Like civil disobedience against opression... I consider self hosting to be the epitome of these actions, in the context of global corporations "ruining" every "product" (be it: privacy concerns, data brokers, pushing AI into products, etc.) Hence, the concept that arises when these two words come together: Cybernetical Disobedience, is the greatest motivation (imho) to spin up some containers, be it searxng, vaultwarden, syncthing, or arr stack. All comes with some rebellious ideation behind... Do any of you feel like me?