[–] 2 points 9 hours ago (1 child)

How about a cloud provider and then taking a open model to that? Also difficult to find, but it's better chance... Hetzner comes to mind. Then you may self-host ollama and some gateway to monitor token usage.

Even if it came to API key on a asian or american company, self host makes sense to me to relax on the lock in (e.g. Bifrost) and have some management dashboard. There's a growing ecosystem of self-hosted tools, the lates I saw was experientiallabs.ai that was aimed to save costs.

(6I'm on a similar track tho I am just a 1-man army with lended over pro plans (no apis) setting up omp.sh to combine and decouple tasks among providers and differentially sized models.)

  • source
  • [–] 2 points 4 days ago (1 child)

    Oh, I see. That definition gives me a new perspective... I always thought of it as ableism.. before online spaces, and even before the word ableism came to my life. As a kid, I always heard that using retarded as an insult was wrong.

    I guess I will have to add this to my todo list, right after invention of time travel ;p hehe. Imagine a kid quoting the dictionary to an adult.

    In any case, your comment stays and my person has learned something new for moderation, beyond this terminology.. the context is very important. I actually felt like removing the comment would have been wrong. It seemed your words were too harsh but still, they were going for a point, without raw intent to insult or carry any ad hominem fallacy. I see my instinct was right :) hooray!

  • source
  • parent
  • context
  • [–] 1 point 4 days ago (1 child)

    Oh, this is not about the top level comment anymore. Zd9 replied one positive use of AI. Not to demeanor the negative sides by that, only to put a fact on the table. Then you came in... the discussion now shifted into.. this. I am no longer engaging, sorry. I didn't mean to discuss at all, only wanted to help u see how the conversation was about you not understanding something... It's there, your downvoted comment.

  • source
  • parent
  • context
  • [–] 3 points 5 days ago* (last edited 5 days ago) (3 children)

    I believe this discussion is important, just the other day I was sad about people colluding inference and training like if both were having the same carbon footprint. I am not defending Sam Altman or anyone else. But we need to look at the facts for what they're. Running a quantized local model, accepting latency and all, can make your use of LLMs as low as playing video games. I already said that in the past, and I only got downvoted. Maybe because everyone is hurt bout this technology, which is having detrimental consequences. I am not saying there aren't any problems... but I am accepting the world for what it is, as GPT4 has said ~3 years ago: confetti has left the cannon.

    So, we need to deal with this reality. The training done on data like open source code, or even copyrighted materials, will always be a debt.

    Just like colonialism. And yet, we are not hating each other for "simple" stuff like eating chocolate or drinking coffee which is most often than not unethically sourced. OR the minerals that make our electronic devices..

    Again, it's not that I am vouching to ignore the issues. But I rather have us take the conversation as a debate or dilemma. Not just start attacking one another.

    This all seems like that caricature of a vegan that hates the vegetarians for eating some cheese.

    Look at the common ground. Here, on lemmy, more often than anywhere else, we have a big chunk of values and ethics in common.

  • source
  • [–] 1 point 5 days ago (3 children)

    I think you're the one wrong. You were accusing zd9 to be defending diffusion models and LLMs. So they said: yes, I am precisely using those and not just any other machine learning algorithm. Yet, you didn't seem to understand... or you're just really unable to see yourself as being incorrect? :/

  • source
  • parent
  • context
  • [–] 2 points 1 week ago

    Oh yeah I meant to say that some sciences have origins that predate empiricism itself. Astronomy for example. Also, some may argue that not all sciences are rooted on evidence in the same way (e.g. positivism would call psychoanalysis a pseudoscience even though there're powerful conclusions that were drown without evidence and have helped people).

    Actually, all hypothesis start with a certain lack of evidence. Some hold for their own value, as potential explanations... Yes, O am not talking about maths anymore but about all sciences. For example many subatomic particles that are investigated by CERN. That's why I believe your approach was shortsighted.

  • source
  • parent
  • context
  • [–] 30 points 1 week ago (2 children)

    Sounds great. Who's stefano? Since I don't know them and the source code is not published yet I am uncertain about this.

    And can you explain what's the lighthouses method to bypass NAT? Never heard of it. Seems like the model for this app is p2p-like more than "strict self-host" (similar to scuttlebutt and other projects), am I right?

  • source
  •  

    Apparently Gemma 4 (by deepmind) are very energy-efficient for their capabilities.

    The post itself seems to recommend a company (neuralwatt.com) but it's unrelated to project wagtail (an open source CMS made with django) so I consider it legit, they're just vouching for this new approach that shows users their ecological footprint basically.

    (Of course, running these at a homelab is possible. hence the relevance of this info for the community)

     

    I've just found the project. And it seems very interesting take. I am adding a link to their blog entry discussion on a system to combat LLMs abuse via a web of trust.

    From their site:

    We envision a place where developers have ownership of their code, communities can freely self-govern and most importantly, coding can be social and fun again.

    AT Protocol enables federated code-collaboration. Submit pull-requests or bug-reports to any repository hosted on any server.

    view more: next ›