Revolut says that in less than a year it's managed to slash its [code generation] costs by roughly 90 percent by making self-hosted models its default instead of relying primarily on commercial services like Claude.

you are viewing a single comment's thread
view the rest of the comments
[–] 73 points 9 hours ago (17 children)

And ethically trained. People should be financially compensated if their data was used to train AI without their consent.

  • source
  • parent
  • hideshow 17 child comments
  • [–] 22 points 8 hours ago (14 children)

    I don't think it's really possible to do this.

    I mean speaking just logistically, how would you determine who gets how much? If it's based on quality, how do you determine what is of high quality? Otherwise, does everyone who has every written anything that finds its way into a training dataset get like a tenth of a cent?

    Alternative proposal: all AI models must be released as open weights, available to everyone.

    AI, through its use of training data, has benefited from the sum total of human knowledge, therefore the results of this training should be given back for the use of all humanity.

    That seems fair to me.

  • source
  • parent
  • hideshow 14 child comments
  • [–] 19 points 6 hours ago* (1 child)

    This is also my opinion. I always advocate for putting GenAI models under UNESCO stewardship, because they are a snapshot of all digital, cultural output the world has to offer, and therefor they aren't less important than physical cultural artifacts. Free personal use, licensed use for commercial usage, with lower prices for educational/nongovernmental organisations. Use the funding to provide grants to the arts in a large scale.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 7 points 7 hours ago

    You are right if we look at it short term, long term llm will be replaced with the next thing and who knows maybe it can be trained ethically, at least we should require research into it.

  • source
  • parent
  • [–] 3 points 7 hours ago (9 children)

    I don't think it's really possible to do this.

    Why not? Both parties have to figure out how much they want to pay or to get payed. Similar like it works for any other license like on Netflix or Spotify. It is not the AI companies job to determine how much they will get payed but how much the data is worth to them and the data creator how much they want.

    If i am at a bakery and the bread they offer does not look like its for that much to me then i have not to buy it.

  • source
  • parent
  • hideshow 9 child comments
  • [–] -2 points 7 hours ago (8 children)

    How do you suggest an individual should go about this?

    Do I go down to my local courthouse and file a suit against Anthropic so I can ask the judge to subpoena them to determine if my Reddit shitpost from 2012 is in their training set?

  • source
  • parent
  • hideshow 8 child comments
  • [–] 1 point 7 hours ago (7 children)

    Class action lawsuits. How would something like this work for anything else? Like Netflix subscription violations?

    And we are talking about meaningful data not your shitpost, like licensed code or a book you wrote and anthropic pirated.

  • source
  • parent
  • hideshow 7 child comments
  • [–] 1 point 7 hours ago (6 children)

    And we are talking about meaningful data not your shitpost, like licensed code or a book you wrote and anthropic pirated.

    Ah ha! You see, that's the problem. My shitpost is meaningful data. This is something people seem to have a really hard time understanding. Scaling laws and the size of the search space in AI training means that the datum is not valuable. It's only the data (in conglomerate) that is value for training, and my shitpost would be a part of that.

    Once you understand this, you should see what I meant when I said it's not feasible. How do you determine and then fairly distribute the payout to everyone who has ever written or recorded anything in digital format? This is not a simple supply vs demand equation, like your bakery example assumes.

    Also I have no idea what Netflix has to do with this discussion.

  • source
  • parent
  • hideshow 6 child comments
  • [–] 1 point 7 hours ago (5 children)

    Ah ha! You see, that's the problem.

    No. Meaningful in the sense of copyright. Data you get copyright

    There you got your distinction.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 0 points 6 hours ago (4 children)

    Copyright isn't something you "get." It's something that comes with the production, no extra steps required.

    You've accidentally come upon the other reason why your example doesn't hold in the training data case. How do you suss out who actually holds the copyright on that data.

    Take my shitpost for example. Whonis the copyright holder? Me the author? Reddit the platform I published on? What if the source was an Internet Archive snapshot?

    Do you earnestly believe this could work in practice?

  • source
  • parent
  • hideshow 4 child comments
  • [–] 1 point 6 hours ago (3 children)

    When i write a sentence then do i have a copyright upon it which i can defend in law? No. Yes copyright is nothing you get, that in theory is correct but in practice a sentence or few lines of code don't let me fight for them in court.

    The current models are all trained with data which at least some larger creator (book writer or whatever) does not want a model to be trained on. So the discussion is a complete other, not how ppl will be compensated on their unlawful use of their data but on how the payment works in the future and here comes my first comment back.

    The current models are under the current law unsustainable. And more and more courts rule in this direction.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 6 hours ago (2 children)

    When i write a sentence then do i have a copyright upon it which i can defend in law?

    Umm... Yes. Yes, you do. That's how copyright works...

    The current models are all trained with data which at least some larger creator (book writer or whatever) does not want a model to be trained on.

    Is this not antithetical to your stance? Or are you saying that only those entities large enough to defend themselves against the likes of OpenAI and Anthropic are deserving of being paid for use of their works?

    The current models are under the current law unsustainable.

    I completely agree with you here, but something like a class action lawsuit is not a viable solution.

    You understand the scale right? This is a combinatorial problem: the plaintiffs in this case would be every individual and company that has ever existed, and the defendants would be not only the AI companies, but also anyone who has ever used or published AI generated content. That's a wishful thought, not a realistic solution.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 5 hours ago (1 child)

    that in theory is correct but in practice a sentence or few lines of code don't let me fight for them in court.

    Pls dont bother to answer if you do not have a proof that a simple sentence or a simple line of code has any meaning for copyright in the court. And no i dont mean the few sentences that are actually copyrighted since they are catchphrases to specifics. No i mean a general sentence, or line of code.

    Try to copyright "i = i + 1". Then we can continue this talk.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 4 points 6 hours ago

    Open weight models cannot do this, they do not have any funding. If you demand this, you are just demanding that there will never be any open models, that proprietary AI models controlled by massive trillion dollar corporations will be the only models available, and frankly the cure is worse than the disease.

    It's also impractical, like closing the gate after the horses have already gone. Open-weight, unethically trained models are already out there. They are not going away. You cannot put the genie back in the bottle. They will never earn any money, so they will never be able to compensate for the training that was done to create them, unless you consider the fact that they exist, and they are open to anybody, as at least some measure of compensation.

    It's not enough compensation, but it is something. The training was certainly unethical, but so is an economic system that requires intellectual property to be transactional. Why fix one unethical thing while keeping and reinforcing another?

    The only sensible and reasonable way to resolve the issue in the long term is for significant government support and patronage of the arts and content creators (and ideally all people) to be established. People who do this for a living are providing valuable service to all of humanity and that deserves to be recognized not by transactional, metered capitalism that defines each piece of art or content in terms of its raw economic value (a system easily and frequently corrupted anyway if you look at the prevalence of theft, forgery, fraud and money-laundering in the high art world), but by guaranteeing a comfortable and dignified life that allows creative people to freely create the art or other works they love and feel passionate about without worrying that they're going to starve to death or be forced into a dead-end job if they're not economically successful.

  • source
  • parent