223
Greg Rutkowski Was Removed From Stable Diffusion, But AI Artists Brought Him Back - Decrypt (decrypt.co)
submitted 3 years ago by to c/technology@beehaw.org
246 comments fedilink hide all child comments
 

Greg Rutkowski, a digital artist known for his surreal style, opposes AI art but his name and style have been frequently used by AI art generators without his consent. In response, Stable Diffusion removed his work from their dataset in version 2.0. However, the community has now created a tool to emulate Rutkowski's style against his wishes using a LoRA model. While some argue this is unethical, others justify it since Rutkowski's art has already been widely used in Stable Diffusion 1.5. The debate highlights the blurry line between innovation and infringement in the emerging field of AI art.

you are viewing a single comment's thread
view the rest of the comments
[–] 23 points 3 years ago (29 children)

No, it wasn't. Theft is a well-defined word. When you steal something you take it away from them so that they don't have it any more.

It wasn't even a case of copyright violation, because no copies of any of Rutkowski's art were made. The model does not contain a copy of any of the training data (with an asterisk for the case of overfitting, which is very rare and which trainers do their best to avoid). The art it produces in Rutkowski's style is also not a copyright violation because you can't copyright a style.

There is no ethical stance for letting billion dollar tech firms hoover up all the art ever created to the try and remix it for profit.

So how about the open-source models? Or in this specific instance, the guy who made a LoRA for mimicking Rutkowski's style, since he did it free of charge and released it for anyone to use?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 29 child comments
    •
  • [–] 28 points 3 years ago (28 children)

    Yes copies were made. The files were downloaded, one way or another (even as a hash, or whatever digital asset they claim to translate them into) then fed to their machines.

    If I go into a Ford plant, take pictures of their equipment, then use those to make my own machines, it's still IP theft, even if I didn't walk out with the machine.

    Make all the excuses you want, you're supporting the theft of other people's life's work then trying to claim it's ethical.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 28 child comments
    •
  • [–] 17 points 3 years ago* (25 children)

    Yes copies were made. The files were downloaded, one way or another (even as a hash, or whatever digital asset they claim to translate them into) then fed to their machines.

    They were put on the Internet for that very purpose. When you visit a website and view an image there a copy of it is made in your computer's memory. If that's a copyright violation then everyone's equally boned. When you click this link you're doing exactly the same thing.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 25 child comments
    •
  • [–] 11 points 3 years ago (18 children)

    By that logic I can sell anything I download from the web while also claiming credit for it, right?

    Downloading to view != downloading to fuel my business.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 18 child comments
    •
  • [–] 15 points 3 years ago (5 children)

    No, and that's such a ridiculous leap of logic that I can't come up with anything else to say except no. Just no. What gave you that idea?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 5 child comments
    •
  • [–] 9 points 3 years ago (4 children)

    Because this thread was about the companies taking art feeding it into their machine a D claiming not to have stolen it.

    Then you compared that to clicking a link.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 11 points 3 years ago (3 children)

    Yes, because it's comparable to clicking a link.

    You said:

    By that logic I can sell anything I download from the web while also claiming credit for it, right?

    And that's the logic I can't follow. Who's downloading and selling Rutkowski's work? Who's claiming credit for it? None of that is being done in the first place, let alone being claimed to be "ok."

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 3 points 3 years ago (2 children)

    Because that is what they're doing, just with extra steps.

    The company pulled down his work, fed it to their AI, then sold the AI as their product.

    Their AI wouldn't work, at all, without the art they "clicked on".

    So there is a difference between me viewing an image in my browser and me turning their work into something for resell under my name. Adding extra steps doesn't change that.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 5 points 3 years ago (1 child)

    The company pulled down his work, fed it to their AI, then sold the AI as their product.

    If you read the article, not even that is what's going on here. Stability AI:

    • Removed Rutkowski's art from their training set.
    • Doesn't sell their AI as a product.
    • Someone else added Rutkowski back in by training a LoRA on top of Stability's AI.
    • They aren't selling their LoRA as a product either.

    So none of what you're objecting to is actually happening. All cool? Or will you just come up with some other thing to object to?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 3 points 3 years ago

    But they did.

    (I'm on mobile so my formatting is meh)

    They put his art in, only when called out did they remove it.

    Once removed, they did nothing to prevent it being added back.

    As for them selling the product, or not, at this point, they still used the output of his labor to build their product.

    That's the thing, everyone trying to justify why it's okay for these companies to do it keep leaning on semantics, legal definitions or "well, back during the industrial revolution..." to try and get around the fact that what these companies are doing is unethical. They're taking someone else's labor, without compensation or consent.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 9 points 3 years ago (11 children)

    No, but you can download Rutkovski's art, learn from it how to paint in his exact style and create art in that style.

    Which is exactly what the image generation AIs do. They're perhaps just a bit too good at it, certainly way better than an average human.

    Which makes it complicated and morally questionable depending on how exactly you arrive at the model and what you do with it, but you can't definitively say it's copyright infringement.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 11 child comments
    •
  • [–] 6 points 3 years ago (7 children)

    You keep comparing what one person, given MONTHS or YEARS of their life could do with one artists work to a machine doing NOT THE SAME THING can do with thousands of artists work.

    The machine is not learning their style, it's taking pieces of the work and dropping it in with other people's work then trying to blend it into a cohesive whole.

    The analogy fails all over the place.

    And I don't care about copyright, I'm not an artist or an IP lawyer, or whatever. I can just look at a company stealing the labor of an entire industry and see it as bad.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 7 child comments
    •
  • [–] 11 points 3 years ago (5 children)

    The speed doesn't factor into it. Modern machines can stamp out metal parts vastly faster than blacksmiths with a hammer and anvil can, are those machines doing something wrong?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 5 child comments
    •
  • [–] 5 points 3 years ago (4 children)

    The machine didn't take the blacksmiths work product and flood the market with copies.

    The machine wasn't fed 10,000 blacksmith made hammers then told to, sorta, copy those.

    Justify this all you want, throw all the bad analogies at it you want, it's still bad.

    Again, if this wasn't bad, the companies would have asked for permission. They didn't.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 5 points 3 years ago (3 children)

    That's not the aspect you were arguing about in the comment I'm responding to. You said:

    You keep comparing what one person, given MONTHS or YEARS of their life could do with one artists work to a machine doing NOT THE SAME THING can do with thousands of artists work.

    And that's what I'm talking about here. The speed with which the machine does its work is immaterial.

    Though frankly, if the machine stamping out parts had somehow "learned" how to do it by looking at thousands of existing parts, that would be fine too. So I don't see any problem here.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 2 points 3 years ago* (2 children)

    And that's where we have a fundamental difference of opinion.

    A company hiring an engineer to design a machine that makes hammers, then hiring one (or more) people to make the machine to then make hammers is the company benefiting from the work product of people they hired. While this may impact the blacksmith they did not steal from the blacksmith.

    A company taking someone else's work product to then build their product, without compensation or consent, is theft of labor.

    I don't see those as equitable situations.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 6 points 3 years ago (1 child)

    At least now you're admitting that it's a difference of opinion, that's progress.

    You think it should be illegal to do this stuff. Fine. I think copyright duration has been extended ridiculously long and should be a flat 30 years at most. But in both cases our opinions differ from what the law actually says. Right now there's nothing illegal about training an AI off of someone's lawfully-obtained published work, which is what was done here.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 2 points 3 years ago

    I'm not a fan of our copyright system. IMO, it's far to long and should also include clauses that place anything not available for (easy) access in the public domain.

    Also, I'm not talking about what laws say, should say or anything like that.

    I've just been sharing my opinion that it's unethical and I've not seen any good explanation for how stealing someone else's labor is "good".

  • permalink
  • fedilink
  • source
  • parent
  • [–] 3 points 3 years ago*

    Speed aside, machines don't have the same rights as humans do, so the idea that they are "learning like a person so it's fine" is like saying a photocopier machine's output ought to be treated as an independent work because it replicated some other work, and it's just so good and fast at it. AI's may not output identical work, but they still rely on taking an artist's work as input, something the creator ought to have a say over.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 3 points 3 years ago (2 children)

    What makes it even trickier is that taking AI generated art and using it however you want definitively isn’t copyright infringement because only works by humans can be protected by copyright.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 3 points 3 years ago

    But that's not what they did, converting it into a set of instructions a computer can use to recreate it is just adding steps.

    And, yes, that's what they've done else we wouldn't find pieces of others works mixed in.

    Also, even if that was how it worked, it's still theft of someone's else's labor to feed your business.

    If it wasn't, they would have asked for permission first.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 1 point 3 years ago

    I think my initial reply to you was meant to go somewhere else but Connect keeps dropping me to the bottom of the thread instead of where the reply I'm trying to get to is.

    I'm going to leave it (for consistency sake) but I don't think it makes much sense as a reply to your post.

    Sorry about that!

  • permalink
  • fedilink
  • source
  • parent
  • [–] 9 points 3 years ago (3 children)

    Here is where a rhethorical sleight of hand is used by AI proponents.

    It's displayed for people's appreciation. AI is not people, it is a tool. It's not entitled to the same rights as people, and the model it creates based on artists works is itself a derivative work.

    Even among AI proponents, few believe that the AI itself is an autonomous being who ought to have rights over their own artworks, least of all the AI creators.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 6 points 3 years ago (2 children)

    I use tools such as web browsers to view art. AI is a tool too. There's no sleight of hand, AI doesn't have to be an "autonomous being." Training is just a mechanism for analyzing art. If I wrote a program that analyzed pictures to determine what the predominant colour in them was that'd be much the same, there'd be no problem with me running it on every image I came across on a public gallery.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 4 points 3 years ago (1 child)

    You wouldn't even be able to point a camera to works in public galleries without permission. Free for viewing doesn't mean free to do whatever you want with them, and many artists have made clear they never gave permission that their works would be used to train AIs.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 8 points 3 years ago (1 child)

    For disclosure I am a former member of the American Photographic Artists/Advertising Photographers of America, and I have works registered at the United States Copyright Office.

    When we put works in our online portfolio, send mailers or physical copies of our portfolios we're doing it as promotional works. There is no usage license attached to it. If loaded into memory for personal viewing, that's fine since its not a commercial application nor violating the intent of that specific release: viewing for promotion.

    Let's break down your example to help you understand what is actually going on. When we upload our works to third party galleries there is often a clause in the terms of service which states the artist uploading to the site grants a usage license for distribution and displaying of the image. Let's look at Section 17 of ArtStation's Terms of Service:

    1. License regarding Your Content

    Your Content may be shared with third parties, for example, on social media sites to promote Your Content on the Site, and may be available for purchase through the Marketplace. You hereby grant royalty-free, perpetual, world-wide, licenses (the “Licenses”) to Epic and our service providers to use, copy, modify, reformat and distribute Your Content, and to use the name that you provide in association with Your Content, in connection with providing the Services; and to Epic and our service providers, members, users and licensees to use, communicate, share, and display Your Content (in whole or in part) subject to our policies, as those policies are amended from time-to-time

    This is in conjunction with Section 16's opening line:

    1. Ownership

    As between you and Epic, you will retain ownership of all original text, images, videos, messages, comments, ratings, reviews and other original content you provide on or through the Site, including Digital Products and descriptions of your Digital Products and Hard Products (collectively, “Your Content”), and all intellectual property rights in Your Content.

    So when I click your link, I'm not engaging in a copyright violation. I'm making use of ArtStation's/Epic's license to distribute the original artist's works. When I save images from ArtStation that license does not transfer to me. Meaning if I were to repurpose that work it could be a copyright violation depending on the usage the artist agrees to. Established law states that I hold onto the rights of my work and any usage depends on what I explicitly state and agree to; emphasis on explicitly because the law will respect my terms and compensation first, and your intentions second. For example, if a magazine uses my images for several months without a license, I can document the usage time frame, send them an invoice, and begin negotiating because their legal team will realize that without a license they have no footing.

    • Yes, this also applies to journalism as well. If you've agreed to let a news outlet use your works on a breaking story for credit/exposure, then you provided a license for fair compensation in the form of credit/exposure.

    I know this seems strange given how the internet freely transformed works for decades without repercussions. But as you know from sites like YouTube copyright holders are not a fan of people repurposing their works without a mutually agreed upon terms in the form of a license. If you remember the old show Mystery Science Theater 3000, they operated in the proper form: get license, transform work, commercialize. In the case of ArtStation, the site agrees to provide free hosting in compensation for the artist providing a license to distribute the work without terms for monetization unless agreed upon through ArtStation's marketplace. At every step, the artist's rights to their work is respected and compensated when the law is applied.

    If all this makes sense and we look back at AI art, well...

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 7 points 3 years ago

    Meaning if I were to repurpose that work it could be a copyright violation depending on the usage the artist agrees to.

    Training an AI doesn't "repurpose" that work, though. The AI learns concepts from it and then the work is discarded. No copyrighted part of the work remains in the AI's model. All that verbiage doesn't really apply to what's being done with the images when an AI trains on them, they are no longer being "used" for anything at all after training is done. Just like when a human artist looks at some reference images and then creates his own original work based on what he's learned from them.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 11 points 3 years ago (1 child)

    Copies that were freely shared for the purpose of letting anyone look at them.

    Do you think it's copyright infringement to go to a website?

    Typically, ephemeral copies that aren't kept for a substantial period of time aren't considered copyright violations, otherwise viewing a website would be a copyright violation for every image appearing on that site.

    Downloading a freely published image to run an algorithm on it and then deleting it without distribution is basically the canonical example of ephemeral.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •