441
Google’s Search AI Says Slavery Was Good, Actually (futurism.com)
submitted 3 years ago by to c/technology@lemmy.world
167 comments fedilink hide all child comments
 

Google's AI-driven Search Generative Experience have been generating results that are downright weird and evil, ie slavery's positives.

you are viewing a single comment's thread
view the rest of the comments
[–] 144 points 3 years ago (7 children)

I think this is an issue with people being offended by definitions. Slavery did “help” the economy. Was it right? No, but it did. Mexico’s drug problem helps that economy. Adolf Hitler was “effective” as a leader. He created a cultural identity for people that had none and mobilized them to a war. Ethical? Absolutely not. What he did was horrendous and the bit should include a caveat, but we need to be a little more understanding that it’s a computer; it will use the dictionary of the English language.

  • permalink
  • fedilink
  • source
  • hideshow 13 child comments
    •
  • [+] 48 points 3 years ago* (1 child)
    [deleted]
  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 23 points 3 years ago (2 children)

    Your and @WoodenBleachers's idea of "effective" is very subjective though.

    For example Germany was far worse off during the last few weeks of Hitler's term than it was before him. He left it in ruins and under the control of multiple other powers.

    To me, that's not effective leadership, it's a complete car crash.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [+] 17 points 3 years ago (10 children)
    [deleted]
  • permalink
  • fedilink
  • source
  • parent
  • hideshow 11 child comments
    •
  • [–] 5 points 3 years ago* (11 children)

    He was able to convince the majority that his way of thinking was the right way to go and deployed a plan to that effect

    So, you're basically saying an effective leader is someone who can convince people to go along with them for a sustained period. Jim Jones was an effective leader by that metric. Which I would dispute. So was the guy who led the Donner Party to their deaths.

    This is why I see a problem with this. You and I are able to discuss this and work out what each other means.

    But in a world where people are time-poor and critical thinking takes time, errors based on fundamental misunderstandings of consensual meanings can flourish.

    And the speed and sheer amount of global digital communication means that they can be multiplied and compounded in ways that individual fact checkers will not be able to challenge sucessfully.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 12 child comments
    •
  • [–] 8 points 3 years ago (1 child)

    I mean Jim Jones was pretty damn effective at convincing a large group of people to commit mass suicide. If he'd been ineffective, he'd have been one of the thousands of failed cult leaders you and I have never heard of. Similarly, if Hitler had been ineffective, it wouldn't have takes the combined forces of half the world to fight him.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 3 years ago*

    This is true, I guess the difference in the Jim Jones scenario is whether you define effective leadership as being able to get your plan carried out (even if that plan is killing everyone you lead) or whether you define it as achieving good outcomes for those you lead.

    Hitler didn't do either of those things in the end so I still don't rate him, but I can see why you would if you just look at the first part of his reign.

    AI often produces unintended consequences based on its interpretations - there's a great TED talk on some of these - and I think with the LLMs we have way more variables in our inputs than we have time to define them. That will probably change as they get refined.

  • permalink
  • fedilink
  • source
  • parent
    • load more comments (10 replies)
    • load more comments (9 replies)
  • [–] 1 point 3 years ago (1 child)

    If you ask it for evidence Hitler was effective, it will give you what you asked for. It is incapable of looking at the bigger picture.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 3 years ago* (last edited 3 years ago) (1 child)

    it doesn't even look at the smaller picture. LLMs build sentences by looking at what's most statistically likely to follow the part of the sentence they have already built (based on the most frequent combinations from their training data). If they start with "Hitler was effective" LLMs don't make any ethical consideration at all.... they just look at how to end that sentence in the most statistically convincing imitation of human language that they can.

    Guardrails are built by painstakingly trying to add ad-hoc rules not to generate "combinations that contain these words" or "sequences of words like these". They are easily bypassed by asking for the same concept in another way that wasn't explicitly disabled, because there's no "concept" to LLMs, just combination of words.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 3 years ago (1 child)

    Yes, but in many defense the "smaller picture" I was alluding to was more like the 4096 tokens of context ChatGPT uses. I didn't mean to suggest it was doing anything we'd recognize as forming an opinion.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 3 years ago

    Sorry if I gave you the impression that I was trying to disagree with you. I just piggy-backed on your comment and sort of continued it. If you read them one after the other as one comment (at least iny head), they seem to flow well

  • permalink
  • fedilink
  • source
  • parent
  • [–] 8 points 3 years ago (2 children)

    Slavery is not good for the economy... Think about it, you have a good part of your population that are providing free labour, sure, but they aren't consumers. Consumption is between 50 and 80% of GDP for developed countries, so if you have half your population as slave you loose between 20% and 35% of your GDP (they still have to eat so you don't loose a 100% of their consumption).

    That also means less revenue in taxes, more unemployed for non slaves because they have to compete with free labour.

    Slaves don't order on Amazon, go on vacation, go to the movies, go to restaurant etc etc That's really bad for the economy.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 14 points 3 years ago (2 children)

    That really bad for a modern consumer economy yes. But those werent a thing before the industrial revolution. Before that the large majority of people were subsitance/tennant farmer or serfs who consumed basically nothing other than food and fuel in winter. Thats what a slave based economy was an alternantive to. Its also why slvery died out in the 19th century, it no longer fit the times.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 2 points 3 years ago (1 child)

    I wish it did die out in the 19th century. We have more slaves now than ever.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 3 years ago (1 child)

    There being more slaves now then ever is heavily disputed. There is also the fact that was little more than a billion people in the world when the trans-Atlantic slave trade stopped, so there would have to be 8 times as many for slavery to be as prevalent.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 4 points 3 years ago* (1 child)

    Yes, I agree, our per capita slave figure has to be much lower these days, mathematically speaking.

    Even one slave is a slave too many, and knowing there are still so many (whatever figure we put it at) is heartbreaking.

    Things like the cocoa plantation slaves and the slave fishing ships have people kidnapped and forced to work for nothing. Actual slavery by any definition.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 3 years ago (1 child)

    Of course, when I said it died out I didn't mean slavery was entirely gone and doesn't exist at all. I mean it died out as a prevalent societal structure.

    100s of people in slavery on a cocoa plantation is of course awful, but it shouldn't obscure the fact that there used to be vast swathes of land where slaves outnumbered free people and their children were born into bondage - that is what has died out.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 3 years ago (3 children)

    Look at the Saudi, China or the UAE, it's still a pretty efficient way to boost your economy. People don't need to be consumer if this isn't what your country needs.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 5 child comments
    •
  • [–] 3 points 3 years ago (1 child)

    China has slavery? Also Saudi Arabia and the UAE import slaves, which is better for the economy than those people not being there at all but worse than them being regular workers.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 3 years ago (1 child)

    Those are very specifics examples, with two of the biggest oil producers, and the factory of the world. Thus their whole economies is based on export, so internal consumption isn't important.

    Moreover what proof do you have their economies wouldn't be in a better shape if they didn't exploit some population but made them citizen with purchasing power?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 3 years ago (1 child)

    2/3 of the people living in the Saudi Emirate are immigrants whose passports have been confiscated, they work in factory, construction sites, oil pit, and all other kind of manual jobs. Meanwhile the Saudi citizens occupy all the well paid job that require education, immigrants can't apply to those. If they didn't use forced labor, there simply wouldn't be enough people in the country to occupy all the jobs. Their economy could not be as good as it is right now.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 3 years ago

    Because their GDP comes from exporting a very rare and valuable natural resource. This is a rare case in the world, and not the one I was talking about.

    Plus who's to say they wouldn't have a better economy if those exploited people could consume more?

  • permalink
  • fedilink
  • source
  • parent
    • load more comments (1 reply)
  • [–] 3 points 3 years ago (1 child)

    I think the problem is more that given the short attention span of the general public (myself included), these "definitions" (I don't believe that slavery can be "defined" as good, but okay) are what's going to stick in the shifting sea of discourse, and are going to be picked out of that sea by people with vile intentions and want to justify them.

    It's also an issue that LLMs are a lot more convincing than they should be, and the same people with short attention spans who don't have time to understand how they work are going to believe that an Artificial Intelligence with access to all the internet's information has concluded that slavery had benefits.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 5 points 3 years ago (2 children)

    what's going to stick in the shifting sea of discourse

    This is what I think too. We've had enough trouble with "vaccines CaUsE AuTiSm" and that was just one article by one rogue doctor.

    AI is capable of a real death-by-a-thousand-cuts effect.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 3 points 3 years ago* (3 children)

    that was just one article by one rogue doctor.

    That was pushed by many media organizations because its sensationalist topic. Antivaxers are idiots but the media played a fucking huge role blowing a pilot study that had a rather fucking absurd conclusion out of proportions, so they can sell more ads/newspapers. I fucking doubt most antivaxers (Hell I doubt most people haven't either) even read the original study and came to their own conclusions on this. They just watched on the telly some stupid idiots giving a bullshit story that they didn't combat at all

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
    load more comments (3 replies)
    • load more comments (1 reply)