332
‘Cyberpunk 2077’ Used AI For A Dead Voice Actor’s Performance, With Permission (www.forbes.com)
submitted 2 years ago by to c/technology@lemmy.world
77 comments fedilink hide all child comments
 

There are uses of AI that are proving to be more than black and white. While voice actors, have protested their performances being fed into AI against their will, we are now seeing an example of this being done, with permission, in a very unique case.

you are viewing a single comment's thread
view the rest of the comments
[–] 41 points 2 years ago (5 children)

I was just thinking earlier today, games could probably use AI to seamlessly work the player's name into dialog. They would still hire voice actors, but insert whatever name the player chooses into the lines where it is mentioned. I feel like this isn't too far away.

  • permalink
  • fedilink
  • source
  • hideshow 10 child comments
    •
  • [–] 20 points 2 years ago

    World of Warcraft would benefit from this. Local processing power is quite up to the task these days, and it’s jarring to see your name on the screen but the audio says “champion” or something similar.

    Maybe in 11.0…

  • permalink
  • fedilink
  • source
  • parent
  • [–] 18 points 2 years ago (2 children)

    Star field does this and it caught me complete off guard became I had used my real name.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 21 points 2 years ago (2 children)

    Fallout 4 did as well, but it worked with a list of names that Codsworth could say. I'm assuming Starfield does something similar? Or is it a ton of NPCs that use the name?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 13 points 2 years ago (2 children)

    Idk I didn't pick a name, I just entered my name for my character. Then I was playing and Vasco just said my name. I literally stopped in my tracks and was like "what did you just say?"

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 7 points 2 years ago (1 child)

    To be fair, Vasco is a robot with a robotic / computer generated sounding voice. It's still cool, but it wouldn't take modern AI / neural network based processing to do that, any old text to speech engine could reproduce Vasco's voice.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 3 points 2 years ago (2 children)

    I thought they actually just recorded a ton of names for Fallout 4? I seem to recall hearing that they did something like 900+ different name recordings.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 9 points 2 years ago

    They did the same thing. Probably using the same list with additions. Both games have a robot be the only character who says your name. I suppose that makes it less unbelievable if you notice the splices where they add your name to an otherwise unaltered line.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 6 points 2 years ago (1 child)

    I like the idea a lot. I can think of two problems that need to be solved for this:

    1. How do you pronounce the player’s name correctly?
    2. How do you prohibit abuse?
  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 13 points 2 years ago (1 child)
    1. Have them type it a second time phonetically, and let them test it
    2. If single-player? Don't. If multiplayer? Yeah... that'd be a nightmare lmao
  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 5 points 2 years ago (1 child)

    Multiplayer doesn't make a difference, at least not noticeably, as all those shenanigans can already be done by text. You'll get reported and named "player345133" whether you misspell e.g. a forbidden slur or use a misspelling to get the slur's pronunciation.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 2 years ago

    But it's harder to detect spoken slang when people make it talk in mixed accents and more, you would have to run a talk to text engine too many different times with different filters and parameters against many different languages' lists of slang words with multiple recognizable pronunciations.

    And then somebody names themselves ChatGPT and the French will laugh because that sounds like "cat farted" in their language

  • permalink
  • fedilink
  • source
  • parent
  • [+] 4 points 2 years ago* (last edited 4 months ago) (1 child)
    [deleted]
  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 8 points 2 years ago (2 children)

    Starfield does this to some degree: https://www.rockpapershotgun.com/starfield-names-list

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 5 points 2 years ago (1 child)

    It does it if you have an anglo-sounding name, which is the problem with brute forcing this.

    Generative AI would be a fun solution, but it currently seems like it'd trigger a lot of controversy, sadly.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 2 years ago (1 child)

    I use a piece of software called crew chief for sim racing, and it has what seems like infinite names for all different languages and regions.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 2 years ago

    I don't use that, but from what I see it seems to have a drop-down for name selection, just like any other instance of this. Certainly not "infinite names". A quick Google even shows a forum thread in their official forums to request specific names to be added.

    So good for them on crowdsourcing the name list, I suppose, but for games that have a set release instead of being an ongoing, live database service the lists tend to be very limited and more often than not anglocentric. Even in sports games like NBA or FIFA where they just let you pick any existing name in the commentary database.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 3 points 2 years ago

    I look forward to the expansion from this, even. Real dialogue between the players and the game. Writers and designers set parameters for each character, backstory, motives, personality, current goals, etc. And then instead of a simple 4-5 choices of pre-canned dialog, with pre-canned responses, the player can type (or even say) whatever they want, and the game can return a customized response appropriate for the character.

  • permalink
  • fedilink
  • source
  • parent