▲ 237 ▼ Little Bobby Tables has a baby sister. Meet Sally Ignore Previous Instructions. (www.haihai.ai) submitted 2 years ago by snaggen@programming.dev to c/programming@programming.dev 22 comments fedilink hide all child comments
[–] glibg10b@lemmy.ml 16 points 2 years ago (2 children) Right. I don't know how the hell someone managed to reveal their OpenAI key to the LLM itself permalink fedilink source parent hideshow 4 child comments replies: [–] gaylord_fartmaster@lemmy.world 18 points 2 years ago (1 child) I don't think it gave him the openAI key, he just had the ability to send as many hijacked (not game related) prompts as he wanted through the game on the devs' dime. permalink fedilink source parent hideshow 2 child comments replies: [–] computergeek125@lemmy.world 0 points 2 years ago (1 child) Which, now given the ability to inject arbitrary code, you could conceivably now write code to list every variable it had access to. permalink fedilink source parent hideshow 2 child comments replies: [–] gaylord_fartmaster@lemmy.world 2 points 2 years ago The text prompt in the game might also be vulnerable to arbitrary code injection, but that wouldn't really have anything to do with the prompt injection being used here. Everything being done is within the confines of chatGPT which wouldn't need or have access to any of the game's code. permalink fedilink source parent [–] DudeDudenson@lemmings.world 7 points 2 years ago* (last edited 2 years ago) They didn't. The point was that the guy could use their implementation freely as if he was paying for a chat gpt license. Basically he made the ai let him run any query he wanted trough it so he just has unlimited access to the paid version of chat gpt at the company's expense permalink fedilink source parent
[–] gaylord_fartmaster@lemmy.world 18 points 2 years ago (1 child) I don't think it gave him the openAI key, he just had the ability to send as many hijacked (not game related) prompts as he wanted through the game on the devs' dime. permalink fedilink source parent hideshow 2 child comments replies: [–] computergeek125@lemmy.world 0 points 2 years ago (1 child) Which, now given the ability to inject arbitrary code, you could conceivably now write code to list every variable it had access to. permalink fedilink source parent hideshow 2 child comments replies: [–] gaylord_fartmaster@lemmy.world 2 points 2 years ago The text prompt in the game might also be vulnerable to arbitrary code injection, but that wouldn't really have anything to do with the prompt injection being used here. Everything being done is within the confines of chatGPT which wouldn't need or have access to any of the game's code. permalink fedilink source parent
[–] computergeek125@lemmy.world 0 points 2 years ago (1 child) Which, now given the ability to inject arbitrary code, you could conceivably now write code to list every variable it had access to. permalink fedilink source parent hideshow 2 child comments replies: [–] gaylord_fartmaster@lemmy.world 2 points 2 years ago The text prompt in the game might also be vulnerable to arbitrary code injection, but that wouldn't really have anything to do with the prompt injection being used here. Everything being done is within the confines of chatGPT which wouldn't need or have access to any of the game's code. permalink fedilink source parent
[–] gaylord_fartmaster@lemmy.world 2 points 2 years ago The text prompt in the game might also be vulnerable to arbitrary code injection, but that wouldn't really have anything to do with the prompt injection being used here. Everything being done is within the confines of chatGPT which wouldn't need or have access to any of the game's code. permalink fedilink source parent
[–] DudeDudenson@lemmings.world 7 points 2 years ago* (last edited 2 years ago) They didn't. The point was that the guy could use their implementation freely as if he was paying for a chat gpt license. Basically he made the ai let him run any query he wanted trough it so he just has unlimited access to the paid version of chat gpt at the company's expense permalink fedilink source parent