▲ 17 ▼ LLMs can unmask anonymous internet users for $1–4 each, matching 67% of pseudonymous Hacker News accounts to real LinkedIn profiles at 90% precision (arstechnica.com) submitted 5 months ago by Innerworld@lemmy.world to c/privacy@programming.dev 14 comments fedilink hide all child comments
[–] RickyRigatoni@piefed.zip 8 points 5 months ago (4 children) What does 67% at 90% precision mean permalink fedilink source hideshow 8 child comments replies: [–] Innerworld@lemmy.world [S] 10 points 5 months ago (1 child) six seven permalink fedilink source parent hideshow 2 child comments replies: [–] RickyRigatoni@piefed.zip 9 points 5 months ago permalink fedilink source parent [–] lasta@piefed.world 3 points 5 months ago* (last edited 5 months ago) Recall—that is, how many users were successfully deanonymized—was as high as 68 percent. Precision—meaning the rate of guesses that correctly identify the user—was up to 90 percent. I take that to mean there is a 90% match between anonymized posts and real life profiles for 68% of users and that it’s a minimum confidence level needed for a user to be considered deanonymized. permalink fedilink source parent [–] LodeMike@lemmy.today 2 points 5 months ago 67% made a match. 90% of matches were right. No idea how they got that number, though. permalink fedilink source parent [–] MadhuGururajan@programming.dev 2 points 5 months ago Precision: ratio of true positives to total predicted positives. Recall: ratio of true positives to actual positives permalink fedilink source parent
[–] Innerworld@lemmy.world [S] 10 points 5 months ago (1 child) six seven permalink fedilink source parent hideshow 2 child comments replies: [–] RickyRigatoni@piefed.zip 9 points 5 months ago permalink fedilink source parent
[–] lasta@piefed.world 3 points 5 months ago* (last edited 5 months ago) Recall—that is, how many users were successfully deanonymized—was as high as 68 percent. Precision—meaning the rate of guesses that correctly identify the user—was up to 90 percent. I take that to mean there is a 90% match between anonymized posts and real life profiles for 68% of users and that it’s a minimum confidence level needed for a user to be considered deanonymized. permalink fedilink source parent
[–] LodeMike@lemmy.today 2 points 5 months ago 67% made a match. 90% of matches were right. No idea how they got that number, though. permalink fedilink source parent
[–] MadhuGururajan@programming.dev 2 points 5 months ago Precision: ratio of true positives to total predicted positives. Recall: ratio of true positives to actual positives permalink fedilink source parent