falken

joined 8 months ago
[–] [email protected] 6 points 3 months ago (1 children)

@kuneho Meta is not inventing this out of the goodness of it's heart. Just like how Google privacy sandbox is a fruit of a poisoned tree, the idea should be treated with extreme caution. If not, well, the NSA have a great new encryption standard they'd love you to use too.

#paranoid

[–] [email protected] 9 points 3 months ago (5 children)

@Carighan @cerement personal data slurping has to be opt in the EU however. So not sure how #noyb etc will feel.

[–] [email protected] 3 points 8 months ago

@[email protected] @[email protected] local LLM execution times can be very fast on recent consumer hardware. No need to send anywhere, just like their translation - do it all on-device.
As an example, with no optimization or GPU support, my @[email protected] (AMD) generates around 5 characters/sec from a 4 gigabyte pre-quantized model.