โฒ 823 โผ Not Total Recall (1990) (lemmy.world) submitted 2 years ago* by ordellrb@lemmy.world to c/linuxmemes@lemmy.world 64 comments fedilink hide all child comments
[โ] JackGreenEarth@lemm.ee 20 points 2 years ago (3 children) What does that command do? permalink fedilink source hideshow 6 child comments replies: [โ] hitwright@lemmy.world 58 points 2 years ago* (1 child) Takes a screenshot every minute and saves it permalink fedilink source parent hideshow 2 child comments replies: [โ] JackGreenEarth@lemm.ee 7 points 2 years ago (3 children) Can you search the screenshots with OCR though? That's Recall's main selling point permalink fedilink source parent hideshow 6 child comments replies: [โ] Aux@lemmy.world 59 points 2 years ago (3 children) You can start by running sudo apt install tesseract-ocr and then reading its docs. permalink fedilink source parent hideshow 6 child comments replies: [โ] Morphit@feddit.uk 29 points 2 years ago Fulfills the AI quota ๐ permalink fedilink source parent [โ] MacNCheezus@lemmy.today 4 points 2 years ago* (last edited 2 years ago) (1 child) It appears to be as simple as tesseract <infile> <outfile>. Possibly could even pipe (or tee) the screenshot straight into that and save both an image and a text file in a single command line. So something like this should do the trick: gnome-screenshot -f - | tee /Microsoft/yourPrivacy/$(date +%s).png | tesseract - /Microsoft/yourPrivacy/$(date +%s).txt Skip the database, just use grep to search that directory if you need to find anything. Voilร , homemade Recall. permalink fedilink source parent hideshow 2 child comments replies: [โ] Aux@lemmy.world 1 point 2 years ago (1 child) It is much better to search using ElasticSearch or Sphinx. Grep is super slow, non indexed and can't do natural language full text searches. It's pretty much useless for any real world text search you'd want from OCRed content. And all these better tools are free and open source, so really a no brainer. permalink fedilink source parent hideshow 2 child comments replies: [โ] MacNCheezus@lemmy.today 1 point 2 years ago Iโm sure there are many ways to improve on this solution, but they would all require significantly more effort (ElasticSearch isnโt exactly trivial to set up). This is really just a proof of concept, the most minimal viable implementation that gets you something similar in terms of functionality. For instance, Windows Recall stores OCR content tagged by app, this solution doesnโt. Also, as others have mentioned, a practical implementation should likely check if anything has changed at all and discard any screenshots that donโt have any new data. permalink fedilink source parent [+] MacNCheezus@lemmy.today 1 point 2 years ago [deleted] permalink fedilink source parent [โ] R00bot@lemmy.blahaj.zone 21 points 2 years ago (3 children) I can't imagine it'd be that hard to write some code that does that using an existing AI model. permalink fedilink source parent hideshow 6 child comments replies: [โ] not_amm@lemmy.ml 9 points 2 years ago I found a small command to run KDE Spectacle (screenshot software) with Tesseract so I can OCR a screenshot if I want to, I only had to install Tesseract and a main language, you could easily do the same with an API and/or a local AI. permalink fedilink source parent [โ] JackGreenEarth@lemm.ee 5 points 2 years ago You're probably right. permalink fedilink source parent [โ] MacNCheezus@lemmy.today 3 points 2 years ago Llava and Bakllava are two Ollama models than can not only extract text but also describe what's happening on screen. Using tesseract-ocr, as the other guy suggested, is probably simpler and less resource intensive though. permalink fedilink source parent [โ] JackbyDev@programming.dev 8 points 2 years ago This is a shitpost and not a real suggestion. permalink fedilink source parent [โ] DmMacniel@feddit.de 27 points 2 years ago* its a cronjob that runs each minute (*/1) in any hour, any day, any month, on any weekday, gnome-screenshot obviously takes a screenshot and outputs it to the given file path and filename, where the filename is written as the current date as string and .png as format permalink fedilink source parent [โ] DaPorkchop_@lemmy.ml 10 points 2 years ago It's a crontab entry which, once a minute, uses the gnome-screenshot program to take a screenshot of your monitor and save it to /Microsoft/yourPrivacy. permalink fedilink source parent
[โ] hitwright@lemmy.world 58 points 2 years ago* (1 child) Takes a screenshot every minute and saves it permalink fedilink source parent hideshow 2 child comments replies: [โ] JackGreenEarth@lemm.ee 7 points 2 years ago (3 children) Can you search the screenshots with OCR though? That's Recall's main selling point permalink fedilink source parent hideshow 6 child comments replies: [โ] Aux@lemmy.world 59 points 2 years ago (3 children) You can start by running sudo apt install tesseract-ocr and then reading its docs. permalink fedilink source parent hideshow 6 child comments replies: [โ] Morphit@feddit.uk 29 points 2 years ago Fulfills the AI quota ๐ permalink fedilink source parent [โ] MacNCheezus@lemmy.today 4 points 2 years ago* (last edited 2 years ago) (1 child) It appears to be as simple as tesseract <infile> <outfile>. Possibly could even pipe (or tee) the screenshot straight into that and save both an image and a text file in a single command line. So something like this should do the trick: gnome-screenshot -f - | tee /Microsoft/yourPrivacy/$(date +%s).png | tesseract - /Microsoft/yourPrivacy/$(date +%s).txt Skip the database, just use grep to search that directory if you need to find anything. Voilร , homemade Recall. permalink fedilink source parent hideshow 2 child comments replies: [โ] Aux@lemmy.world 1 point 2 years ago (1 child) It is much better to search using ElasticSearch or Sphinx. Grep is super slow, non indexed and can't do natural language full text searches. It's pretty much useless for any real world text search you'd want from OCRed content. And all these better tools are free and open source, so really a no brainer. permalink fedilink source parent hideshow 2 child comments replies: [โ] MacNCheezus@lemmy.today 1 point 2 years ago Iโm sure there are many ways to improve on this solution, but they would all require significantly more effort (ElasticSearch isnโt exactly trivial to set up). This is really just a proof of concept, the most minimal viable implementation that gets you something similar in terms of functionality. For instance, Windows Recall stores OCR content tagged by app, this solution doesnโt. Also, as others have mentioned, a practical implementation should likely check if anything has changed at all and discard any screenshots that donโt have any new data. permalink fedilink source parent [+] MacNCheezus@lemmy.today 1 point 2 years ago [deleted] permalink fedilink source parent [โ] R00bot@lemmy.blahaj.zone 21 points 2 years ago (3 children) I can't imagine it'd be that hard to write some code that does that using an existing AI model. permalink fedilink source parent hideshow 6 child comments replies: [โ] not_amm@lemmy.ml 9 points 2 years ago I found a small command to run KDE Spectacle (screenshot software) with Tesseract so I can OCR a screenshot if I want to, I only had to install Tesseract and a main language, you could easily do the same with an API and/or a local AI. permalink fedilink source parent [โ] JackGreenEarth@lemm.ee 5 points 2 years ago You're probably right. permalink fedilink source parent [โ] MacNCheezus@lemmy.today 3 points 2 years ago Llava and Bakllava are two Ollama models than can not only extract text but also describe what's happening on screen. Using tesseract-ocr, as the other guy suggested, is probably simpler and less resource intensive though. permalink fedilink source parent [โ] JackbyDev@programming.dev 8 points 2 years ago This is a shitpost and not a real suggestion. permalink fedilink source parent
[โ] JackGreenEarth@lemm.ee 7 points 2 years ago (3 children) Can you search the screenshots with OCR though? That's Recall's main selling point permalink fedilink source parent hideshow 6 child comments replies: [โ] Aux@lemmy.world 59 points 2 years ago (3 children) You can start by running sudo apt install tesseract-ocr and then reading its docs. permalink fedilink source parent hideshow 6 child comments replies: [โ] Morphit@feddit.uk 29 points 2 years ago Fulfills the AI quota ๐ permalink fedilink source parent [โ] MacNCheezus@lemmy.today 4 points 2 years ago* (last edited 2 years ago) (1 child) It appears to be as simple as tesseract <infile> <outfile>. Possibly could even pipe (or tee) the screenshot straight into that and save both an image and a text file in a single command line. So something like this should do the trick: gnome-screenshot -f - | tee /Microsoft/yourPrivacy/$(date +%s).png | tesseract - /Microsoft/yourPrivacy/$(date +%s).txt Skip the database, just use grep to search that directory if you need to find anything. Voilร , homemade Recall. permalink fedilink source parent hideshow 2 child comments replies: [โ] Aux@lemmy.world 1 point 2 years ago (1 child) It is much better to search using ElasticSearch or Sphinx. Grep is super slow, non indexed and can't do natural language full text searches. It's pretty much useless for any real world text search you'd want from OCRed content. And all these better tools are free and open source, so really a no brainer. permalink fedilink source parent hideshow 2 child comments replies: [โ] MacNCheezus@lemmy.today 1 point 2 years ago Iโm sure there are many ways to improve on this solution, but they would all require significantly more effort (ElasticSearch isnโt exactly trivial to set up). This is really just a proof of concept, the most minimal viable implementation that gets you something similar in terms of functionality. For instance, Windows Recall stores OCR content tagged by app, this solution doesnโt. Also, as others have mentioned, a practical implementation should likely check if anything has changed at all and discard any screenshots that donโt have any new data. permalink fedilink source parent [+] MacNCheezus@lemmy.today 1 point 2 years ago [deleted] permalink fedilink source parent [โ] R00bot@lemmy.blahaj.zone 21 points 2 years ago (3 children) I can't imagine it'd be that hard to write some code that does that using an existing AI model. permalink fedilink source parent hideshow 6 child comments replies: [โ] not_amm@lemmy.ml 9 points 2 years ago I found a small command to run KDE Spectacle (screenshot software) with Tesseract so I can OCR a screenshot if I want to, I only had to install Tesseract and a main language, you could easily do the same with an API and/or a local AI. permalink fedilink source parent [โ] JackGreenEarth@lemm.ee 5 points 2 years ago You're probably right. permalink fedilink source parent [โ] MacNCheezus@lemmy.today 3 points 2 years ago Llava and Bakllava are two Ollama models than can not only extract text but also describe what's happening on screen. Using tesseract-ocr, as the other guy suggested, is probably simpler and less resource intensive though. permalink fedilink source parent [โ] JackbyDev@programming.dev 8 points 2 years ago This is a shitpost and not a real suggestion. permalink fedilink source parent
[โ] Aux@lemmy.world 59 points 2 years ago (3 children) You can start by running sudo apt install tesseract-ocr and then reading its docs. permalink fedilink source parent hideshow 6 child comments replies: [โ] Morphit@feddit.uk 29 points 2 years ago Fulfills the AI quota ๐ permalink fedilink source parent [โ] MacNCheezus@lemmy.today 4 points 2 years ago* (last edited 2 years ago) (1 child) It appears to be as simple as tesseract <infile> <outfile>. Possibly could even pipe (or tee) the screenshot straight into that and save both an image and a text file in a single command line. So something like this should do the trick: gnome-screenshot -f - | tee /Microsoft/yourPrivacy/$(date +%s).png | tesseract - /Microsoft/yourPrivacy/$(date +%s).txt Skip the database, just use grep to search that directory if you need to find anything. Voilร , homemade Recall. permalink fedilink source parent hideshow 2 child comments replies: [โ] Aux@lemmy.world 1 point 2 years ago (1 child) It is much better to search using ElasticSearch or Sphinx. Grep is super slow, non indexed and can't do natural language full text searches. It's pretty much useless for any real world text search you'd want from OCRed content. And all these better tools are free and open source, so really a no brainer. permalink fedilink source parent hideshow 2 child comments replies: [โ] MacNCheezus@lemmy.today 1 point 2 years ago Iโm sure there are many ways to improve on this solution, but they would all require significantly more effort (ElasticSearch isnโt exactly trivial to set up). This is really just a proof of concept, the most minimal viable implementation that gets you something similar in terms of functionality. For instance, Windows Recall stores OCR content tagged by app, this solution doesnโt. Also, as others have mentioned, a practical implementation should likely check if anything has changed at all and discard any screenshots that donโt have any new data. permalink fedilink source parent [+] MacNCheezus@lemmy.today 1 point 2 years ago [deleted] permalink fedilink source parent
[โ] Morphit@feddit.uk 29 points 2 years ago Fulfills the AI quota ๐ permalink fedilink source parent
[โ] MacNCheezus@lemmy.today 4 points 2 years ago* (last edited 2 years ago) (1 child) It appears to be as simple as tesseract <infile> <outfile>. Possibly could even pipe (or tee) the screenshot straight into that and save both an image and a text file in a single command line. So something like this should do the trick: gnome-screenshot -f - | tee /Microsoft/yourPrivacy/$(date +%s).png | tesseract - /Microsoft/yourPrivacy/$(date +%s).txt Skip the database, just use grep to search that directory if you need to find anything. Voilร , homemade Recall. permalink fedilink source parent hideshow 2 child comments replies: [โ] Aux@lemmy.world 1 point 2 years ago (1 child) It is much better to search using ElasticSearch or Sphinx. Grep is super slow, non indexed and can't do natural language full text searches. It's pretty much useless for any real world text search you'd want from OCRed content. And all these better tools are free and open source, so really a no brainer. permalink fedilink source parent hideshow 2 child comments replies: [โ] MacNCheezus@lemmy.today 1 point 2 years ago Iโm sure there are many ways to improve on this solution, but they would all require significantly more effort (ElasticSearch isnโt exactly trivial to set up). This is really just a proof of concept, the most minimal viable implementation that gets you something similar in terms of functionality. For instance, Windows Recall stores OCR content tagged by app, this solution doesnโt. Also, as others have mentioned, a practical implementation should likely check if anything has changed at all and discard any screenshots that donโt have any new data. permalink fedilink source parent
[โ] Aux@lemmy.world 1 point 2 years ago (1 child) It is much better to search using ElasticSearch or Sphinx. Grep is super slow, non indexed and can't do natural language full text searches. It's pretty much useless for any real world text search you'd want from OCRed content. And all these better tools are free and open source, so really a no brainer. permalink fedilink source parent hideshow 2 child comments replies: [โ] MacNCheezus@lemmy.today 1 point 2 years ago Iโm sure there are many ways to improve on this solution, but they would all require significantly more effort (ElasticSearch isnโt exactly trivial to set up). This is really just a proof of concept, the most minimal viable implementation that gets you something similar in terms of functionality. For instance, Windows Recall stores OCR content tagged by app, this solution doesnโt. Also, as others have mentioned, a practical implementation should likely check if anything has changed at all and discard any screenshots that donโt have any new data. permalink fedilink source parent
[โ] MacNCheezus@lemmy.today 1 point 2 years ago Iโm sure there are many ways to improve on this solution, but they would all require significantly more effort (ElasticSearch isnโt exactly trivial to set up). This is really just a proof of concept, the most minimal viable implementation that gets you something similar in terms of functionality. For instance, Windows Recall stores OCR content tagged by app, this solution doesnโt. Also, as others have mentioned, a practical implementation should likely check if anything has changed at all and discard any screenshots that donโt have any new data. permalink fedilink source parent
[โ] R00bot@lemmy.blahaj.zone 21 points 2 years ago (3 children) I can't imagine it'd be that hard to write some code that does that using an existing AI model. permalink fedilink source parent hideshow 6 child comments replies: [โ] not_amm@lemmy.ml 9 points 2 years ago I found a small command to run KDE Spectacle (screenshot software) with Tesseract so I can OCR a screenshot if I want to, I only had to install Tesseract and a main language, you could easily do the same with an API and/or a local AI. permalink fedilink source parent [โ] JackGreenEarth@lemm.ee 5 points 2 years ago You're probably right. permalink fedilink source parent [โ] MacNCheezus@lemmy.today 3 points 2 years ago Llava and Bakllava are two Ollama models than can not only extract text but also describe what's happening on screen. Using tesseract-ocr, as the other guy suggested, is probably simpler and less resource intensive though. permalink fedilink source parent
[โ] not_amm@lemmy.ml 9 points 2 years ago I found a small command to run KDE Spectacle (screenshot software) with Tesseract so I can OCR a screenshot if I want to, I only had to install Tesseract and a main language, you could easily do the same with an API and/or a local AI. permalink fedilink source parent
[โ] JackGreenEarth@lemm.ee 5 points 2 years ago You're probably right. permalink fedilink source parent
[โ] MacNCheezus@lemmy.today 3 points 2 years ago Llava and Bakllava are two Ollama models than can not only extract text but also describe what's happening on screen. Using tesseract-ocr, as the other guy suggested, is probably simpler and less resource intensive though. permalink fedilink source parent
[โ] JackbyDev@programming.dev 8 points 2 years ago This is a shitpost and not a real suggestion. permalink fedilink source parent
[โ] DmMacniel@feddit.de 27 points 2 years ago* its a cronjob that runs each minute (*/1) in any hour, any day, any month, on any weekday, gnome-screenshot obviously takes a screenshot and outputs it to the given file path and filename, where the filename is written as the current date as string and .png as format permalink fedilink source parent
[โ] DaPorkchop_@lemmy.ml 10 points 2 years ago It's a crontab entry which, once a minute, uses the gnome-screenshot program to take a screenshot of your monitor and save it to /Microsoft/yourPrivacy. permalink fedilink source parent
