Honestly, the cost of LLMs are simply too high for me to stomach. I would never use them, no matter how much they are shoved onto my face.
Would you use a local open source LLM? (Assuming you have, or have the ability to acquire, a GPU or 2)
Most likely no. I haven't found them all that useful, tbh. Maybe I am just broken, but it really makes me wonder how people like it so much.
I find some utility in them, they're VERY far from the end all be all tool that AI bros hype.
I used it heavily to generate more cover letters for a recent job hunt than Ive ever done in my life and that's in addition to generating pretty much all of my written communication. So it was of great help there to help me mass apply to shit (without using one of those dumb AI applying services (tried like 2 of em, utter dog shit lmao))
Just yesterday I used my local LLM to process a pic I snapped of a handwritten birthday invite one of my kids got and it was inserted into my calendar accurately. Is GenAI 100%, no, but it's more accurate than the previous solution for something like that I think.
Any hints?
Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!
Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.
Hope you enjoy the instance!
Rules
Follow the wormhole through a path of communities !webdev@programming.dev