745
submitted 3 weeks ago by [email protected] to c/[email protected]
you are viewing a single comment's thread
view the rest of the comments
[-] [email protected] -5 points 3 weeks ago

Apparently it's useful for extraction of information out of a text to a format you specify. A Friend is using it to extract transactions out of 500 year old texts. However to get rid of hallucinations the temperature reds to be 0. So the only way is to self host.

[-] [email protected] 13 points 3 weeks ago

Setting the temperature to 0 doesn't get rid of hallucinations.

It might slightly increase accuracy, but it's still going to go wrong.

[-] [email protected] 10 points 3 weeks ago

Well, LLMs are capable (but hallucinant) and cost an absolute fuckton of energy. There have been purpose trained efficient ML models that we've used for years. Document Understanding and Computer Vision are great, just don't use a LLM for them.

this post was submitted on 07 May 2025
745 points (100.0% liked)

TechTakes

1880 readers
104 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 2 years ago
MODERATORS