BradleyUffner comments on Experienced software developers assumed AI would save them a chunk of time. But in one experiment, their tasks took 20% longer

[–] BradleyUffner@lemmy.world 25 points 9 months ago* (last edited 9 months ago) (22 children)

Unless you are retraining the model locally at your 23 acre data center in your garage after every interaction, it's still not learning anything. You are just dumping more data in to its temporary context.

permalink

fedilink

source

parent

hideshow 22 child comments

[+] plantfanatic@sh.itjust.works -10 points 9 months ago* (15 children)

What part of customize did you not understand?

And lots fit on personal computers dude, do you even know what different llms there are…?

One for programming doesn’t need all the fluff of books and art, so now it’s a manageable size. Llms are customizable to any degree, use your own data library for the context data even!

permalink

fedilink

source

parent

hideshow 15 child comments

[–] BradleyUffner@lemmy.world 11 points 9 months ago* (14 children)

What part about how LLMs actually work do you not understand?

"Customizing" is just dumping more data in to it's context. You can't actually change the root behavior of an LLM without rebuilding it's model.

permalink

fedilink

source

parent

hideshow 14 child comments

[+] plantfanatic@sh.itjust.works -6 points 9 months ago* (11 children)

"Customizing" is just dumping more data in to it's context.

Yes, which would fix the incorrect coding issues. It’s not an llm issue, it’s too much data. Or remove the context causing that issue. These require a little legwork and knowledge to make useful. Like anything else.

You really don’t know how these work do you?

permalink

fedilink

source

parent

hideshow 11 child comments

[–] BradleyUffner@lemmy.world 8 points 9 months ago* (last edited 9 months ago) (4 children)

You do understand that the model weights and the context are not the same thing right? They operate completely differently and have different purposes.

Trying to change the model's behavior using instructions in the context is going to fail. That's like trying to change how a word processor works by typing in to the document. Sure, you can kind of get the formatting you want if you manhandle the data, but you haven't changed how the application works.

permalink

fedilink

source

parent

hideshow 4 child comments

[–] SchmidtGenetics@lemmy.world -2 points 9 months ago (3 children)

Why are you so focused on just the training? The data is ALSO the issue.

Of course if you ignore one fix, that works, of course you can only cry it’s not fixable.

But it is.

permalink

fedilink

source

parent

hideshow 3 child comments

[–] BradleyUffner@lemmy.world 7 points 9 months ago* (2 children)

Why are you so focused on just the training?

Because I work with LLMs daily. I understand how they work. No matter how much I type at an LLM, its behavior will never fundamentally change without regenerating the model. It never learns anything from the content of the context.

The model is the LLM. The context is the document of a word processor.

A Jr developer will actually learn and grow in to a Sr developer and will retain that knowledge as they move from job to job. That is fundamentally different from how an LLM works.

I'm not anti-AI. I'm not "crying" about their issues. I'm just discussing the from a practical standpoint.

LLMs do not learn.

permalink

fedilink

source

parent

hideshow 2 child comments

[+] SchmidtGenetics@lemmy.world -6 points 9 months ago* (1 child)

Because I work with LLMs daily. I understand how they work.

Clearly you don’t, because context data modifies how the training data extrapolates.

You can use something, while not being educated on how to use it. And just using something does not mean you understand how they work. Your comments have made it QUITE clear that you have no idea.

People who just whing about AI and pretend they know how they work are the worst kind of people right now.

permalink

fedilink

source

parent

hideshow 1 child comment

[–] BradleyUffner@lemmy.world 7 points 9 months ago*

Your comments have made it QUITE clear that you have no idea.

Odd, I can say the exact same thing about your comments on the subject.

We are clearly at an impasse that won't be solved through this discussion.

permalink

fedilink

source

parent

[–] tja@sh.itjust.works 7 points 9 months ago (5 children)

But

All the fluff from books and art

Is not inside the context, that comes from training. So you know how an llm works?

permalink

fedilink

source

parent

hideshow 5 child comments

[+] SchmidtGenetics@lemmy.world -7 points 9 months ago* (4 children)

Where do you think the errors are coming from? From data bleed over, the word “coding” shows up in books, so yes the context would incorrectly pull book data too.

Or do you not realize coding books exist as well…? And would be in the dataset.

permalink

fedilink

source

parent

hideshow 4 child comments

[–] tja@sh.itjust.works 3 points 9 months ago (3 children)

Why would you put whole books into the context?!? Do you even know what an llm is?

permalink

fedilink

source

parent

hideshow 3 child comments

[+] SchmidtGenetics@lemmy.world -6 points 9 months ago* (2 children)

Because that’s how they work…? It’s not an actual physical book… you don’t seriously think this do you…? it’s the text data inside, like any other text file it would use for context.

Where do you think it gets its data from…?

permalink

fedilink

source

parent

hideshow 2 child comments

[–] tja@sh.itjust.works 4 points 9 months ago (1 child)

From the training.

I will stop now replying to, because you clearly need to learn more about llms.

Here, have a fish 🐟

permalink

fedilink

source

parent

hideshow 1 child comment

[–] SchmidtGenetics@lemmy.world -4 points 9 months ago

So you use a programming llm instead of a generic one….

Or do you think all llms and ai are the same?

permalink

fedilink

source

parent

[+] SchmidtGenetics@lemmy.world -8 points 9 months ago* (1 child)

If it’s constantly making an error, fix the context data dude. What about it an llm/ai makes you think this isn’t possible…? Lmfao, you just want to bitch about ai, not comprehend how they work.

permalink

fedilink

source

parent

hideshow 1 child comment

[+] Eheran@lemmy.world -7 points 9 months ago

This is Lemmy, bitching about AI is the norm.

permalink

fedilink

source

parent