this post was submitted on 19 Oct 2024
103 points (88.1% liked)

Asklemmy

43965 readers
1487 users here now

A loosely moderated place to ask open-ended questions

Search asklemmy ๐Ÿ”

If your post meets the following criteria, it's welcome here!

  1. Open-ended question
  2. Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
  3. Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
  4. Not ad nauseam inducing: please make sure it is a question that would be new to most members
  5. An actual topic of discussion

Looking for support?

Looking for a community?

~Icon~ ~by~ ~@Double_[email protected]~

founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[โ€“] [email protected] 1 points 1 month ago (1 children)

My point is that if we turn up our gibberish dial now then at least our llms will be learning the wrong thing & we have some control.

There is still a lot of understanding that we do automatically that an llm will never do. I still 4eckon I can spot gibberish better than an llm & I would like to keep it that way

Or we just give up. As you can see I have mostly given up.

[โ€“] [email protected] 1 points 1 month ago (1 children)

My point is that if we turn up our gibberish dial now then at least our llms will be learning the wrong thing & we have some control.

We'd be covering ourselves in poop to prevent people from sitting next to us on the train. Sure, people will avoid sitting next to us, but in the meantime we'll be covered in poop.

And then other people will learn the trick, cover themselves in poop too, and now everyone's poopy and the trick stops working.

There is still a lot of understanding that we do automatically that an llm will never do.

Are you willing to bet the convenience of comprehensible online discourse on that? "Automatically understanding stuff" is basically the one job of LLMs.

LLMs model language, and coming up with some kind of "gibberish" filter is simply inventing a new language. If there's semantic meaning in it the LLMs will figure it out just like any other language, and if there isn't semantic meaning then we've lost the ability to communicate entirely. I see no upside.

[โ€“] [email protected] 1 points 1 month ago (1 children)

Sigh

I think the point of gibberish is that it is not language.

Thats why imagination and creativity is required - no?

I feel like I'm talking to an llm right now. too many words.

[โ€“] [email protected] 1 points 1 month ago

If it's not communicating anything, what's the point?