you are viewing a single comment's thread
view the rest of the comments
[–] 47 points 4 months ago (23 children)
  • [–] 22 points 4 months ago (17 children)

    Properly prompting an LLM is not something most people inherently get.

  • source
  • parent
  • hideshow 17 child comments
  • [–] 15 points 4 months ago (1 child)

    I haven't used an LLM, but it's probably similar to how people could not Google for shit. I always considered myself something of an expert at using search engines, although they've gone to shit obviously, and with the advent of AI it seems like they will fade out.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 11 points 4 months ago (3 children)

    I don't know, it seems to me that most people know how to ask a question or make a request. It's not that different. It's just that a lot of people don't understand what is possible and they freeze.

    You tell them, to ask for anything you want. They uncork and say "So I can ask it for a chocolate cream pie?". Partially in jest, but they do that because they don't seem to have a comfortable knowledge of the limits. A person with little technical background has no need for output that they don't understand. Once you guide them a little and let them know they can get a recipe for a chocolate cream pie and some practical advice on how to make it, that might be helpful, but little better than just looking up a recipe. You'd have to let them know that they can find multiple variants of recipes and have it rank them, compare them, and produce a summary of the most popular types. By now they've stopped listening and have gone to the grocery store to buy a chocolate cream pie and you're standing there hoping they will give you a piece.

    In summary, I wish I had some pie. What was the question?

  • source
  • parent
  • hideshow 3 child comments
  • [–] -4 points 4 months ago (2 children)

    I don't know, it seems to me that most people know how to ask a question or make a request. It's not that different.

    You don't actually use AI in any professional capacity, huh

  • source
  • parent
  • hideshow 2 child comments
  • [–] 9 points 4 months ago (7 children)

    "Properly prompting" is to not prompt. A chat interface is the lowest fidelity interface to use with an LLM.

  • source
  • parent
  • hideshow 7 child comments
  • [–] 2 points 4 months ago (6 children)

    Tell me more? It's the only way I'm familiar with interacting with an LLM

  • source
  • parent
  • hideshow 6 child comments
  • [–] 2 points 4 months ago (5 children)

    Examples to consider:

    A code base with TODOs embedded will make fewer mistakes and spend less tokens than if you attempt to direct the LLM only with prompting.

    A file system gives an LLM more context than a flat file (or large prompt) with the same contents because a file system has a tree like structure and makes it less likely the LLM will ingest context it doesn't need and confuse it

    Lastly consider the efficacy of providing it tools vs using agent skills which is another form of prompting. Giving an LLM a deterministic feedback loop beats tweaking your prompts every time

  • source
  • parent
  • hideshow 5 child comments
  • [–] 4 points 4 months ago (4 children)

    Ok so i think i do all of these things and would just describe them as "other ways to prompt and LLM" - i think the nuance youre shooting for here is that using these methods you are "pre-preparing" the prompt - not thinking about it at prompt-time and thus likely to miss stuff.

    e.g. Feeding a TODO is just the same as copy-pasting that todo in as a prompt.

    Have I understood you correctly?

  • source
  • parent
  • hideshow 4 child comments
  • [–] 1 point 4 months ago* (3 children)

    No, it's not the same as copying and pasting the TODO into a prompt. Embedding the TODO in code instead of the prompt reduces tokens burned and increases accuracy because it's observing the TODO in context. Sure you can write more prompting to provide that context, but it still won't be as accurate. The less context you provide via prompting and instead provide more context through automatic deterministc feedback the better the results

  • source
  • parent
  • hideshow 3 child comments
  • [–] 2 points 4 months ago (2 children)

    Okay so now I think you're describing the behaviour I take for granted with the harness i.e. Claude Code.

    Having good repo readiness through a good agents/claude.md file + tests + docs means the LLM is able to read more files into its context.

    It never occurred to me that anyone would prompt in isolation of their repos but I guess thats exactly what it was like for me last year when I was just feeding ChatGPT prompts away from the repo.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 4 months ago (1 child)

    Yes, code harnesses help by providing deterministic feedback like with a language server and reduce the amount of prompting requirements. I guess I should have led with that example 😅

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 4 months ago

    Gotcha...I've always struggled to pick up the vocabulary around technical concepts - I guess ive just never prioritised it, and now this whole new field has materialised with a whole new vocabulary to go along with it! I get the tech. The words are my achilles heel.

  • source
  • parent
  • [–] 2 points 4 months ago (2 children)

    Ez pz. "Interpret this prompt in the proper manner"

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 4 months ago (1 child)

    That's almost correct, actually. One of the best things to do is to prompt it to ask you clarifying questions.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 4 months ago

    You should absolutely start every task in Plan mode (maybe that's cursor-specific) and iterate a few times before executing. Making sure a robust plan is in place before actually doing anything has reduced my failure rate to pretty-damn-near 0

  • source
  • parent
  • [+] -9 points 4 months ago (3 children)

    Ever see someone using Google and cringe? People who have experience getting AI to do what they want feel the same when they see normies writing their prompts.

  • source
  • parent
  • hideshow 3 child comments