236

...and I still don't get it. I paid for a month of Pro to try it out, and it is consistently and confidently producing subtly broken junk. I had tried doing this before in the past, but gave up because it didn't work well. I thought that maybe this time it would be far along enough to be useful.

The task was relatively simple, and it involved doing some 3d math. The solutions it generated were almost write every time, but critically broken in subtle ways, and any attempt to fix the problems would either introduce new bugs, or regress with old bugs.

I spent nearly the whole day yesterday going back and forth with it, and felt like I was in a mental fog. It wasn't until I had a full night's sleep and reviewed the chat log this morning until I realized how much I was going in circles. I tried prompting a bit more today, but stopped when it kept doing the same crap.

The worst part of this is that, through out all of this, Claude was confidently responding. When I said there was a bug, it would "fix" the bug, and provide a confident explanation of what was wrong... Except it was clearly bullshit because it didn't work.

I still want to keep an open mind. Is anyone having success with these tools? Is there a special way to prompt it? Would I get better results during certain hours of the day?

For reference, I used Opus 4.6 Extended.

you are viewing a single comment's thread
view the rest of the comments
[-] shaggy@beehaw.org 3 points 1 day ago

I've had an opposite experience. Here are some guidelines I follow:

  1. Setup a foundation of rules and knowledge for Claude to fall back on. I define expectations, common definitions, behaviors and anything else that's not project specific upfront.
  • in Claude.md I reference different domains of behavior, definitions, and rules (Claude has conventions for storing this type of stuff, so ask it to handle organizing information too)
  • create a top-level project definition: this defines what "knowledge" is. It allows you to build up what Claude knows later on as you work on your project. "Update knowledge", "add this to your knowledge", etc
  • create a top-level rule: all information in knowledge must have one source of truth. Whenever needed reference the original knowledge source instead of duplicating it. Now you can ask it to "review your knowledge", "audit and flag knowledge"
  1. explicitly explain everything, leave nothing ambiguous; explain like you're explaining the problem to a new developer who's not familiar with the plan or codebase at all. Don't ask it to write code right away. Ask it to write a plan/spec. Review the plan, make changes and discuss it until the plan is 100%. This plan can include implementation details if you're ok with that, but it's not necessary (sometimes I write a separate referenced file called implementation.md beside the plan and have the plan reference it.).
  • Your role as a developer is shifting from writing code, to writing specs, and reviewing code
  1. Once there is nothing left to describe, and no ambiguity in your plan, have it use your plan to write the code. This works amazingly well for me.

A benefit to this method is that there is less wasted effort on my part. If Claude writes the code wrong, I can trace the reason for the mistake to a gap in the plan. I can then update the plan, throw away the code (if I have to), and have Claude reimplement the code again.

Rinse and Repeat.


Keep knowledge, plans, and implementation details clearly separated (you can copy your latest successful knowledge files to new projects to get started on future projects even faster).

Keep the goals of each plan as small and granular as possible (easier the define plans). Knowledge, plans, and implementation details all get tracked in your repository just like your code does.


I'm a career developer, and have been writing code for over 20 years. I'm adding this bit because I understand how AI driven development can look like a threat to developers. Over this last year, I've had a shift in this thinking though. I can take what I've learned through my career and use it to inform writing successful specifications Claude can use to write effective code. Claude may not solve all of our coding problems, but if used effectively, it solves nearly everything you throw at it.

[-] RamenJunkie@midwest.social 1 points 21 hours ago

Yeah, I wonder sometimes if people who fail tonget usable code are

1- Asking it to do much at once.

2- Don't actually understand the problem or coding enough to ask it to do the right thing.

If you say, "Write a program that does X", it will most likely fail to give you what you want.

It works great if you break it down into parts.

Write a program that takes this databas input and converts it this way.

Now uodate it so the output gets displayed this way.

Adjust the colors.

Add the ability to save the output in this format.

This looks good but I need to swap these parts of the output and add this data to the output.

That sort of iterative, step by step process. Or even just, when there are bugs, give it the error output, explain that X needs to be Y. Also, at some point you may need to also look at the code. I had an issue where it was running twice on some data and after looking at it I realized it was processing things as images and links, because the links had images (but images did not always have links). I explained this problem, and pointed to where it was and it fixed it.

[-] f3nyx@lemmy.ml 0 points 23 hours ago

hey shaggy. I want to touch on your last point as a newer developer:

My department is finally seeing 10x development due to the shift of writing code to writing spec. The main issue is now our pipeline is stuck at review, so all that extra output is effectively wasted. Do you have any tips on what worked for you if you had a similar situation?

[-] shaggy@beehaw.org 2 points 13 hours ago

This is our new bottleneck too. Developers roles are shifting to spec writers and code reviewers more and more. I don't think I'd call this wasted effort though (unless the code produced is worse than what developers would have produced otherwise). I'd think of it as a good problem to have.

We're doing several things to alleviate this, and I'm genuinely curious how other teams are handling this too.

  • We have Claude running code reviews on our PRs too ๐Ÿ˜„. In our department, a PR isn't expected to be reviewed by a dev until the author has addressed or reviewed and dismissed all of the issues Claude has brought up.
  • There is pressure for developers on our team to become better reviewers. I think this is good, because reviewing code is a more valuable skill to prospective employers than writing it is anyway.
[-] f3nyx@lemmy.ml 1 points 11 hours ago

thanks for the response. for what its worth, most people I ask this question to are attempting some form of your first bulletpoint. I think we're on the right track there, it only makes sense.

speaking for myself, your second point is the silver lining of all this, to me. ive never had this kind of pressure before, but I hope that its the kind of pressure that makes me a better dev instead of burning me out.

cheers!

[-] Senal@programming.dev 6 points 22 hours ago* (last edited 22 hours ago)

If you're stuck at review you aren't seeing 10x development, you're seeing 10x code generation.

This is especially important because without the review/test/deploy part of the pipeline you aren't actually seeing any progress towards business goals.

Once you do get these parts sorted, you can then look at what multiplier you're seeing.

That's not to say there isn't an improvement in your workflow, just that you can't say with any certainty what kind of improvement without measuring the end to end.

It might turn out that the rest of the pipeline is way easier , in which case your multiplier will be higher, it might also be much harder, in which case the multiplier will be lower.

I'm not taking shots, i mean it seriously, especially if you need to report any of this to the rest of the business.


edit : In addition, if it turns out that review is going to be a bottleneck you can get extra resource pointed in that direction which will benefit the workflow overall.

another edit: i would consider correctly managing the expectations of those you report to as a vital skill.

[-] Dangerhart@lemmy.zip 4 points 22 hours ago

Exactly this. My experience with our companies wrapper on Claude lines up with OP, not this comment thread.

Everyone seems to forget everything you write is a liability. You can't have bugs in code that is never written or generated, comments that don't exist never become inaccurate, not duplicating "knowledge" into a repo doesnt have a risk of not aligning with business goals long term as they change.

From what I've seen, people claiming a "10x increase" did not have a strong foundation to begin with and/or did not utilize tools like IDEs effectively. No offense to thread OP, which seems itself a generated response, but in the time he has done all of that a strong engineer would be long done. Everything listed should be done before ever getting into code along with business and product partners.

[-] zbyte64@awful.systems 1 points 18 hours ago

Everything listed should be done before ever getting into code along with business and product partners.

Ehh, it really depends on where the risk is and the problem is LLMs can't evaluate for that unless you feed it everything. Some projects need code experiments before you settle on an architecture, but that's only if you're a pioneer (which frankly is where the money is at).

[-] f3nyx@lemmy.ml 1 points 19 hours ago

that's a very good distinction, absolutely. its just code generation at this stage.

the review was the bottleneck before (as I believe was already the case for many companies) but now with 10x the code generated for review, the bottleneck has turned into a dripping faucet.

this post was submitted on 11 Apr 2026
236 points (90.4% liked)

Programming

26482 readers
287 users here now

Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!

Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.

Hope you enjoy the instance!

Rules

Rules

  • Follow the programming.dev instance rules
  • Keep content related to programming in some way
  • If you're posting long videos try to add in some form of tldr for those who don't want to watch videos

Wormhole

Follow the wormhole through a path of communities !webdev@programming.dev



founded 2 years ago
MODERATORS