2
Can't seem to execute commands with local models (programming.dev)
submitted 1 week ago by to c/opencode@programming.dev
6 comments fedilink hide all child comments
 

I was curious about opencode and tried to run it with mistral:7b as well as qwencode3:8b, but it simply couldn't execute a single command.

It was necessary, I think, to be able to execute commands because it kept attempting to write to /home/user. So I told it to run pwd to find out where it was. That always failed.

Was j using a wrong model? Or is opencode just incapable of running commands?

you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 1 week ago (1 child)

Those sound like old models which doesnt help. Generally the best model in my experience is qwen3.6-27b. Ornith 9b is the smallest model ive used that is decent at tool use.

The attempting to write to the wrong folder can be helped by denying a permission in your config. Dont have it off the top of my head.

  • permalink
  • fedilink
  • source
  • hideshow 2 child comments
    •
  • [–] [S] 1 point 1 week ago (2 children)

    I only have 8GB VRAM. So I'm limited, hence those smaller models.

    What do you mean by deny a permission? Shouldn't it be allowing a permission? I didn't even know there were permissions beyond read write

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 2 points 1 week ago (2 children)

    Older models may not know how to tool call which is required for read/write access, in general stay with models released this year.

    Qwen3.6-35B-A3B works well for 24GB RAM + 8GB VRAM (I run it on 32+8 via llama.cpp).

    Regarding permissions, opencode should have default write permissions by default to current folder and will ask for permission for read/write to external folders (such as /tmp) only when needed.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 1 point 1 week ago

    A quick test to make sure opencode is working fine, first make sure you're in Build mode by pressing TAB until you see Build. Then prompt:

    Write today's date/time to `today.md`

    if it fails to run date then writing today.md correctly in current directory, then the model is most likely not able to do tool calling.

  • permalink
  • fedilink
  • source
  • parent