8
submitted 1 day ago* (last edited 1 day ago) by [email protected] to c/[email protected]

I'm currently running my Immich server on a mini PC with proxmox

It's got 3x N97 CPU cores available to it and 7gb of ram It's using the default ViT-B-32__openai model, I was wondering if I can use a more powerful model, but I'm not sure which one or if I should enable hardware acceleration etc.

This is my yaml file

  immich-machine-learning:  
    container_name: immich_machine_learning  
    # For hardware acceleration, add one of -[armnn, cuda, rocm, openvino, rknn] to the image tag.  
    # Example tag: ${IMMICH_VERSION:-release}-cuda  
    image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION:-release}  
    # extends: # uncomment this section for hardware acceleration - see https://immich.app/docs/features/ml-hardware-acceleration  
    #   file: hwaccel.ml.yml  
    #   service: cpu # set to one of [armnn, cuda, rocm, openvino, openvino-wsl, rknn] for accelerated inference - use the `-wsl` version for WSL2 where applicable  
    volumes:  
      - immich-model-cache:/cache  
    env_file:  
      - stack.env  
    restart: always  
    healthcheck:  
      disable: false  

I looked at the docs but it's a bit confusing so that's why I'm here.

top 4 comments
sorted by: hot top new old
[-] [email protected] 3 points 1 day ago

They have a list here of the models with performance and RAM usage data: https://immich.app/docs/features/searching/

You kind of just have to pick one, try it, and see if it crashes from low memory.

Also enable OpenVINO HWaccel, because it will be extremely slow otherwise.

[-] [email protected] 2 points 1 day ago

OpenVino is about your only option here. It is not super efficient and will increase system load during those jobs.

[-] [email protected] 2 points 1 day ago* (last edited 1 day ago)

According to this paste, you're not even using inference at all, or rather, it's using CPU.

Change the release tag and "cpu" to openvino and see if that performs any better.

[-] [email protected] 1 points 21 hours ago

thanks I managed to enable openvino and pick a stronger model and it's working quite well, I also bumped the ram to 10gb

this post was submitted on 05 Jun 2025
8 points (90.0% liked)

Selfhosted

46672 readers
386 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 2 years ago
MODERATORS