immich-machine-learning openvino not working (transcoding works) about immich HOT 18 CLOSED

I'm guessing you're either missing a driver, or 24.04 is too new for the OpenVINO version in the container. Also, what model is the CPU? I last tested it on a 13700H.

from immich.

It's i9-13900H

I tried with bookworm Debian 6.1 kernel but had no success at all.

from immich.

Hmm, you can try looking at some of the drivers mentioned in this page. This page also suggests using --group-add. For Compose files, this would mean first running stat -c \"%g\" /dev/dri/render*, then adding the output as:

...
group_add:
  - <output>

Also, for what it's worth, I tested on Fedora.

from immich.

No success - driver installation went smooth but no changes.
And I added this to my hwaccel.ml.ml

openvino:
device_cgroup_rules:
- "c 189:* rmw"
devices:
- /dev/dri:/dev/dri
group_add:
- "993"
volumes:
- /dev/bus/usb:/dev/bus/usb

from immich.

What's the output of ls -l /dev/dri? Also, can you set LOG_LEVEL=debug, try again and find the line Available OpenVINO devices: in the ML logs?

from immich.

ls -l /dev/dri:

total 0
drwxr-xr-x 2 root root 100 May 16 14:49 by-path
crw-rw---- 1 root video 226, 0 May 16 14:49 card0
crw-rw---- 1 root video 226, 1 May 16 14:49 card1
crw-rw---- 1 root render 226, 128 May 16 14:49 renderD128

from immich.

Can you also add the output of stat -c \"%g\" /dev/dri/card* to group_add? I think the OpenVINO image is non-root, so it may not be able to access the devices in /dev/dri.

from immich.

but still the same error

from immich.

Try adding this:

    environment:
      - NEOReadDebugKeys=1
      - OverrideGpuAddressSpace=48

from immich.

that seems to have worked

from immich.

Sweet! That means it's a bug in intel-compute-runtime.

from immich.

So anything we can do about that or do I just need to keep that compose extension forever?

from immich.

We would need the latest patched release for intel-compute-runtime in the image, which will take some time to be available in package managers. You can just keep those envs around until then.

from immich.

I decided to add these to the hwaccel.ml.yml file in the meantime: #9541.

from immich.

I added this to the openvino section in hwaccel.ml.yml but it still doesn't work. Mine is intel N5015 installing Xpenology 7.2. Could you please help? The log said "no gpu device found in openvino"
```
environment:
- NEOReadDebugKeys=1
- OverrideGpuAddressSpace=48

from immich.

That fix only applies to kernels 6.7.5 or newer. I don't imagine a Synology server would have such a new kernel. It could be that the kernel is too old instead and/or that you're missing a driver.

from immich.

so there's nothing I can do about it? I see that hardware accelerator works well with Plex while transcoding but I've tried many fixes but can't get it work with immich ML

from immich.

I can't say for certain, but I wouldn't be surprised if it's impossible without a newer host environment.

But on the other hand, your processor would likely run into other issues with OpenVINO, so you may have had to use CPU instead anyway. I can only recommend OpenVINO for Iris Xe and Arc graphics - anything else is too unreliable from what I've seen.

from immich.