You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am running IPEX in a docker container and for about a month, as soon as I input a prompt ollama gives an internal service error right away. I have looked through them and I am not able to find any useful information that would point to a cause. Here are the logs: https://pastebin.com/pjuizqYN
And here are the environment variables I have set:
I am running IPEX in a docker container and for about a month, as soon as I input a prompt ollama gives an internal service error right away. I have looked through them and I am not able to find any useful information that would point to a cause. Here are the logs: https://pastebin.com/pjuizqYN
And here are the environment variables I have set:
ONEAPI_DEVICE_SELECTOR=level_zero:0;level_zero:1
IPEX_LLM_NUM_CTX=16384
OLLAMA_PARALLEL=1
OLLAMA_MAX_LOADED_MODELS=0
OLLAMA_DEBUG=1
I am running it on two Arc a770s, 9900k, and 32gb ram.
And here is the versions I'm running on Ubuntu 24.04:
ollama-0.5.4-ipex-llm-2.2.0b20250220-ubuntu.tgz
https://github.com/oneapi-src/level-zero/releases/download/v1.19.2/level-zero_1.19.2+u24.04_amd64.deb
https://github.com/intel/intel-graphics-compiler/releases/download/v2.5.6/intel-igc-core-2_2.5.6+18417_amd64.deb
https://github.com/intel/intel-graphics-compiler/releases/download/v2.5.6/intel-igc-opencl-2_2.5.6+18417_amd64.deb
https://github.com/intel/compute-runtime/releases/download/24.52.32224.5/intel-level-zero-gpu_1.6.32224.5_amd64.deb
https://github.com/intel/compute-runtime/releases/download/24.52.32224.5/intel-opencl-icd_24.52.32224.5_amd64.deb
https://github.com/intel/compute-runtime/releases/download/24.52.32224.5/libigdgmm12_22.5.5_amd64.deb
Any help is greatly appreciated.
The text was updated successfully, but these errors were encountered: