Error "Half key.dtype: float and value.dtype: float instead"

#20

by victorthoulouze - opened Dec 10, 2023

Discussion

victorthoulouze

Dec 10, 2023

•

edited Dec 10, 2023

Hi Dear community,

I am trying to use the IPmodel on M2 Macbook. But i have the same error over and over :
RuntimeError: Expected query, key, and value to have the same dtype, but got query.dtype: c10::Half key.dtype: float and value.dtype: float instead.

I changed the webui-macos-env.sh and it works :

export COMMANDLINE_ARGS="--skip-torch-cuda-test --upcast-sampling --no-half-vae --no-half --use-cpu interrogate --opt-sub-quad-attention --medvram --disable-safe-unpickle"

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment