Pro Space GPU not detected: 'Can't initialize NVML' error

Spaces
1

Hello,

I am new user of hugging face hub with user name IArjunS, and trying to host and run inference from a fine tuned ML model , I am not able to launch the app
because of unavailibility of GPU i think. Can someone look into this error and provide help

Space URL: Gemma 2b Finetuned Quotes Generator - a Hugging Face Space by IArjunS
My account type - (Pro subscription).

UserWarning: Can’t initialize NVML
Loading model ‘IArjunS/gemma-2b-finetuned-quotes’ on device: cpu…
Stopping Node.js server…
My app.py has the DEVICE = “cuda” if torch.cuda.is_available() else “cpu” logic, and in settings Free GPU seems to be running automatically but error log suggests otherwise.
I think the GPU is not being properly exposed to my container.

Thank you
Arjun

1 Like
2

I could solve the problem, i had not added @spaces.GPU in app.py .

1 Like