P40 out of support

[indogood1]

vllm-project/vllm#1374

Hi, how many people use p40 for running llm ?
any trouble ?

[lee-b]

P40 is not "out of support", it's supported by nvidia. Some members of the vllm team don't have a great attitude toward Pascal cards (even though a patch exists to support it), but llama.cpp has great support.

[mateuszdrab]

So from my experience, the P40 is out of support by the 17.x GRID drivers, which were the only drivers that worked out of box in WDDM mode on my host. I'm currently on the 16.9 driver with CUDA 12.2 and attempts at switching newer drivers to WDDM mode fails with error code 43.

I am currently documenting my experiences in issue seflerZ/oneclick-gpu-pv#8 (comment)

As of right now, it appears that only drivers above 565.90 are immune to the seg fault issue with nvidia-smi on Linux VMs/WSL2; but, the latest version of the datacenter driver I was able to get to switch to WDDM using the registry hacks from your guide was 551.78, which unfortunately is the same version of CUDA and is affected by the seg fault issue.

Newer drivers 566.03 and 572.13 render the card error out with code 43 in device manager.

Have you been able to get newer drivers to work?