Folding GPUs disabled over night ????

[jcarron2]

Hi All

I had a 640, 730, and 1050 folding away, and now all of the sudden silly FAHclient is reporting the 640 and 730 aren't Cuda 1.2 compliant? Whaaaat?

They were a day ago, was there a change to GPUs.txt over night? Noticed the driver version incremented slightly from 456.71 to 461.92...

The 640 finished a WU in 1.49 days, and the 730 in 23 hours... more than enough time.

Log from when things were working 2 days ago

Code: Select all

03:06:32:            CWD: C:\ProgramData\FAHClient
03:06:32:  Win32 Service: false
03:06:32:             OS: Windows 10 Enterprise
03:06:32:        OS Arch: AMD64
03:06:32:           GPUs: 3
03:06:32:          GPU 0: Bus:88 Slot:0 Func:0 NVIDIA:5 GP107 [GeForce GTX 1050 LP] 1862
03:06:32:          GPU 1: Bus:69 Slot:0 Func:0 NVIDIA:3 GK107 [GeForce GT 640] 693
03:06:32:          GPU 2: Bus:24 Slot:0 Func:0 NVIDIA:3 GK208B [GeForce GT 730] 692.7
03:06:32:  CUDA Device 0: Platform:0 Device:0 Bus:88 Slot:0 Compute:6.1 Driver:11.1   <- See this is 11.1 here, did an update mess this up????
03:06:32:  CUDA Device 1: Platform:0 Device:1 Bus:24 Slot:0 Compute:3.5 Driver:11.1    <- See this is 11.1 here, did an update mess this up????
03:06:32:  CUDA Device 2: Platform:0 Device:2 Bus:69 Slot:0 Compute:3.0 Driver:11.1    <- See this is 11.1 here, did an update mess this up????
03:06:32:OpenCL Device 0: Platform:0 Device:0 Bus:88 Slot:0 Compute:1.2 Driver:456.71    <- Same version
03:06:32:OpenCL Device 1: Platform:0 Device:1 Bus:24 Slot:0 Compute:1.2 Driver:456.71
03:06:32:OpenCL Device 2: Platform:0 Device:2 Bus:69 Slot:0 Compute:1.2 Driver:456.71
03:06:32:***********************************************************************
03:06:32:<config>
03:06:32:  <!-- Network -->
03:06:32:  <proxy v=':8080'/>
03:06:32:
03:06:32:  <!-- User Information -->
03:06:32:  <team v='225605'/>
03:06:32:  <user v='JC_XW9400'/>
03:06:32:
03:06:32:  <!-- Folding Slots -->
03:06:32:  <slot id='0' type='CPU'/>
03:06:32:  <slot id='1' type='GPU'>
03:06:32:    <pci-bus v='88'/>
03:06:32:    <pci-slot v='0'/>
03:06:32:  </slot>
03:06:32:  <slot id='2' type='GPU'>
03:06:32:    <pci-bus v='69'/>
03:06:32:    <pci-slot v='0'/>
03:06:32:  </slot>
03:06:32:  <slot id='3' type='GPU'>
03:06:32:    <pci-bus v='24'/>
03:06:32:    <pci-slot v='0'/>
03:06:32:  </slot>
03:06:32:</config>
03:06:32:Trying to access database...
03:06:34:Successfully acquired database lock
03:06:34:FS00:Initialized folding slot 00: cpu:1
03:06:34:FS01:Initialized folding slot 01: gpu:88:0 GP107 [GeForce GTX 1050 LP] 1862
03:06:34:FS02:Initialized folding slot 02: gpu:69:0 GK107 [GeForce GT 640] 693
03:06:34:FS03:Initialized folding slot 03: gpu:24:0 GK208B [GeForce GT 730] 692.7
03:06:41:WU00:FS00:Starting

Log from today when things suddenly stopped working... what gives?

Code: Select all

19:44:42:            CWD: C:\ProgramData\FAHClient
19:44:42:  Win32 Service: false
19:44:42:             OS: Windows 10 Enterprise
19:44:42:        OS Arch: AMD64
19:44:42:           GPUs: 3
19:44:42:          GPU 0: Bus:88 Slot:0 Func:0 NVIDIA:5 GP107 [GeForce GTX 1050 LP] 1862
19:44:42:          GPU 1: Bus:69 Slot:0 Func:0 NVIDIA:3 GK107 [GeForce GT 640] 693
19:44:42:          GPU 2: Bus:24 Slot:0 Func:0 NVIDIA:3 GK208B [GeForce GT 730] 692.7
19:44:42:  CUDA Device 0: Platform:0 Device:0 Bus:88 Slot:0 Compute:6.1 Driver:11.2        <- EDIT: maybe this is responsible 11.1 to 11.2? Have I been had by windows updates?
19:44:42:OpenCL Device 0: Platform:0 Device:0 Bus:88 Slot:0 Compute:1.2 Driver:461.92
19:44:42:***********************************************************************
19:44:43:<config>
19:44:43:  <!-- Network -->
19:44:43:  <proxy v=':8080'/>
19:44:43:
19:44:43:  <!-- User Information -->
19:44:43:  <team v='225605'/>
19:44:43:  <user v='JC_XW9400'/>
19:44:43:
19:44:43:  <!-- Folding Slots -->
19:44:43:  <slot id='0' type='CPU'/>
19:44:43:  <slot id='1' type='GPU'>
19:44:43:    <pci-bus v='88'/>
19:44:43:    <pci-slot v='0'/>
19:44:43:  </slot>
19:44:43:  <slot id='2' type='GPU'>
19:44:43:    <pci-bus v='69'/>
19:44:43:    <pci-slot v='0'/>
19:44:43:  </slot>
19:44:43:  <slot id='3' type='GPU'>
19:44:43:    <pci-bus v='24'/>
19:44:43:    <pci-slot v='0'/>
19:44:43:  </slot>
19:44:43:</config>
19:44:43:Trying to access database...
19:44:44:Successfully acquired database lock
19:44:44:FS00:Initialized folding slot 00: cpu:1
19:44:44:FS01:Initialized folding slot 01: gpu:88:0 GP107 [GeForce GTX 1050 LP] 1862
19:44:44:WARNING:FS02:No CUDA or OpenCL 1.2+ support detected for GPU slot 02: gpu:69:0 GK107 [GeForce GT 640] 693.  Disabling.   <- HUH?
19:44:44:WARNING:FS03:No CUDA or OpenCL 1.2+ support detected for GPU slot 03: gpu:24:0 GK208B [GeForce GT 730] 692.7.  Disabling.   <- HUH ?
19:44:49:WU00:FS00:Connecting to assign1.foldingathome.org:80
19:44:49:WU01:FS01:Connecting to assign1.foldingathome.org:80
19:44:50:WU01:FS01:Assigned to work server 34.72.228.44
19:44:50:WU01:FS01:Requesting new work unit for slot 01: gpu:88:0 GP107 [GeForce GTX 1050 LP] 1862 from 34.72.228.44
19:44:50:WU01:FS01:Connecting to 34.72.228.44:8080
19:44:50:WARNING:WU00:FS00:Failed to get assignment from 'assign1.foldingathome.org:80': No WUs available for this configuration

[Joe_H]

I don't see any changes to GPUs.txt that relate to the GT 640 or GT 730. It is possible the driver update is not compatible with them, or requires multiple installs to put in place specific support files for these GPUs that differ from those for the GT 1050. That can happen when running GPUs from different architectures such as the Kepler used in the 640 and 730 and Pascal used in the 1050.

Nvidia also ended support except for security updates to the drivers for Kepler based GPUs back in 2021.

[jcarron2]

thanks for confirming no changes in the file..!
Turns out the newer drivers do not support this for the older GPU cards.
To add to the complexity, the "studio driver" of 456.71 does not work either.
The game-ready driver version 456.71 does, have installed this version and disabled future driver updates.
Great to squeeze some life out of these cards still.

Regards,
Jonathan

[toTOW]

They were a day ago, was there a change to GPUs.txt over night? Noticed the driver version incremented slightly from 456.71 to 461.92...

Windows Updates probably updated the driver automatically ... those drivers don't have all the required components to run FAH.

Reinstall the drivers download from nVidia ...