GPU folding says "Running" but remains at 0%

Moderators: Site Moderators, FAHC Science Team

Post Reply
Seneca
Posts: 10
Joined: Thu Mar 19, 2020 7:51 pm

GPU folding says "Running" but remains at 0%

Post by Seneca »

Hi Friends & Folders,
I have a problem folding my GPU (wait ... folding WITH my GPU sounds better :))

The GPU task tells "Running", somtimes changing temporarily to "Ready". The progress bar stays at 0%, the ETA states 2.00 days. Can't see any progress, and the GPU temp remains low (5% load, 35°C core temp ... expected to be 80+% load and 65°C)

Any hint what's wrong ?

Seneca
0=0

Log for the GPU slot reads

Code: Select all

*********************** Log Started 2020-07-03T20:06:09Z ***********************
20:06:09:WU00:FS01:Cleaning up
20:06:13:WU00:FS01:Connecting to assign1.foldingathome.org:80
20:06:14:WU00:FS01:Assigned to work server 3.133.76.19
20:06:14:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:TU104 [GeForce RTX 2080 SUPER] from 3.133.76.19
20:06:14:WU00:FS01:Connecting to 3.133.76.19:8080
20:06:18:WU00:FS01:Downloading 16.89MiB
20:06:24:WU00:FS01:Download 65.50%
20:06:26:WU00:FS01:Download complete
20:06:26:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:14441 run:0 clone:222 gen:68 core:0x22 unit:0x0000007303854c135ea0a3008d8e506e
20:06:26:WU00:FS01:Starting
20:06:26:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Frank\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 706 -lifeline 2764 -checkpoint 5 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
20:06:26:WU00:FS01:Started FahCore on PID 3196
20:06:26:WU00:FS01:Core PID:1784
20:06:26:WU00:FS01:FahCore 0x22 started
20:06:41:WARNING:WU00:FS01:FahCore returned: CORE_RESTART (98 = 0x62)
20:06:41:WU00:FS01:Starting
20:06:41:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Frank\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 706 -lifeline 2764 -checkpoint 5 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
20:06:41:WU00:FS01:Started FahCore on PID 6512
20:06:41:WU00:FS01:Core PID:6700
20:06:41:WU00:FS01:FahCore 0x22 started
20:06:56:WARNING:WU00:FS01:FahCore returned: CORE_RESTART (98 = 0x62)
20:07:41:WU00:FS01:Starting
20:07:41:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Frank\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 706 -lifeline 2764 -checkpoint 5 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
20:07:41:WU00:FS01:Started FahCore on PID 11872
20:07:41:WU00:FS01:Core PID:3112
20:07:41:WU00:FS01:FahCore 0x22 started
20:07:56:WARNING:WU00:FS01:FahCore returned: CORE_RESTART (98 = 0x62)
20:08:41:WU00:FS01:Starting
20:08:41:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Frank\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 706 -lifeline 2764 -checkpoint 5 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
20:08:41:WU00:FS01:Started FahCore on PID 7560
20:08:42:WU00:FS01:Core PID:8316
20:08:42:WU00:FS01:FahCore 0x22 started
20:08:57:WARNING:WU00:FS01:FahCore returned: CORE_RESTART (98 = 0x62)
20:09:42:WU00:FS01:Starting
20:09:42:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Frank\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 706 -lifeline 2764 -checkpoint 5 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
20:09:42:WU00:FS01:Started FahCore on PID 13932
20:09:42:WU00:FS01:Core PID:12208
20:09:42:WU00:FS01:FahCore 0x22 started
20:09:57:WARNING:WU00:FS01:FahCore returned: CORE_RESTART (98 = 0x62)
20:10:42:WU00:FS01:Starting
20:10:42:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Frank\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 706 -lifeline 2764 -checkpoint 5 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
20:10:42:WU00:FS01:Started FahCore on PID 8500
20:10:42:WU00:FS01:Core PID:6760
20:10:42:WU00:FS01:FahCore 0x22 started
20:10:57:WARNING:WU00:FS01:FahCore returned: CORE_RESTART (98 = 0x62)
20:11:42:WU00:FS01:Starting
20:11:42:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Frank\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 706 -lifeline 2764 -checkpoint 5 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
20:11:42:WU00:FS01:Started FahCore on PID 12692
20:11:42:WU00:FS01:Core PID:13172
20:11:42:WU00:FS01:FahCore 0x22 started
20:11:57:WARNING:WU00:FS01:FahCore returned: CORE_RESTART (98 = 0x62)
20:12:42:WU00:FS01:Starting
20:12:42:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Frank\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 706 -lifeline 2764 -checkpoint 5 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
20:12:42:WU00:FS01:Started FahCore on PID 3252
20:12:42:WU00:FS01:Core PID:9368
20:12:42:WU00:FS01:FahCore 0x22 started
20:12:57:WARNING:WU00:FS01:FahCore returned: CORE_RESTART (98 = 0x62)
20:13:42:WU00:FS01:Starting
20:13:42:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Frank\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 706 -lifeline 2764 -checkpoint 5 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
20:13:42:WU00:FS01:Started FahCore on PID 2956
20:13:42:WU00:FS01:Core PID:12488
20:13:42:WU00:FS01:FahCore 0x22 started
20:13:57:WARNING:WU00:FS01:FahCore returned: CORE_RESTART (98 = 0x62)
System Info (from Logfile) reads:

Code: Select all

19:33:17:****************************** FAHClient ******************************
19:33:17:        Version: 7.6.13
19:33:17:         Author: Joseph Coffland <[email protected]>
19:33:17:      Copyright: 2020 foldingathome.org
19:33:17:       Homepage: https://foldingathome.org/
19:33:17:           Date: Apr 27 2020
19:33:17:           Time: 21:21:01
19:33:17:       Revision: 5a652817f46116b6e135503af97f18e094414e3b
19:33:17:         Branch: master
19:33:17:       Compiler: Visual C++ 2008
19:33:17:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
19:33:17:       Platform: win32 10
19:33:17:           Bits: 32
19:33:17:           Mode: Release
19:33:17:           Args: --open-web-control
19:33:17:         Config: C:\Users\*****\AppData\Roaming\FAHClient\config.xml
19:33:17:******************************** CBang ********************************
19:33:17:           Date: Apr 24 2020
19:33:17:           Time: 17:07:55
19:33:17:       Revision: ea081a3b3b0f4a37c4d0440b4f1bc184197c7797
19:33:17:         Branch: master
19:33:17:       Compiler: Visual C++ 2008
19:33:17:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
19:33:17:       Platform: win32 10
19:33:17:           Bits: 32
19:33:17:           Mode: Release
19:33:17:******************************* System ********************************
19:33:17:            CPU: Intel(R) Core(TM) i7-2600K CPU @ 3.40GHz
19:33:17:         CPU ID: GenuineIntel Family 6 Model 42 Stepping 7
19:33:17:           CPUs: 8
19:33:17:         Memory: 31.98GiB
19:33:17:    Free Memory: 19.61GiB
19:33:17:        Threads: WINDOWS_THREADS
19:33:17:     OS Version: 6.2
19:33:17:    Has Battery: false
19:33:17:     On Battery: false
19:33:17:     UTC Offset: 2
19:33:17:            PID: 12680
19:33:17:            CWD: C:\Users\*****\AppData\Roaming\FAHClient
19:33:17:  Win32 Service: false
19:33:17:             OS: Windows 10 Enterprise
19:33:17:        OS Arch: AMD64
19:33:17:           GPUs: 1
19:33:17:          GPU 0: Bus:3 Slot:0 Func:0 NVIDIA:8 TU104 [GeForce RTX 2080 SUPER]
19:33:17:  CUDA Device 0: Platform:0 Device:0 Bus:3 Slot:0 Compute:7.5 Driver:11.0
19:33:17:OpenCL Device 0: Platform:0 Device:0 Bus:3 Slot:0 Compute:1.2 Driver:446.14
19:33:17:******************************* libFAH ********************************
19:33:17:           Date: Apr 15 2020
19:33:17:           Time: 14:53:14
19:33:17:       Revision: 216968bc7025029c841ed6e36e81a03a316890d3
19:33:17:         Branch: master
19:33:17:       Compiler: Visual C++ 2008
19:33:17:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
19:33:17:       Platform: win32 10
19:33:17:           Bits: 32
19:33:17:           Mode: Release
19:33:17:***********************************************************************
JohnChodera
Pande Group Member
Posts: 467
Joined: Fri Feb 22, 2013 9:59 pm

Re: GPU folding says "Running" but remains at 0%

Post by JohnChodera »

Oh no! Looks like you're caught in a CORE_RESTART loop. To force an upgrade, can you delete your `cores/` directory? It will re-download a functional core.

~ John Chodera // MSKCC
Seneca
Posts: 10
Joined: Thu Mar 19, 2020 7:51 pm

Re: GPU folding says "Running" but remains at 0%

Post by Seneca »

Sorry, but nope ... doesn't help.

I've killed the client, deleted the cotntent of /cores and restarted. It updated the core but ran onto the same problem.

I've tried to kill the workunit as well, but it just dl'd a new wu and gets stuck again.

Any further hint ?
_r2w_ben
Posts: 285
Joined: Wed Apr 23, 2008 3:11 pm

Re: GPU folding says "Running" but remains at 0%

Post by _r2w_ben »

Can you post the contents of science.log? It would be in C:\Users\Frank\AppData\Roaming\FAHClient\work\##\01\

You could try a different GPU driver version to see if that has any effect.
aetch
Posts: 436
Joined: Thu Jun 25, 2020 3:04 pm
Location: Between chair and keyboard

Re: GPU folding says "Running" but remains at 0%

Post by aetch »

This may be a long shot, have you added the FAH client and working folders to the exceptions/ignore list in your internet security?
Folding Rigs - None (25-Jun-2022)

ImageImage
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: GPU folding says "Running" but remains at 0%

Post by bruce »

How are you starting FAHClient? Does it have read/write permissions to C:\Users\*****\AppData\Roaming\FAHClient

Presumably that's the same as %APPDATA%\FAHClient
Seneca
Posts: 10
Joined: Thu Mar 19, 2020 7:51 pm

Re: GPU folding says "Running" but remains at 0%

Post by Seneca »

@atech:

long shot, but "hit, sunk". My internet security suite has sandboxed the FAHCore_22 NVIDIA executable ... that caused the weird effects.

Un-sandboxed it and rebootet to be on the safe side, and - et voilá ...

Thanks to all for the suggestions !

Seneca
0=0
Post Reply