Page 1 of 1
sudden surge of bad work units
Posted: Sat Mar 21, 2020 10:23 pm
by createcoms
Have been contributing for a number of days but things aren't going well today. A few times yesterday but now continuously today I'm seeing this:
22:13:45:WU00:FS01:0x22:Folding@home Core Shutdown: BAD_WORK_UNIT
22:13:45:WARNING:WU00:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
22:13:45:WU00:FS01:Sending unit results: id:00 state:SEND error:FAULTY project:11764 run:0 clone:1501 gen:13 core:0x22 unit:0x0000001880fccb0a5e6d8199f3f25575
22:13:46:WU00:FS01:Uploading 8.00KiB to 128.252.203.10
It just keeps downloading a work unit, and then deciding it's bad. Is this my bad or upstream ?
Re: sudden surge of bad work units
Posted: Sat Mar 21, 2020 11:35 pm
by Rikko
Same here
20:20:21:WU02:FS01:0x22:Completed 0 out of 1000000 steps (0%)
20:20:21:WU02:FS01:0x22:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
22:08:51:WU02:FS01:0x22:Completed 10000 out of 1000000 steps (1%)
******************************* Date: 2020-03-21 *******************************
23:09:13:WU02:FS01:0x22:ERROR:exception: clWaitForEvents
23:09:13:WU02:FS01:0x22:Saving result file ..\logfile_01.txt
23:09:13:WU02:FS01:0x22:Saving result file checkpt.crc
23:09:13:WU02:FS01:0x22:Saving result file science.log
23:09:13:WU02:FS01:0x22:Folding@home Core Shutdown: BAD_WORK_UNIT
23:09:14:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
23:09:14:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:11752 run:0 clone:1103 gen:3 core:0x22 unit:0x0000000e8ca304e75e6a805f7fbf4953
Maybe my old graphic card was too slow. [NVIDIA GT610]
1% --> about 2 hours ??
Re: sudden surge of bad work units
Posted: Sat Mar 21, 2020 11:46 pm
by Jesse_V
Are you overclocked at all? Is your graphics card staying cooled? It might be a hardware problem, so those are my guesses.
Re: sudden surge of bad work units
Posted: Sun Mar 22, 2020 12:05 am
by createcoms
I have not overclocked my graphics card, it's running as per factory default. Cooling is excellent.
Re: sudden surge of bad work units
Posted: Sun Mar 22, 2020 1:34 am
by _r2w_ben
Welcome to the forums createcoms and Rikko! Could you please post the the first 100 lines of your logs? This will give a bit more information about your setup and assist with diagnosing the problem.
Re: sudden surge of bad work units
Posted: Sun Mar 22, 2020 1:38 am
by createcoms
Code: Select all
*********************** Log Started 2020-03-21T20:22:08Z ***********************
20:22:08:************************* Folding@home Client *************************
20:22:08: Website: https://foldingathome.org/
20:22:08: Copyright: (c) 2009-2018 foldingathome.org
20:22:08: Author: Joseph Coffland <[email protected]>
20:22:08: Args: --open-web-control
20:22:08: Config: C:\Users\createcoms\AppData\Roaming\FAHClient\config.xml
20:22:08:******************************** Build ********************************
20:22:08: Version: 7.5.1
20:22:08: Date: May 11 2018
20:22:08: Time: 13:06:32
20:22:08: Repository: Git
20:22:08: Revision: 4705bf53c635f88b8fe85af7675557e15d491ff0
20:22:08: Branch: master
20:22:08: Compiler: Visual C++ 2008
20:22:08: Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
20:22:08: Platform: win32 10
20:22:08: Bits: 32
20:22:08: Mode: Release
20:22:08:******************************* System ********************************
20:22:08: CPU: AMD Ryzen 7 1700 Eight-Core Processor
20:22:08: CPU ID: AuthenticAMD Family 23 Model 1 Stepping 1
20:22:08: CPUs: 16
20:22:08: Memory: 63.94GiB
20:22:08: Free Memory: 59.25GiB
20:22:08: Threads: WINDOWS_THREADS
20:22:08: OS Version: 6.2
20:22:08: Has Battery: false
20:22:08: On Battery: false
20:22:08: UTC Offset: 10
20:22:08: PID: 7548
20:22:08: CWD: C:\Users\createcoms\AppData\Roaming\FAHClient
20:22:08: OS: Windows 10 Home
20:22:08: OS Arch: AMD64
20:22:08: GPUs: 1
20:22:08: GPU 0: Bus:10 Slot:0 Func:0 AMD:5 Ellesmere XT [Radeon RX
20:22:08: 470/480/570/580]
20:22:08: CUDA: Not detected: Failed to open dynamic library 'nvcuda.dll': The
20:22:08: specified module could not be found.
20:22:08:
20:22:08:OpenCL Device 0: Platform:0 Device:0 Bus:10 Slot:0 Compute:1.2 Driver:3004.8
20:22:08: Win32 Service: false
20:22:08:***********************************************************************
20:22:08:<config>
20:22:08: <!-- Slot Control -->
20:22:08: <power v='FULL'/>
20:22:08:
20:22:08: <!-- User Information -->
20:22:08: <user v='createcoms'/>
20:22:08:
20:22:08: <!-- Folding Slots -->
20:22:08: <slot id='0' type='CPU'/>
20:22:08: <slot id='1' type='GPU'/>
20:22:08:</config>
20:22:08:Trying to access database...
20:22:08:Successfully acquired database lock
20:22:08:Enabled folding slot 00: READY cpu:15
20:22:08:Enabled folding slot 01: READY gpu:0:Ellesmere XT [Radeon RX 470/480/570/580]
20:22:08:WU00:FS01:Sending unit results: id:00 state:SEND error:FAULTY project:11781 run:0 clone:4245 gen:3 core:0x22 unit:0x000000040d5a98395e73c4ffe7f40e97
20:22:08:WU00:FS01:Uploading 8.00KiB to 13.90.152.57
20:22:08:WU00:FS01:Connecting to 13.90.152.57:8080
20:22:09:WU01:FS00:Connecting to 65.254.110.245:8080
20:22:09:WU02:FS01:Connecting to 65.254.110.245:8080
20:22:09:WARNING:WU01:FS00:Failed to get assignment from '65.254.110.245:8080': No WUs available for this configuration
20:22:09:WU01:FS00:Connecting to 18.218.241.186:80
20:22:10:WARNING:WU01:FS00:Failed to get assignment from '18.218.241.186:80': No WUs available for this configuration
20:22:10:ERROR:WU01:FS00:Exception: Could not get an assignment
20:22:10:9:127.0.0.1:New Web connection
20:22:10:WU01:FS00:Connecting to 65.254.110.245:8080
20:22:11:WARNING:WU02:FS01:Failed to get assignment from '65.254.110.245:8080': No WUs available for this configuration
20:22:11:WU02:FS01:Connecting to 18.218.241.186:80
20:22:11:WARNING:WU01:FS00:Failed to get assignment from '65.254.110.245:8080': No WUs available for this configuration
20:22:11:WU01:FS00:Connecting to 18.218.241.186:80
20:22:11:WARNING:WU02:FS01:Failed to get assignment from '18.218.241.186:80': No WUs available for this configuration
20:22:11:ERROR:WU02:FS01:Exception: Could not get an assignment
20:22:12:WU02:FS01:Connecting to 65.254.110.245:8080
20:22:12:WARNING:WU01:FS00:Failed to get assignment from '18.218.241.186:80': No WUs available for this configuration
20:22:12:ERROR:WU01:FS00:Exception: Could not get an assignment
20:22:12:24:127.0.0.1:New Web connection
20:22:12:WARNING:WU02:FS01:Failed to get assignment from '65.254.110.245:8080': No WUs available for this configuration
20:22:12:WU02:FS01:Connecting to 18.218.241.186:80
20:22:13:WU02:FS01:Assigned to work server 128.252.203.10
20:22:13:WU02:FS01:Requesting new work unit for slot 01: READY gpu:0:Ellesmere XT [Radeon RX 470/480/570/580] from 128.252.203.10
20:22:13:WU02:FS01:Connecting to 128.252.203.10:8080
20:22:34:WARNING:WU02:FS01:WorkServer connection failed on port 8080 trying 80
20:22:34:WU02:FS01:Connecting to 128.252.203.10:80
20:22:55:ERROR:WU02:FS01:Exception: Failed to connect to 128.252.203.10:80: A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond.
20:23:07:WU00:FS01:Upload complete
20:23:07:WU00:FS01:Server responded WORK_ACK (400)
20:23:07:WU00:FS01:Cleaning up
20:23:10:WU01:FS00:Connecting to 65.254.110.245:8080
20:23:11:WARNING:WU01:FS00:Failed to get assignment from '65.254.110.245:8080': No WUs available for this configuration
20:23:11:WU01:FS00:Connecting to 18.218.241.186:80
20:23:12:WARNING:WU01:FS00:Failed to get assignment from '18.218.241.186:80': No WUs available for this configuration
20:23:12:ERROR:WU01:FS00:Exception: Could not get an assignment
20:23:12:WU02:FS01:Connecting to 65.254.110.245:8080
20:23:12:WARNING:WU02:FS01:Failed to get assignment from '65.254.110.245:8080': No WUs available for this configuration
20:23:12:WU02:FS01:Connecting to 18.218.241.186:80
20:23:13:WU02:FS01:Assigned to work server 40.114.52.201
20:23:13:WU02:FS01:Requesting new work unit for slot 01: READY gpu:0:Ellesmere XT [Radeon RX 470/480/570/580] from 40.114.52.201
20:23:13:WU02:FS01:Connecting to 40.114.52.201:8080
20:24:22:WU02:FS01:Downloading 79.12MiB
20:24:28:WU02:FS01:Download 5.29%
20:24:34:WU02:FS01:Download 14.06%
20:24:40:WU02:FS01:Download 21.72%
20:24:46:WU02:FS01:Download 34.05%
20:24:47:WU01:FS00:Connecting to 65.254.110.245:8080
20:24:48:WARNING:WU01:FS00:Failed to get assignment from '65.254.110.245:8080': No WUs available for this configuration
20:24:48:WU01:FS00:Connecting to 18.218.241.186:80
20:24:49:WARNING:WU01:FS00:Failed to get assignment from '18.218.241.186:80': No WUs available for this configuration
20:24:49:ERROR:WU01:FS00:Exception: Could not get an assignment
20:24:52:WU02:FS01:Download 39.18%
20:24:58:WU02:FS01:Download 43.92%
20:25:04:WU02:FS01:Download 51.11%
20:25:10:WU02:FS01:Download 58.53%
20:25:16:WU02:FS01:Download 66.27%
20:25:22:WU02:FS01:Download 74.88%
20:25:28:WU02:FS01:Download 80.73%
20:25:34:WU02:FS01:Download 89.34%
20:25:40:WU02:FS01:Download 97.08%
20:25:41:WU02:FS01:Download complete
20:25:41:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:11776 run:0 clone:5608 gen:5 core:0x22 unit:0x00000009287234c95e74339e75474f71
20:25:41:WU02:FS01:Starting
20:25:41:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\createcoms\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 02 -suffix 01 -version 705 -lifeline 7548 -checkpoint 15 -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
20:25:41:WU02:FS01:Started FahCore on PID 12368
20:25:41:WU02:FS01:Core PID:9640
20:25:41:WU02:FS01:FahCore 0x22 started
20:25:42:WU02:FS01:0x22:*********************** Log Started 2020-03-21T20:25:41Z ***********************
20:25:42:WU02:FS01:0x22:*************************** Core22 Folding@home Core ***************************
20:25:42:WU02:FS01:0x22: Type: 0x22
20:25:42:WU02:FS01:0x22: Core: Core22
20:25:42:WU02:FS01:0x22: Website: https://foldingathome.org/
20:25:42:WU02:FS01:0x22: Copyright: (c) 2009-2018 foldingathome.org
20:25:42:WU02:FS01:0x22: Author: John Chodera <[email protected]> and Rafal Wiewiora
20:25:42:WU02:FS01:0x22: <[email protected]>
20:25:42:WU02:FS01:0x22: Args: -dir 02 -suffix 01 -version 705 -lifeline 12368 -checkpoint 15
20:25:42:WU02:FS01:0x22: -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
20:25:42:WU02:FS01:0x22: Config: <none>
20:25:42:WU02:FS01:0x22:************************************ Build *************************************
20:25:42:WU02:FS01:0x22: Version: 0.0.2
20:25:42:WU02:FS01:0x22: Date: Dec 6 2019
20:25:42:WU02:FS01:0x22: Time: 21:30:31
20:25:42:WU02:FS01:0x22: Repository: Git
20:25:42:WU02:FS01:0x22: Revision: abeb39247cc72df5af0f63723edafadb23d5dfbe
20:25:42:WU02:FS01:0x22: Branch: HEAD
20:25:42:WU02:FS01:0x22: Compiler: Visual C++ 2008
20:25:42:WU02:FS01:0x22: Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
20:25:42:WU02:FS01:0x22: Platform: win32 10
20:25:42:WU02:FS01:0x22: Bits: 64
20:25:42:WU02:FS01:0x22: Mode: Release
20:25:42:WU02:FS01:0x22:************************************ System ************************************
20:25:42:WU02:FS01:0x22: CPU: AMD Ryzen 7 1700 Eight-Core Processor
20:25:42:WU02:FS01:0x22: CPU ID: AuthenticAMD Family 23 Model 1 Stepping 1
20:25:42:WU02:FS01:0x22: CPUs: 16
20:25:42:WU02:FS01:0x22: Memory: 63.94GiB
20:25:42:WU02:FS01:0x22:Free Memory: 59.19GiB
20:25:42:WU02:FS01:0x22: Threads: WINDOWS_THREADS
20:25:42:WU02:FS01:0x22: OS Version: 6.2
20:25:42:WU02:FS01:0x22:Has Battery: false
20:25:42:WU02:FS01:0x22: On Battery: false
20:25:42:WU02:FS01:0x22: UTC Offset: 10
20:25:42:WU02:FS01:0x22: PID: 9640
20:25:42:WU02:FS01:0x22: CWD: C:\Users\createcoms\AppData\Roaming\FAHClient\work
20:25:42:WU02:FS01:0x22: OS: Windows 10 Home
20:25:42:WU02:FS01:0x22: OS Arch: AMD64
20:25:42:WU02:FS01:0x22:********************************************************************************
20:25:42:WU02:FS01:0x22:Project: 11776 (Run 0, Clone 5608, Gen 5)
20:25:42:WU02:FS01:0x22:Unit: 0x00000009287234c95e74339e75474f71
20:25:42:WU02:FS01:0x22:Reading tar file core.xml
20:25:42:WU02:FS01:0x22:Reading tar file integrator.xml
20:25:42:WU02:FS01:0x22:Reading tar file state.xml
20:25:42:WU02:FS01:0x22:Reading tar file system.xml
20:25:43:WU02:FS01:0x22:Digital signatures verified
20:25:43:WU02:FS01:0x22:Folding@home GPU Core22 Folding@home Core
20:25:43:WU02:FS01:0x22:Version 0.0.2
20:26:01:WU02:FS01:0x22:ERROR:exception: Error invoking kernel sortShortList: clEnqueueNDRangeKernel (-5)
20:26:01:WU02:FS01:0x22:Saving result file ..\logfile_01.txt
20:26:01:WU02:FS01:0x22:Saving result file science.log
20:26:01:WU02:FS01:0x22:Folding@home Core Shutdown: BAD_WORK_UNIT
20:26:01:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
20:26:01:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:11776 run:0 clone:5608 gen:5 core:0x22 unit:0x00000009287234c95e74339e75474f71
20:26:01:WU02:FS01:Uploading 8.00KiB to 40.114.52.201
20:26:01:WU02:FS01:Connecting to 40.114.52.201:8080
20:26:02:WU00:FS01:Connecting to 65.254.110.245:8080
20:26:02:WARNING:WU00:FS01:Failed to get assignment from '65.254.110.245:8080': No WUs available for this configuration
20:26:02:WU00:FS01:Connecting to 18.218.241.186:80
20:26:03:WARNING:WU00:FS01:Failed to get assignment from '18.218.241.186:80': No WUs available for this configuration
20:26:03:ERROR:WU00:FS01:Exception: Could not get an assignment
20:26:03:WU00:FS01:Connecting to 65.254.110.245:8080
20:26:04:WARNING:WU00:FS01:Failed to get assignment from '65.254.110.245:8080': No WUs available for this configuration
20:26:04:WU00:FS01:Connecting to 18.218.241.186:80
20:26:05:WARNING:WU00:FS01:Failed to get assignment from '18.218.241.186:80': No WUs available for this configuration
20:26:05:ERROR:WU00:FS01:Exception: Could not get an assignment
20:26:47:WU02:FS01:Upload complete
20:26:47:WU02:FS01:Server responded WORK_ACK (400)
20:26:47:WU02:FS01:Cleaning up
20:27:03:WU00:FS01:Connecting to 65.254.110.245:8080
20:27:04:WARNING:WU00:FS01:Failed to get assignment from '65.254.110.245:8080': No WUs available for this configuration
20:27:04:WU00:FS01:Connecting to 18.218.241.186:80
20:27:05:WARNING:WU00:FS01:Failed to get assignment from '18.218.241.186:80': No WUs available for this configuration
Re: sudden surge of bad work units
Posted: Sun Mar 22, 2020 1:41 am
by createcoms
I must note I am now successfully working on a project after a long period of failure.
Re: sudden surge of bad work units
Posted: Sun Mar 22, 2020 1:48 am
by Jesse_V
You've got one BAD_WORK_UNIT in the log there. The "No WUs available for this configuration" means that the server is temporarily out of workunits at that moment. There's been an overwhelming number of new users to Folding@home and the workunits are being consumed faster than they can be regenerated, but the research teams are getting new servers online and more work into the queue, so hopefully that settles out in the next day or two.
Re: sudden surge of bad work units
Posted: Sun Mar 22, 2020 1:57 am
by _r2w_ben
This BAD_WORK_UNIT failed for the same reason as those reported
here. It's a p11776 with 165,550 atoms on an RX 470/480/570/580.
Re: sudden surge of bad work units
Posted: Sun Mar 22, 2020 6:13 am
by createcoms
So the TL;DR is - fault is not at my end, software update in future will fix this ?
Re: sudden surge of bad work units
Posted: Sun Mar 22, 2020 2:27 pm
by Jesse_V
createcoms wrote:So the TL;DR is - fault is not at my end, software update in future will fix this ?
Your software is working fine; no update needed. The fix will happen when the research teams put more workunits in the queue on the server-end, which they are currently working on. No action needed on your end as it should sort itself out on its own.
Re: sudden surge of bad work units
Posted: Sun Mar 22, 2020 6:20 pm
by bruce