2 of my 4 GPU's are in Ready/Download state for long time

[DejaVu]

HI,
I am new to folding, just from few days. Till now there was no problems at all, but since last night 2 of my GPU's are in Ready and Download state. work server for both is 171.64.65.93, collection server is 0.0.0.0.
Here is few lines from the log for FS02:

Code: Select all

07:19:19:WU03:FS02:0x17:*********************** Log Started 2014-05-21T07:19:18Z ***********************
07:19:19:WU03:FS02:0x17:Project: 9408 (Run 3050, Clone 0, Gen 0)
07:19:19:WU03:FS02:0x17:Unit: 0x000000000a3b1e5c5343568b4ab277f3
07:19:19:WU03:FS02:0x17:CPU: 0x00000000000000000000000000000000
07:19:19:WU03:FS02:0x17:Machine: 2
07:19:19:WU03:FS02:0x17:Digital signatures verified
07:19:19:WU03:FS02:0x17:Folding@home GPU core17
07:19:19:WU03:FS02:0x17:Version 0.0.52
07:19:26:WU03:FS02:0x17:ERROR:Win32: 0xc0000005: Exception access violation
07:19:26:WU03:FS02:0x17:Saving result file logfile_01.txt
07:19:26:WU03:FS02:0x17:Saving result file log.txt
07:19:26:WU03:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
07:19:27:WARNING:WU03:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
07:19:27:WU03:FS02:Sending unit results: id:03 state:SEND error:FAULTY project:9408 run:3050 clone:0 gen:0 core:0x17 unit:0x000000000a3b1e5c5343568b4ab277f3
07:19:27:WU03:FS02:Uploading 3.44KiB to 171.64.65.56
07:19:27:WU03:FS02:Connecting to 171.64.65.56:8080
07:19:27:WU04:FS02:Connecting to 171.67.108.201:80
07:19:28:WU04:FS02:Assigned to work server 171.64.65.93
07:19:28:WU04:FS02:Requesting new work unit for slot 02: READY gpu:1:Tahiti XT [Radeon R9 200/HD 7900/8970] from 171.64.65.93
07:19:28:WU04:FS02:Connecting to 171.64.65.93:8080
07:19:28:WU03:FS02:Upload complete
07:19:28:WU03:FS02:Server responded WORK_ACK (400)
07:19:28:WU03:FS02:Cleaning up
07:19:29:ERROR:WU04:FS02:Exception: Server did not assign work unit
07:19:29:WU04:FS02:Connecting to 171.67.108.201:80
07:19:30:WU04:FS02:Assigned to work server 171.64.65.93
07:19:30:WU04:FS02:Requesting new work unit for slot 02: READY gpu:1:Tahiti XT [Radeon R9 200/HD 7900/8970] from 171.64.65.93
07:19:30:WU04:FS02:Connecting to 171.64.65.93:8080
07:19:31:ERROR:WU04:FS02:Exception: Server did not assign work unit
07:20:29:WU04:FS02:Connecting to 171.67.108.201:80
07:20:30:WU04:FS02:Assigned to work server 171.64.65.93
07:20:30:WU04:FS02:Requesting new work unit for slot 02: READY gpu:1:Tahiti XT [Radeon R9 200/HD 7900/8970] from 171.64.65.93
07:20:30:WU04:FS02:Connecting to 171.64.65.93:8080
07:20:31:ERROR:WU04:FS02:Exception: Server did not assign work unit
07:22:07:WU04:FS02:Connecting to 171.67.108.201:80
07:22:07:WU04:FS02:Assigned to work server 171.64.65.93
07:22:07:WU04:FS02:Requesting new work unit for slot 02: READY gpu:1:Tahiti XT [Radeon R9 200/HD 7900/8970] from 171.64.65.93
07:22:07:WU04:FS02:Connecting to 171.64.65.93:8080
07:22:08:ERROR:WU04:FS02:Exception: Server did not assign work unit
07:24:44:WU04:FS02:Connecting to 171.67.108.201:80
07:24:45:WU04:FS02:Assigned to work server 171.64.65.93
07:24:45:WU04:FS02:Requesting new work unit for slot 02: READY gpu:1:Tahiti XT [Radeon R9 200/HD 7900/8970] from 171.64.65.93
07:24:45:WU04:FS02:Connecting to 171.64.65.93:8080
07:24:46:ERROR:WU04:FS02:Exception: Server did not assign work unit
07:28:59:WU04:FS02:Connecting to 171.67.108.201:80
07:29:00:WU04:FS02:Assigned to work server 171.64.65.93
07:29:00:WU04:FS02:Requesting new work unit for slot 02: READY gpu:1:Tahiti XT [Radeon R9 200/HD 7900/8970] from 171.64.65.93
07:29:00:WU04:FS02:Connecting to 171.64.65.93:8080
07:29:01:ERROR:WU04:FS02:Exception: Server did not assign work unit
07:35:49:WU04:FS02:Connecting to 171.67.108.201:80
07:35:50:WU04:FS02:Assigned to work server 171.64.65.93
07:35:51:WU04:FS02:Requesting new work unit for slot 02: READY gpu:1:Tahiti XT [Radeon R9 200/HD 7900/8970] from 171.64.65.93
07:35:51:WU04:FS02:Connecting to 171.64.65.93:8080
07:35:52:ERROR:WU04:FS02:Exception: Server did not assign work unit
07:46:55:WU04:FS02:Connecting to 171.67.108.201:80
07:46:56:WU04:FS02:Assigned to work server 171.64.65.93
07:46:57:WU04:FS02:Requesting new work unit for slot 02: READY gpu:1:Tahiti XT [Radeon R9 200/HD 7900/8970] from 171.64.65.93
07:46:57:WU04:FS02:Connecting to 171.64.65.93:8080
07:46:57:ERROR:WU04:FS02:Exception: Server did not assign work unit

and here is for FS03:
*********************** Log Started 2014-05-21T04:53:04Z ***********************

Code: Select all

04:53:17:FS03:Unpaused
04:53:18:WU02:FS03:Connecting to 171.67.108.201:80
04:53:19:WU02:FS03:Assigned to work server 171.64.65.93
04:53:19:WU02:FS03:Requesting new work unit for slot 03: READY gpu:2:Tahiti XT [Radeon R9 200/HD 7900/8970] from 171.64.65.93
04:53:19:WU02:FS03:Connecting to 171.64.65.93:8080
04:53:19:ERROR:WU02:FS03:Exception: Server did not assign work unit
04:53:20:WU02:FS03:Connecting to 171.67.108.201:80
04:53:20:WU02:FS03:Assigned to work server 171.64.65.93
04:53:20:WU02:FS03:Requesting new work unit for slot 03: READY gpu:2:Tahiti XT [Radeon R9 200/HD 7900/8970] from 171.64.65.93
04:53:20:WU02:FS03:Connecting to 171.64.65.93:8080
04:53:21:ERROR:WU02:FS03:Exception: Server did not assign work unit
04:54:20:WU02:FS03:Connecting to 171.67.108.201:80
04:54:20:WU02:FS03:Assigned to work server 171.64.65.93
04:54:20:WU02:FS03:Requesting new work unit for slot 03: READY gpu:2:Tahiti XT [Radeon R9 200/HD 7900/8970] from 171.64.65.93
04:54:20:WU02:FS03:Connecting to 171.64.65.93:8080
04:54:21:ERROR:WU02:FS03:Exception: Server did not assign work unit
04:55:57:WU02:FS03:Connecting to 171.67.108.201:80
04:55:58:WU02:FS03:Assigned to work server 171.64.65.93
04:55:58:WU02:FS03:Requesting new work unit for slot 03: READY gpu:2:Tahiti XT [Radeon R9 200/HD 7900/8970] from 171.64.65.93
04:55:58:WU02:FS03:Connecting to 171.64.65.93:8080
04:55:58:ERROR:WU02:FS03:Exception: Server did not assign work unit
04:58:34:WU02:FS03:Connecting to 171.67.108.201:80
04:58:35:WU02:FS03:Assigned to work server 171.64.65.93
04:58:35:WU02:FS03:Requesting new work unit for slot 03: READY gpu:2:Tahiti XT [Radeon R9 200/HD 7900/8970] from 171.64.65.93
04:58:35:WU02:FS03:Connecting to 171.64.65.93:8080
04:58:36:ERROR:WU02:FS03:Exception: Server did not assign work unit
05:02:49:WU02:FS03:Connecting to 171.67.108.201:80
05:02:49:WU02:FS03:Assigned to work server 171.64.65.93
05:02:49:WU02:FS03:Requesting new work unit for slot 03: READY gpu:2:Tahiti XT [Radeon R9 200/HD 7900/8970] from 171.64.65.93
05:02:49:WU02:FS03:Connecting to 171.64.65.93:8080
05:02:50:ERROR:WU02:FS03:Exception: Server did not assign work unit
05:09:40:WU02:FS03:Connecting to 171.67.108.201:80
05:09:41:WU02:FS03:Assigned to work server 171.64.65.93
05:09:41:WU02:FS03:Requesting new work unit for slot 03: READY gpu:2:Tahiti XT [Radeon R9 200/HD 7900/8970] from 171.64.65.93
05:09:41:WU02:FS03:Connecting to 171.64.65.93:8080
05:09:42:ERROR:WU02:FS03:Exception: Server did not assign work unit
05:20:46:WU02:FS03:Connecting to 171.67.108.201:80
05:20:47:WU02:FS03:Assigned to work server 171.64.65.93
05:20:47:WU02:FS03:Requesting new work unit for slot 03: READY gpu:2:Tahiti XT [Radeon R9 200/HD 7900/8970] from 171.64.65.93
05:20:47:WU02:FS03:Connecting to 171.64.65.93:8080
05:20:48:ERROR:WU02:FS03:Exception: Server did not assign work unit
05:38:43:WU02:FS03:Connecting to 171.67.108.201:80
05:38:43:WU02:FS03:Assigned to work server 171.64.65.93
05:38:44:WU02:FS03:Requesting new work unit for slot 03: READY gpu:2:Tahiti XT [Radeon R9 200/HD 7900/8970] from 171.64.65.93
05:38:44:WU02:FS03:Connecting to 171.64.65.93:8080
05:38:45:ERROR:WU02:FS03:Exception: Server did not assign work unit
06:07:45:WU02:FS03:Connecting to 171.67.108.201:80
06:07:46:WU02:FS03:Assigned to work server 171.64.65.93
06:07:46:WU02:FS03:Requesting new work unit for slot 03: READY gpu:2:Tahiti XT [Radeon R9 200/HD 7900/8970] from 171.64.65.93
06:07:46:WU02:FS03:Connecting to 171.64.65.93:8080
06:07:47:ERROR:WU02:FS03:Exception: Server did not assign work unit
06:54:44:WU02:FS03:Connecting to 171.67.108.201:80
06:54:45:WU02:FS03:Assigned to work server 171.64.65.93
06:54:45:WU02:FS03:Requesting new work unit for slot 03: READY gpu:2:Tahiti XT [Radeon R9 200/HD 7900/8970] from 171.64.65.93
06:54:45:WU02:FS03:Connecting to 171.64.65.93:8080
06:54:46:ERROR:WU02:FS03:Exception: Server did not assign work unit

any suggestions?

[P5-133XL]

I looks like your work server is running out of WU's.

[DejaVu]

In server status page, http://fah-web.stanford.edu/pybeta/serverstat.html, everything is fine...

[P5-133XL]

Everything is fine, but not very many WU's compared to normal.

Short-term solution is to pick a different client-type to get a different work server.

[planetclown]

I'm seeing the same for a Radeon HD 7950.

Code: Select all

12:04:37:WU00:FS00:Assigned to work server 171.64.65.93
12:04:37:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:Tahiti PRO [Radeon R9 280/HD 7900/8950] from 171.64.65.93
12:04:38:ERROR:WU00:FS00:Exception: Server did not assign work unit
12:04:38:WU00:FS00:Assigned to work server 171.64.65.93
12:04:38:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:Tahiti PRO [Radeon R9 280/HD 7900/8950] from 171.64.65.93
12:04:38:ERROR:WU00:FS00:Exception: Server did not assign work unit

I did have the advanced flag set. Once I removed that flag, I immediately received a project 13000 WU from work server 140.163.4.231.

[NookieBandit]

I'm having the same issue - all 16 GPUs - mix of 7970 and 780ti systems - not receiving any work units. Have started/stopped slots, rebooted PCs, checked internet connections and diagnosed/troubleshot everything I can on my end. Can a mod please check server status again? Thanks...

[Kurtis200200]

Same issue here (well, that one of my two nvidia GTX660 GPUs sits idle while the other one continues to work on its 24-hour work unit)

Edit: forgot to mention that I'm running Linux

While I don't have a log to provide (removing the "client-type" "advanced" flag appears to have blasted it), I can say (according to FAHContol) that the WS for the idle GPU is 171.64.65.93, that 11 attempts have been made, and that the collection server is 0.0.0.0.

Also, the slot has been idle now since ~2a PDT.

Since I requested (via the FAH telnet connection) a WS assignment, the idle slot's "Waiting On" a "WS Assignment".

[JimF]

Same here on one of my HD 7870s. I removed "client-type advanced", rebooted and it changed assignment servers, and I now have a work unit again.

[P5-133XL]

The server owner has been contacted.

[bcavnaugh]

I cannot get any projects on AMD or NVIDIA, what's up?
client-type" "advanced Removed all all no new work.

Core 17 P13000 on AMD
Core 15 on NVIDIA SAD SAD SAD DAY ONCE MORE FOR NVIDIA.

[Jesse_V]

Same issue. The issue started yesterday afternoon but FoldingForum.org was down at that time.

Code: Select all

14:39:02:WU03:FS01:Assigned to work server 171.64.65.93
14:39:02:WU03:FS01:Requesting new work unit for slot 01: READY gpu:0:GF114 [GeForce GTX 560 Ti] from 171.64.65.93
14:39:02:WU03:FS01:Connecting to 171.64.65.93:8080
14:39:03:ERROR:WU03:FS01:Exception: Server did not assign work unit

My GTX 480 and GTX 560TI are both down.

[msultan]

Hi,
Thanks for all the feed back and sorry about the mess up. It was completely my fault. P9101 was ending and I was starting a new project P9102 but forgot to inform the assignment server. The project has been released and should be assigning work now. Let me know if there are any further problems.

beta project link:
viewtopic.php?f=66&t=26363

Happy folding,
Muneeb

[Jesse_V]

Thanks for fixing it, I can confirm that my GPUs are up and running again.

[NookieBandit]

All is fine on my end now as well.

Thank goodness, I was fearful my electric bill would go down this month

Seriously, much appreciation for the feedback and quick resolution.