Stuck trying to send job for 3 days

If you're new to FAH and need help getting started or you have very basic questions, start here.

Moderators: Site Moderators, FAHC Science Team

Post Reply
unwiredmedic
Posts: 3
Joined: Fri Apr 17, 2020 6:26 am
Hardware configuration: HP Z800 Desktop Server
Dual Xeon E5620 @ 2.40GHz 4 Core - 8 Thread
48GB DDR3 1033 ECC RAMM
NVIDIA Quadro 4000
NVIDIA Quadro 2000
Contact:

Stuck trying to send job for 3 days

Post by unwiredmedic »

Relatively new to folding here (since April 2, 2020). I upped my logging level and this is what I came up with. I will have to try again tomorrow, but I only have a little over 2 more days before this expires. TIA for any help.
06:35:34:WARNING:WU00:FS00:Exception: Failed to send results to work server: 10002: Received short response, expected 512 bytes, got 0
06:35:34:WU00:FS00:Trying to send results to collection server
06:35:34:WU00:FS00:Uploading 6.49MiB to 155.247.166.219
06:35:34:WU00:FS00:Connecting to 155.247.166.219:8080
06:36:47:ERROR:WU00:FS00:Exception: 10002: Received short response, expected 512 bytes, got 0
06:36:47:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:14365 run:312 clone:1 gen:41 core:0xa7 unit:0x0000002b9bf7a4d55e81239c84eb8cc6
06:36:47:WU00:FS00:Uploading 6.49MiB to 155.247.164.213
06:36:47:WU00:FS00:Connecting to 155.247.164.213:8080
06:37:08:WARNING:WU00:FS00:WorkServer connection failed on port 8080 trying 80
06:37:08:WU00:FS00:Connecting to 155.247.164.213:80
06:37:29:WARNING:WU00:FS00:Exception: Failed to send results to work server: Failed to connect to 155.247.164.213:80: A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond.
06:37:29:WU00:FS00:Trying to send results to collection server
06:37:30:WU00:FS00:Uploading 6.49MiB to 155.247.166.219
06:37:30:WU00:FS00:Connecting to 155.247.166.219:8080
06:38:21:ERROR:WU00:FS00:Exception: 10002: Received short response, expected 512 bytes, got 0
06:38:21:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:14365 run:312 clone:1 gen:41 core:0xa7 unit:0x0000002b9bf7a4d55e81239c84eb8cc6
06:38:21:WU00:FS00:Uploading 6.49MiB to 155.247.164.213
06:38:21:WU00:FS00:Connecting to 155.247.164.213:8080
06:38:42:WARNING:WU00:FS00:WorkServer connection failed on port 8080 trying 80
06:38:42:WU00:FS00:Connecting to 155.247.164.213:80
06:39:04:WARNING:WU00:FS00:Exception: Failed to send results to work server: Failed to connect to 155.247.164.213:80: A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond.
06:39:04:WU00:FS00:Trying to send results to collection server
06:39:04:WU00:FS00:Uploading 6.49MiB to 155.247.166.219
06:39:04:WU00:FS00:Connecting to 155.247.166.219:8080
06:41:41:ERROR:WU00:FS00:Exception: 10002: Received short response, expected 512 bytes, got 0
06:41:41:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:14365 run:312 clone:1 gen:41 core:0xa7 unit:0x0000002b9bf7a4d55e81239c84eb8cc6
06:41:41:WU00:FS00:Uploading 6.49MiB to 155.247.164.213
06:41:41:WU00:FS00:Connecting to 155.247.164.213:8080
Things I have tried:
- app restarts
- pause folding
- restart my workstation
- I shut down for the night for several hours at a time and resume the next day (generates A LOT of heat! :twisted: )
- my Spectrum cable modem and my WiFi router are reset every day in the wee hours
- verified my connection to the interwebz and I have bandwidth to spare
PantherX
Site Moderator
Posts: 6986
Joined: Wed Dec 23, 2009 9:33 am
Hardware configuration: V7.6.21 -> Multi-purpose 24/7
Windows 10 64-bit
CPU:2/3/4/6 -> Intel i7-6700K
GPU:1 -> Nvidia GTX 1080 Ti
§
Retired:
2x Nvidia GTX 1070
Nvidia GTX 675M
Nvidia GTX 660 Ti
Nvidia GTX 650 SC
Nvidia GTX 260 896 MB SOC
Nvidia 9600GT 1 GB OC
Nvidia 9500M GS
Nvidia 8800GTS 320 MB

Intel Core i7-860
Intel Core i7-3840QM
Intel i3-3240
Intel Core 2 Duo E8200
Intel Core 2 Duo E6550
Intel Core 2 Duo T8300
Intel Pentium E5500
Intel Pentium E5400
Location: Land Of The Long White Cloud
Contact:

Re: Stuck trying to send job for 3 days

Post by PantherX »

Welcome to the F@H Forum unwiredmedic,

Please note that due to bandwidth issues, the Sever is overloaded. May I suggest that you leave the client running at night but pause them? In theory, it should try to upload the completed WUs but not generate any heat.

Furthermore, please ensure that the verbosity level is set at 3 since any high will hinder us in troubleshooting.
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time

Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
unwiredmedic
Posts: 3
Joined: Fri Apr 17, 2020 6:26 am
Hardware configuration: HP Z800 Desktop Server
Dual Xeon E5620 @ 2.40GHz 4 Core - 8 Thread
48GB DDR3 1033 ECC RAMM
NVIDIA Quadro 4000
NVIDIA Quadro 2000
Contact:

Re: Stuck trying to send job for 3 days

Post by unwiredmedic »

I'll give it a shot. I was hoping the server was just extraordinarily busy. Thanks.
astronomyrat
Posts: 3
Joined: Fri Apr 17, 2020 10:04 am
Hardware configuration: I5 4th gen running debian, no GPU
I7 4th gen U (laptop) win 10, with a small GPU
I7 7th gen win10, GeForce GTX 950
I7 8th gen win10, GeFroce GTX 1050 Ti
Location: Switzerland

Re: Stuck trying to send job for 3 days

Post by astronomyrat »

I have my the same problem, and the PC is running 24/24h, I have now 2 WU waiting to be send since days is there a way to avoid WU from 155.247.164.213 as it seems it upload server isn't able to accept all the processed WU.
PantherX
Site Moderator
Posts: 6986
Joined: Wed Dec 23, 2009 9:33 am
Hardware configuration: V7.6.21 -> Multi-purpose 24/7
Windows 10 64-bit
CPU:2/3/4/6 -> Intel i7-6700K
GPU:1 -> Nvidia GTX 1080 Ti
§
Retired:
2x Nvidia GTX 1070
Nvidia GTX 675M
Nvidia GTX 660 Ti
Nvidia GTX 650 SC
Nvidia GTX 260 896 MB SOC
Nvidia 9600GT 1 GB OC
Nvidia 9500M GS
Nvidia 8800GTS 320 MB

Intel Core i7-860
Intel Core i7-3840QM
Intel i3-3240
Intel Core 2 Duo E8200
Intel Core 2 Duo E6550
Intel Core 2 Duo T8300
Intel Pentium E5500
Intel Pentium E5400
Location: Land Of The Long White Cloud
Contact:

Re: Stuck trying to send job for 3 days

Post by PantherX »

Welcome to the F@H Forum astronomyrat,

Unfortunately, there's no way to block the Work Server from the Client side. There's a massive load on the Work Server bandwidth/resource limitations and work is being done to elevate it so in the meantime, please leave the client running and it will automatically handle the WUs :)
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time

Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
tomc001
Posts: 28
Joined: Mon Jan 05, 2009 12:58 am

Re: Stuck trying to send job for 3 days

Post by tomc001 »

I have 4 to send from 155.247.164.213. Just a moment ago it was 5 to send but one finally made it back home. The oldest one in the send queue is two days old now. My computer is always on.

Does anyone know if the send requests use an Ethernet like exponential backoff time algorithm between attempts in an effort to reduce collisions? Obviously the time constants would need to be much longer than the microseconds used with Ethernet.
Joe_H
Site Admin
Posts: 7929
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2
Location: W. MA

Re: Stuck trying to send job for 3 days

Post by Joe_H »

Yes, the client usually backs off the sending of WUs. In the log you would be able to see an increasing time between return attempts for each WU.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
unwiredmedic
Posts: 3
Joined: Fri Apr 17, 2020 6:26 am
Hardware configuration: HP Z800 Desktop Server
Dual Xeon E5620 @ 2.40GHz 4 Core - 8 Thread
48GB DDR3 1033 ECC RAMM
NVIDIA Quadro 4000
NVIDIA Quadro 2000
Contact:

Re: Stuck trying to send job for 3 days

Post by unwiredmedic »

OKay, so it didn't send for the fourth day. I'll keep trying and hope it goes through before it expires.
tomc001
Posts: 28
Joined: Mon Jan 05, 2009 12:58 am

Re: Stuck trying to send job for 3 days

Post by tomc001 »

There is a real problem with at least one server receiving results. Here are the 5 currently stuck for me. The oldest is 5 days old. What's the point of assigning work units if the results are never received?

Image

Image

Image

Image

Image
Jan
Posts: 79
Joined: Tue Mar 31, 2020 6:46 pm

Re: Stuck trying to send job for 3 days

Post by Jan »

The staff is aware of this situation. Projects are being redistributed to additional servers. Should see a noticable difference within the next 3-4 days.
Post Reply