Issues with assign[1-4].foldingathome.org

[Jakre73]

Hi together!
Currently, I´ve got some issues with getting WU´s from multiple servers. I´ve already tried to change the folding power (number of CPU cores), I´ve deleted and re-created the CPU slot, I´ve tried to delete the GPU slot and let the CPU slot work alone, and I´ve performed a clean re-install of the complete client, I´ve also tried the classic PC restart. The issues appear since about 3-5 days ago and are coming up sporadically. I receive some jobs from time to time, and then there are times when I´m not receiving anything for hours while GPU is working fine.
Here is my log since the last successful completed job:

Code: Select all

18:12:58:WU00:FS00:0xa7:Completed 250000 out of 250000 steps (100%)
18:12:59:WU00:FS00:0xa7:Saving result file ..\logfile_01.txt
18:12:59:WU00:FS00:0xa7:Saving result file frame57.trr
18:12:59:WU00:FS00:0xa7:Saving result file frame57.xtc
18:12:59:WU00:FS00:0xa7:Saving result file md.log
18:12:59:WU00:FS00:0xa7:Saving result file science.log
18:12:59:WU00:FS00:0xa7:Folding@home Core Shutdown: FINISHED_UNIT
18:12:59:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
18:12:59:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:14254 run:0 clone:3917 gen:57 core:0xa7 unit:0x00000049cedfaa925f6a388c9f5fbe5c
18:12:59:WU00:FS00:Uploading 2.87MiB to 206.223.170.146
18:12:59:WU00:FS00:Connecting to 206.223.170.146:8080
18:13:05:WU00:FS00:Upload complete
18:13:05:WU00:FS00:Server responded WORK_ACK (400)
18:13:05:WU00:FS00:Final credit estimate, 6293.00 points
18:13:05:WU00:FS00:Cleaning up
18:56:42:WU00:FS00:Connecting to assign1.foldingathome.org:80
18:56:42:WARNING:WU00:FS00:Failed to get assignment from 'assign1.foldingathome.org:80': No WUs available for this configuration
18:56:42:WU00:FS00:Connecting to assign2.foldingathome.org:80
18:56:43:WARNING:WU00:FS00:Failed to get assignment from 'assign2.foldingathome.org:80': No WUs available for this configuration
18:56:43:WU00:FS00:Connecting to assign3.foldingathome.org:80
18:56:43:WU00:FS00:Assigned to work server 178.174.196.138
18:56:43:WU00:FS00:Requesting new work unit for slot 00: READY cpu:15 from 178.174.196.138
18:56:43:WU00:FS00:Connecting to 178.174.196.138:8080
18:57:04:WARNING:WU00:FS00:WorkServer connection failed on port 8080 trying 80
18:57:04:WU00:FS00:Connecting to 178.174.196.138:80
18:57:25:ERROR:WU00:FS00:Exception: Failed to connect to 178.174.196.138:80: Ein Verbindungsversuch ist fehlgeschlagen, da die Gegenstelle nach einer bestimmten Zeitspanne nicht richtig reagiert hat, oder die hergestellte Verbindung war fehlerhaft, da der verbundene Host nicht reagiert hat.
18:57:26:WU00:FS00:Connecting to assign1.foldingathome.org:80
18:57:26:WARNING:WU00:FS00:Failed to get assignment from 'assign1.foldingathome.org:80': No WUs available for this configuration
18:57:26:WU00:FS00:Connecting to assign2.foldingathome.org:80
18:57:27:WU00:FS00:Assigned to work server 69.94.66.7
18:57:27:WU00:FS00:Requesting new work unit for slot 00: READY cpu:15 from 69.94.66.7
18:57:27:WU00:FS00:Connecting to 69.94.66.7:8080
18:57:28:ERROR:WU00:FS00:Exception: Server did not assign work unit
18:58:26:WU00:FS00:Connecting to assign1.foldingathome.org:80
18:58:27:WU00:FS00:Assigned to work server 69.94.66.7
18:58:27:WU00:FS00:Requesting new work unit for slot 00: READY cpu:15 from 69.94.66.7
18:58:27:WU00:FS00:Connecting to 69.94.66.7:8080
18:58:27:ERROR:WU00:FS00:Exception: Server did not assign work unit
19:00:03:WU00:FS00:Connecting to assign1.foldingathome.org:80
19:00:04:WARNING:WU00:FS00:Failed to get assignment from 'assign1.foldingathome.org:80': No WUs available for this configuration
19:00:04:WU00:FS00:Connecting to assign2.foldingathome.org:80
19:00:04:WU00:FS00:Assigned to work server 178.174.196.138
19:00:04:WU00:FS00:Requesting new work unit for slot 00: READY cpu:15 from 178.174.196.138
19:00:04:WU00:FS00:Connecting to 178.174.196.138:8080
19:00:25:WARNING:WU00:FS00:WorkServer connection failed on port 8080 trying 80
19:00:25:WU00:FS00:Connecting to 178.174.196.138:80
19:00:46:ERROR:WU00:FS00:Exception: Failed to connect to 178.174.196.138:80: Ein Verbindungsversuch ist fehlgeschlagen, da die Gegenstelle nach einer bestimmten Zeitspanne nicht richtig reagiert hat, oder die hergestellte Verbindung war fehlerhaft, da der verbundene Host nicht reagiert hat.
19:02:41:WU00:FS00:Connecting to assign1.foldingathome.org:80
19:02:41:WARNING:WU00:FS00:Failed to get assignment from 'assign1.foldingathome.org:80': No WUs available for this configuration
19:02:41:WU00:FS00:Connecting to assign2.foldingathome.org:80
19:02:42:WARNING:WU00:FS00:Failed to get assignment from 'assign2.foldingathome.org:80': No WUs available for this configuration
19:02:42:WU00:FS00:Connecting to assign3.foldingathome.org:80
19:02:42:WU00:FS00:Assigned to work server 66.170.111.50
19:02:42:WU00:FS00:Requesting new work unit for slot 00: READY cpu:15 from 66.170.111.50
19:02:42:WU00:FS00:Connecting to 66.170.111.50:8080
19:02:43:ERROR:WU00:FS00:Exception: Server did not assign work unit
19:06:55:WU00:FS00:Connecting to assign1.foldingathome.org:80
19:06:55:WU00:FS00:Assigned to work server 66.170.111.50
19:06:56:WU00:FS00:Requesting new work unit for slot 00: READY cpu:15 from 66.170.111.50
19:06:56:WU00:FS00:Connecting to 66.170.111.50:8080
19:06:57:ERROR:WU00:FS00:Exception: Server did not assign work unit
19:13:36:FS00:Finishing
19:13:46:WU00:FS00:Connecting to assign1.foldingathome.org:80
19:13:46:WARNING:WU00:FS00:Failed to get assignment from 'assign1.foldingathome.org:80': No WUs available for this configuration
19:13:46:WU00:FS00:Connecting to assign2.foldingathome.org:80
19:13:47:WU00:FS00:Assigned to work server 128.252.203.1
19:13:48:WU00:FS00:Requesting new work unit for slot 00: READY cpu:15 from 128.252.203.1
19:13:48:WU00:FS00:Connecting to 128.252.203.1:8080
19:13:48:ERROR:WU00:FS00:Exception: Server did not assign work unit
19:14:08:FS00:Paused
19:14:19:FS00:Unpaused
19:14:46:WU00:FS00:Connecting to assign1.foldingathome.org:80
19:14:46:WARNING:WU00:FS00:Failed to get assignment from 'assign1.foldingathome.org:80': No WUs available for this configuration
19:14:46:WU00:FS00:Connecting to assign2.foldingathome.org:80
19:14:47:WU00:FS00:Assigned to work server 178.174.196.138
19:14:48:WU00:FS00:Requesting new work unit for slot 00: READY cpu:14 from 178.174.196.138
19:14:48:WU00:FS00:Connecting to 178.174.196.138:8080
19:15:09:WARNING:WU00:FS00:WorkServer connection failed on port 8080 trying 80
19:15:09:WU00:FS00:Connecting to 178.174.196.138:80
19:15:30:ERROR:WU00:FS00:Exception: Failed to connect to 178.174.196.138:80: Ein Verbindungsversuch ist fehlgeschlagen, da die Gegenstelle nach einer bestimmten Zeitspanne nicht richtig reagiert hat, oder die hergestellte Verbindung war fehlerhaft, da der verbundene Host nicht reagiert hat.
19:16:23:WU00:FS00:Connecting to assign1.foldingathome.org:80
19:16:24:WARNING:WU00:FS00:Failed to get assignment from 'assign1.foldingathome.org:80': No WUs available for this configuration
19:16:24:WU00:FS00:Connecting to assign2.foldingathome.org:80
19:16:24:WARNING:WU00:FS00:Failed to get assignment from 'assign2.foldingathome.org:80': No WUs available for this configuration
19:16:24:WU00:FS00:Connecting to assign3.foldingathome.org:80
19:16:25:WARNING:WU00:FS00:Failed to get assignment from 'assign3.foldingathome.org:80': No WUs available for this configuration
19:16:25:WU00:FS00:Connecting to assign4.foldingathome.org:80
19:16:25:WARNING:WU00:FS00:Failed to get assignment from 'assign4.foldingathome.org:80': No WUs available for this configuration
19:16:25:ERROR:WU00:FS00:Exception: Could not get an assignment
******************************* Date: 2020-10-27 *******************************
19:19:01:WU00:FS00:Connecting to assign1.foldingathome.org:80
19:19:02:WARNING:WU00:FS00:Failed to get assignment from 'assign1.foldingathome.org:80': No WUs available for this configuration
19:19:02:WU00:FS00:Connecting to assign2.foldingathome.org:80
19:19:03:WARNING:WU00:FS00:Failed to get assignment from 'assign2.foldingathome.org:80': No WUs available for this configuration
19:19:03:WU00:FS00:Connecting to assign3.foldingathome.org:80
19:19:04:WARNING:WU00:FS00:Failed to get assignment from 'assign3.foldingathome.org:80': No WUs available for this configuration
19:19:04:WU00:FS00:Connecting to assign4.foldingathome.org:80
19:19:04:WARNING:WU00:FS00:Failed to get assignment from 'assign4.foldingathome.org:80': No WUs available for this configuration
19:19:04:ERROR:WU00:FS00:Exception: Could not get an assignment
19:23:16:WU00:FS00:Connecting to assign1.foldingathome.org:80
19:23:17:WARNING:WU00:FS00:Failed to get assignment from 'assign1.foldingathome.org:80': No WUs available for this configuration
19:23:17:WU00:FS00:Connecting to assign2.foldingathome.org:80
19:23:17:WARNING:WU00:FS00:Failed to get assignment from 'assign2.foldingathome.org:80': No WUs available for this configuration
19:23:17:WU00:FS00:Connecting to assign3.foldingathome.org:80
19:23:18:WARNING:WU00:FS00:Failed to get assignment from 'assign3.foldingathome.org:80': No WUs available for this configuration
19:23:18:WU00:FS00:Connecting to assign4.foldingathome.org:80
19:23:19:WARNING:WU00:FS00:Failed to get assignment from 'assign4.foldingathome.org:80': No WUs available for this configuration
19:23:19:ERROR:WU00:FS00:Exception: Could not get an assignment
19:30:06:WU00:FS00:Connecting to assign1.foldingathome.org:80
19:30:06:WARNING:WU00:FS00:Failed to get assignment from 'assign1.foldingathome.org:80': No WUs available for this configuration
19:30:06:WU00:FS00:Connecting to assign2.foldingathome.org:80
19:30:07:WU00:FS00:Assigned to work server 69.94.66.7
19:30:07:WU00:FS00:Requesting new work unit for slot 00: READY cpu:15 from 69.94.66.7
19:30:07:WU00:FS00:Connecting to 69.94.66.7:8080
19:30:07:ERROR:WU00:FS00:Exception: Server did not assign work unit

I think that the issue will disappear in a few hours, and I´ll receive WUs again, but it is kind of frustrating to have the CPU slot empty and "wasting" my HW capacity.

If someone got any further tips for me I´m open for all suggestions!
BR Jakre

[aetch]

Yeah, same here.
I think we're just in a lull for work units just now.
I'm pretty sure the good peoples at FAH will put a few more projects on the fire for us to burn through.

[gs60]

Hello,

It's a normal part of the process. We are just in a lull at the moment. One the bright side, with the cpu free, the wu's assigned to the gpu tend to fold faster (at least that's the way it works for me). This is from this forums main home page:

The Folding@home team know about the work unit shortage.
It's happening because of an approximately 20x increase in demand.
The Folding@home team are working on it and hope to have a solution very soon.
Keep your machines running, they will eventually fold on their own.

[Hopfgeist]

[...]

Code: Select all

19:30:07:ERROR:WU00:FS00:Exception: Server did not assign work unit

I think that the issue will disappear in a few hours, and I´ll receive WUs again, but it is kind of frustrating to have the CPU slot empty and "wasting" my HW capacity.

If someone got any further tips for me I´m open for all suggestions!
BR Jakre

I have had this problem for a while now, occasionally one of my machines has to wait, sometimes a few minutes, sometimes a few hours, not a big deal, but fairly constant currently. I don't expect it to go away very soon. Not until a couple of new projects are approved, which will happen in its own time. Better to make sure they are set up properly rather than rush them and have to redo it all.

The nature of the FaH work is that for each Run/Clone in each Project, work units are sequential (the "Gen" parameter), so each one depends on completion of the previous, and new ones become available as old ones are finished and accepted and the new snapshot of all atoms' positions and momenta transferred from the accepting to the assigning server. Details are probably highly non-trivial, and it is amazing that it works as well as it does.

Hello,

It's a normal part of the process. We are just in a lull at the moment. One the bright side, with the cpu free, the wu's assigned to the gpu tend to fold faster (at least that's the way it works for me). This is from this forums main home page:

The Folding@home team know about the work unit shortage.
It's happening because of an approximately 20x increase in demand.
The Folding@home team are working on it and hope to have a solution very soon.
Keep your machines running, they will eventually fold on their own.

This "20x increase" was near the beginning of the pandemic, which was more than half a year ago, so this message (which I can't seem to find anywhere: what's the "forum's main home page?) is old.

Projects have come and gone since, so that cannot really be the reason for the current WU shortage.

Cheers,
HG

[aetch]

Actually, it's not the incomers that's the current problem.
About a week or so ago we finished the latest Moonshot Sprint.
Up to that point we had been seeing work units numbering in the 1,600,000 to 2,500,000, maybe higher, I'm not sure.
Last week they dropped as low as 500,000.
https://apps.foldingathome.org/serverstats

EDIT: Folding Forum landing page prior to index with "20x quote" https://foldingforum.org/

[Hopfgeist]

Actually, it's not the incomers that's the current problem.
About a week or so ago we finished the latest Moonshot Sprint.
Up to that point we had been seeing work units numbering in the 1,600,000 to 2,500,000, maybe higher, I'm not sure.
Last week they dropped as low as 500,000.
https://apps.foldingathome.org/serverstats

EDIT: Folding Forum landing page prior to index with "20x quote" https://foldingforum.org/

Weren't the moonshot projects GPU only? Is there another reason why there is a shortage of CPU work units?

Cheers,
HG

[gs60]

Hello,

This is the main forum entry point where the messages are posted https://foldingforum.org/ They may be a little out of date but the sentiment is the same. I suspect we'll all be knee deep in cpu wu's again soon as new projects are generated. I also suspect with the ltt folding month contest going on, https://linustechtips.com/main/topic/12 ... onth-2020/ many machines that aren't normally folding have been brought into the contest/event? My cpu:10 is ready for some action!

[aetch]

Hokay, a little statistics.

This is only for the processor of the Ryzen system in my sig for a period of roughly 4 months.

Period:- 20-Jun to 24-Oct

No. Projects No. WUs
Cancer:- 4 13
Unspecified:- 30 210
Covid-19:- 134 2182 (196 units were connected to moonshot but were not moonshot themselves - projects 14377, 14379 and 14383)
Totals 168 2405

[bruce]

The moonshot sprints have been a screening process on GPUs. There are lots of suggested proteins but only some are worthy of additional study. The screening process checks where the suggested protein binds on the virus spike so there's a lot of similarity between the processing, including some hidden sites.

Once the good proteins are separated from the useless ones, a more detailed analysis needs to be performed. Additional screening is perfromed, but setting up a more conventional FAH analysis on those those individual proteins takes additional scientific work to create and then to examine the results. Meanwhile, the most promising proteins are synthesized by classical chemical techniques ... which is also a slow process.

[Joe_H]

Yes, at this point it may take a short period of time before a WU request is filled. There are probably a number of different factors causing this.

Some that I am aware of include that one COVID Moonshot has completed and the next has not yet been released. I don't know if something has been posted elsewhere than the sites I watch, so don't know when the next is going to be released. Another is that the large amount of data generated so far does need to be analyzed, and that takes researcher time. They have been working on methods of automating some of this analysis, but that is still in the beginning phase. Some of this analysis will lead to more work.

Other factors - active users may have dropped from the peak of about 20x bure still at 5x what it was at the beginning of March. But the processing power represented has not dropped as much as that would imply. On the server side, some of the additional ones provided through arrangements with cloud service providers have gone as those agreements have ended. But new servers have been acquired and are in the process of being configured for use.

Finally, there is academics. Some of the grad students active in the first months of the COVID response are in the process of finishing up their degrees and becoming less active in creating new work. At the same time new students starting this Fall are being brought up to speed on getting research started and getting projects readied.

So how much these and other factors contribute to the shortages in assignable WUs at times I can't determine. But there are many possible factors that may have aligned at this point.

[Colonel_Klink]

I had the same problem with my Ryzen 3900x with one CPU slot configured for 21 cores. The problem - no WU's available for that configuration - started about 10 days ago. Restarting, changing FAHClient from 7.13 etc had no impact for me, just as it had no impact for others.

I reconfigured the system by changing to three 6 core CPU slots the day before yesterday, and they have all been busy since the reconfiguration. I have noticed that they are almost exclusively processing non Covid related WU's. So there is meaningful work out there, just not for CPUs configured for large numbers of Cores.

[Neil-B]

There are few cpu projects at the moment and iirc one of them is limited to 10 or less cores due to size so that may be why smaller slots are getting used more consistently than larger ones

[bruce]

Configuring for 21 CPUs is a bad idea. FAHCore_a7 has trouble with all numbers which contain 7 as a factor. I would configure it for 18 or configure two slots with smaller numbers adding up to 21 such as 9 + 12.