Page 1 of 6
It's getting better now, isn't it?
Posted: Mon Mar 30, 2020 8:24 am
by ajm
Is it just me or are the servers becoming smoother, at last? I'm reaching some 50% of my Total Estimated Points Per Day! And most of the time all my ressources are now used.
The servers stats are now constantly over 100,000 jobs per hour:
https://apps.foldingathome.org/serverstats - kudos to LTT (I suppose) for their linus1 server!
Feels great!
Re: It's getting better now, isn't it?
Posted: Mon Mar 30, 2020 8:37 am
by JimboPalmer
I was up to 1/2 expected PPD, late last week, back to 1/4 now. When researchers get back Monday I am optimistic more resources will get online.
As to how well they are doing, look at this graph, click on Weekly and Users Active
https://folding.extremeoverclocking.com ... ary.php?s=
That is impressive!
Re: It's getting better now, isn't it?
Posted: Mon Mar 30, 2020 9:06 am
by ajm
Yay!
Re: It's getting better now, isn't it?
Posted: Mon Mar 30, 2020 9:42 am
by WTS
It seems to be better here, although I do have to reboot now and then to get a work unit or two.
But, may I ask, are the scientists learning anything from the huge increase in computing power, and how long
will it take to get the information into the hands of the researchers that need the information? It'd be nice to
know how forward we're moving in solving this. Is F@H regular work also progressing faster? Thanks!
Re: It's getting better now, isn't it?
Posted: Mon Mar 30, 2020 11:00 am
by Neil-B
I expect we will get some form of News announcement as/when the team have a chance to do one - but I expect resource is focused at resolving the server throughput challenges ... I would expect the knowledge is already filtering out to the researchers as this is I believe shaping the directions and scale of the new projects - which are spawning fast and furious at the moment (keeping the volunteer beta testers well busy).
Given the current pandemic work is being given priority in the queues and as I understanding the issues are not lack of WUs but more lack of ability to farm out quick enough to keep all the expanded community busy I believe that for the most part it is Covid related WUs being released ... Some regular work may well be getting out at the moment and once expansion of
throughput on the servers is resolved then I expect that as long as regular science WUs are being generated they will get folded.
(Brain wanders off at a tangent)
I wish it were possible to "solve" Covid ... I am simply hoping that all the myriad efforts inc FAH, and lifestyle changes, and shifts in societal behaviours can get us to the point where a new normal can be established that doesn't require vast groups of people to be isolated and where enough has been learned that ways of living develop and sustain that addresses some of the deep seated causes of the pandemic (and I don't mean the virus itself).
Re: It's getting better now, isn't it?
Posted: Mon Mar 30, 2020 11:46 am
by Vester
I am getting plenty of work, but my backlog of uploading jobs is twenty at this time. FAH has used more than 20GB of bandwidth in the past few days trying to upload work units. Most fail repeatedly at 40% to 99% uploaded. If the servers would limit their number of simultaneous connections, the throughput would improve.
Re: It's getting better now, isn't it?
Posted: Mon Mar 30, 2020 3:42 pm
by Frogging101
Vester wrote:I am getting plenty of work, but my backlog of uploading jobs is twenty at this time. FAH has used more than 20GB of bandwidth in the past few days trying to upload work units. Most fail repeatedly at 40% to 99% uploaded. If the servers would limit their number of simultaneous connections, the throughput would improve.
Possibly. But I imagine that to some extent, it's just the sheer volume of incoming requests. It's like a friendly DDoS attack. Even if the server were configured to ignore half of the requests directed at it, all of those incoming packets are still filling up the "pipe".
I have never been involved with operating a server that deals with any significant amount of traffic, but I would be surprised if mitigating something like this were as simple as limiting the number of connections.
Re: It's getting better now, isn't it?
Posted: Mon Mar 30, 2020 3:46 pm
by Neil-B
It iisn't !!
Re: It's getting better now, isn't it?
Posted: Mon Mar 30, 2020 4:02 pm
by bruce
There are periods of server-overload and gaps where work can be downloaded or uploaded and I think the gaps are becoming more plentiful.
It's still a supply_and_demand issue. FAH has dramatically increased supply and concurrently I suppose demand has backed off. It's hard to measure the relative significance of either one based on looking at the status of my clients a few times a day and I don't closely monitor my points like ajm did in his second post.
I would be surprised if mitigating something like this were as simple as limiting the number of connections.
When the bandwidth limiters kick in, you get the message "No WUs available for this configuration" but you get exactly the same message when there's something wrong with your configuration or the servers really have run out of a class of WUs.
My impression is that downloading has improved somewhat but reduced congestion there (if that's what happened) has allowed us to see congestion on back-end systems ... like the points DB.
Re: It's getting better now, isn't it?
Posted: Mon Mar 30, 2020 4:35 pm
by ajm
Hum, my second post doesn't show my points. It's the Aggregate Teams Summary, with a view of FAH's total daily points in the course of last month.
EDIT: And it shows - that was the point - that the upwards progression has been accelerating these last days.
Re: It's getting better now, isn't it?
Posted: Mon Mar 30, 2020 9:27 pm
by fernandg
It's been a lot better within the past two to three days compared to last week.
Re: It's getting better now, isn't it?
Posted: Mon Mar 30, 2020 10:34 pm
by IkkeDus
It's getting better in the sense of getting work, less idle time, BUT I do see a problem with uploading the results ("Server responded PLEASE_WAIT") which is not good for the PPD as well.
Although it is likely worse if the results are not getting uploaded at all (in time)...
Re: It's getting better now, isn't it?
Posted: Tue Mar 31, 2020 6:23 am
by ajm
Browsing my logs, I see that the upload to 13.90.152.57 was often slow to very slow lately.
37.187.12.48 was fast.
13.82.98.119 was fast.
140.163.4.231 was ok.
Is that kind of feedback useful?
Re: It's getting better now, isn't it?
Posted: Tue Mar 31, 2020 1:28 pm
by WTS
Help!!! F@H is getting spoofed badly. Here are the details: <
https://www.proofpoint.com/us/threat-in ... l-campaign>
Re: It's getting better now, isn't it?
Posted: Tue Mar 31, 2020 1:54 pm
by ajm
Well, there's not much FAH can do. And, don't worry, if you're here, you have chosen the real one.