Stats servers down

[drougnor]

The flat files that are for external download and use are frozen at the 13:31 GMT update for 03/26/2022 (9:31 am, EDT). The 'live stats' page appears to be updating.

Can we get the flat files server kicked back into gear as this is keeping anyone's automated systems from being able to update in the prescribed manner?

Thanks!

d

[Joe_H]

The flat files that are for external download and use are frozen at the 13:31 GMT update for 03/26/2022 (9:31 am, EDT). The 'live stats' page appears to be updating.

Can we get the flat files server kicked back into gear as this is keeping anyone's automated systems from being able to update in the prescribed manner?

Thanks!

d

I have seen a notice that servers were in the process of being moved on cloud services in connection with passkeys not getting sent out until permissions were updated for emailing from the servers. The developer was asked if that server move was linked to these stats not updating, no response yet.

[Lazvon]

Thank you for keeping us informed.

[Kana-chan]

Hello,

I would like to know where we can post about the new API.
I would try to use it to retrieve all donors from my team, but only the 1000 first are in the list.

And/or about the flat files, is it possible to add the new user id in the team flat file?

Thanks in advance.

[aetch]

The flat files are periodic snapshots of the stats, when a new user/donor submits a work unit they are automatically added to the flat files when the next snapshot is taken.
The flat files for the teams contains - Team ID, TeamName, Point accrued (Score), Work unit returned (wu). This currently ~125,000 entries in size.
The flat files for the Donors contains - Donor's name (name), point accrued (score), work units returned (wu), team ID. This is currently ~2,600,000 entries in size.

[fz4z]

I have seen a notice that servers were in the process of being moved on cloud services in connection with passkeys not getting sent out until permissions were updated for emailing from the servers.

Is this related to the Bowman lab's move to University of Pennsylvania this summer ?
( Move the servers in WUSTL on cloud at first. )

[Joe_H]

Is this related to the Bowman lab's move to University of Pennsylvania this summer ?

As far as I know it is not related. The servers from what I can tell are ones already on cloud servers

[drougnor]

Just FYI for anyone else who tracks the flat files - We appear to be to every other hour updates now instead of hourly. However, all the data is still there, just not as frequent.

Personally, I'd prefer going back to hourly, but it does all boil down to what the project can support for attention and for processing cycles.

d

[goodyca]

What URL are you using to download the flat files? The URL at fah-web.stanford.edu is no longer found.

[Joe_H]

What URL are you using to download the flat files? The URL at fah-web.stanford.edu is no longer found.

The stanford.edu addresses have been dead for years, some had redirects to the current site. Those may have finally been removed in part or completely. Download links for the flat files can be found on the official stats front page - https://foldingathome.org/statistics/.

At one point they were updating the flat files hourly, but ran into load issues on the stats database. Initially they reduced it to every 4 hours, then after a request from the person maintaining the EOC stats increased it to every 3 hours.

[goodyca]

Thank you for the information. I had been using the old URL until it stopped working on March 27th.

[drougnor]

The four flat file addresses are (First the .bz2 compressed)
https://apps.foldingathome.org/daily_us ... ry.txt.bz2
https://apps.foldingathome.org/daily_te ... ry.txt.bz2

Or the much larger un-compressed
https://apps.foldingathome.org/daily_user_summary.txt
https://apps.foldingathome.org/daily_team_summary.txt