Stats not updating

[VijayPande]

Can you guys give links for the pages you're finding aren't working? Note the "fast team pages" are only updated for a certain number of teams.

[billford]

Dammit, I had a lovely post set up to display exactly what I meant, then when I checked the links in preview the team page had updated and was showing the correct values!

Maybe I've misunderstood- I assumed the team pages updated at the same time as the user stats, but if they only update every 24 hours then all is explained…


edit- I think cxh has just explained it

[cxh]

Hi all!

Thanks for reporting the issue with Stats page. This was associated with a failed Stats update, but should be resolved as of today. Let me know if you encounter any further problems!

Carlos

[John_Weatherman]

To explain, the stats at http://fah-web.stanford.edu/cgi-bin/main.py showed the correct work done, but when clicking on the team name and going to the team stats details webpage the amount of work done was out of date. What was really odd was clicking on a donors name and going to the donors webpage of work done and seeing that was correct!
Checking now, it's all showing the correct/same figures/work done.
Edit - Update - this is still happening ...

[billford]

I think it needs another kick:

Code: Select all

Last updated: Mon Nov 3 09:00:10 PST 2014
Mon Nov 3 17:00:10 UTC 2014

Edit- Some WUs seem to have been credited since I posted that, but maybe not all, hard to tell, and the "Last Updated time" didn't change.

Second edit- Now it has changed, fingers crossed it's OK now…

Code: Select all

Last updated: Mon Nov 3 12:33:38 PST 2014
Mon Nov 3 20:33:38 UTC 2014

[billford]

I'm assuming that it should have performed another update run at 21:00Z, as far as I can tell it didn't.

Won't be able to check if it catches up at 22:00Z, but it seems to be stuttering along at best.

[billford]

Won't be able to check if it catches up at 22:00Z

Turns out I was able to check after all, and it didn't.

"Last Updated" is unchanged but more diagnostic- so is my WU count. I gave it 40 minutes, when it's working it doesn't take more than 10 to show a change in points/WUs.

Dr Pande's code modification seems to have worked well for a while, but maybe it's time for more than Band-Aid?

[VijayPande]

yes, we are working on it and made some progress yesterday on ways to diagnose the situation. The container it's running in is running out of memory and we're looking into what's the best way to handle it. For now, if it does go down, it only misses a single stats update and cleans up on its own, which is an improvement, but not something we're happy with long term.

[billford]

For now, if it does go down, it only misses a single stats update and cleans up on its own

Unfortunately it seems that is not the case:

Code: Select all

Last updated: Wed Nov 5 22:00:02 PST 2014
Thu Nov 6 06:00:02 UTC 2014

That's on the rare occasion I can reach the page, Safari usually comes back with "Server not responding" for most stats-related pages.

When I eventually managed to download the user summary file it was empty, just the line:

Code: Select all

Thu Nov  6 02:20:02 PST 2014

and I think EOC may have the same problem- no updates for its last two runs (ie 6 hours).

Can't cross-check with Kakao, of course.

[Sn1ken]

Now it is down.

http://fah-web.stanford.edu/cgi-bin/mai ... =teamstats

[artoar_11]

http://fah-web.stanford.edu/psummary.html - "This web page is not available".

http://fah-web.stanford.edu/pybeta/serverstat.html - "This web page is not available".

[billford]

I think there may be something wrong causing problems in several areas- most things seem very slow or not accessible and all my clients are having problems uploading completed WUs and getting new ones.

They get there in the end, but only after several attempts and I've seen faster transfers on dial-up.

Hopefully there's just one problem at the bottom of it, and when it's fixed, everything gets fixed

[schwancr]

There are some network issues that are disrupting the stats pages, stats servers, and several WS's. We're aware of the problem and working on it, but stats updates will only come through sporadically until we can fix the root issue. Thank you for your patience.

[billford]

At least that explains why most of my WUs ended up being returned to a CS rather than the WS that issued them!

Thanks for the update, good luck.

[schwancr]

The network has been restored, so the servers should all be accessible again.