Estimate personal share on overall compute power in FAH

Moderators: Site Moderators, FAHC Science Team

Post Reply
ThWuensche
Posts: 79
Joined: Fri May 29, 2020 4:10 pm

Estimate personal share on overall compute power in FAH

Post by ThWuensche »

Guess that question has been discussed before, however could not find that information.

I would be interested to estimate the part of compute power I'm contributing to the project. However all attempts have severe uncertainties. Taking the PPD and comparing it to the overall PPD (as published on EOC for example) has the influence of quick return bonus, as a result fast hardware will indicate to high, slow hardware to low share. Part of completed WUs probably is also misleading, as CPU WUs seem to finish much faster on my system than GPU WUs and in general the compute power requirements differ widely over the WUs. Base points per day I could not find published, furthermore I don't know statistics which show base points completed instead of PPD.

So in my case the estimate ranges from 1/5000 of compute power (200WU/d compared to a total somewhat above 1MWU/d in total) to 1/3000 (11MPPD compared to about 30GPPD in total). The PPD based calculation does not properly take into account the compute power supplied by clients without passkey.

Is there a better way of estimation?

This calculations however, even in the weaker case of 1/5000 of total power, lead to some interesting commercial considerations. If I roughly estimate my expenses for hardware in the range of EUR 7000, then the hardware value for providing the compute power of FAH is about 35M EUR. That seems quite cheap compared to supercomputers providing the same performance. That of course works only in case of workloads that can be divided in the way FAH does.
UofM.MartinK
Posts: 59
Joined: Tue Apr 07, 2020 8:53 pm

Re: Estimate personal share on overall compute power in FAH

Post by UofM.MartinK »

I am actually working on that, and I am currently using base_credit as the basis of actual work performed.
ajm
Posts: 750
Joined: Sat Mar 21, 2020 5:22 am
Location: Lucerne, Switzerland

Re: Estimate personal share on overall compute power in FAH

Post by ajm »

For these considerations, ultimately, I think that we will have to take the power consomption into account? Wouldn't it be a good "investment" to integrate in the client some secure ways to monitor the effective power consomption? This would flow into the stats and be freely available to the folders, possibly with some "official" FAH declaration.

If it works, it would provide a solid basis for folders to optimize their systems' efficiency and their FAH-related acquisitions (computers and/or power production hardware like PV panels), and negotiate subsidies, tax-deductions, and special tarifs with their local state authorities and/or power producers.
Neil-B
Posts: 1996
Joined: Sun Mar 22, 2020 5:52 pm
Hardware configuration: 1: 2x Xeon [email protected], 512GB DDR4 LRDIMM, SSD Raid, Win10 Ent 20H2, Quadro K420 1GB, FAH 7.6.21
2: Xeon [email protected], 32GB DDR4, NVME, Win10 Pro 20H2, Quadro M1000M 2GB, FAH 7.6.21 (actually have two of these)
3: [email protected], 12GB DDR3, SSD, Win10 Pro 20H2, GTX 750Ti 2GB, GTX 1080Ti 11GB, FAH 7.6.21
Location: UK

Re: Estimate personal share on overall compute power in FAH

Post by Neil-B »

In the big scheme of things I am contribution about 0% - but I am quite proud of the statistically insignificant amount I am doing and will continue to do it :)
2x Xeon E5-2697v3, 512GB DDR4 LRDIMM, SSD Raid, W10-Ent, Quadro K420
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070

(Green/Bold = Active)
PantherX
Site Moderator
Posts: 6986
Joined: Wed Dec 23, 2009 9:33 am
Hardware configuration: V7.6.21 -> Multi-purpose 24/7
Windows 10 64-bit
CPU:2/3/4/6 -> Intel i7-6700K
GPU:1 -> Nvidia GTX 1080 Ti
§
Retired:
2x Nvidia GTX 1070
Nvidia GTX 675M
Nvidia GTX 660 Ti
Nvidia GTX 650 SC
Nvidia GTX 260 896 MB SOC
Nvidia 9600GT 1 GB OC
Nvidia 9500M GS
Nvidia 8800GTS 320 MB

Intel Core i7-860
Intel Core i7-3840QM
Intel i3-3240
Intel Core 2 Duo E8200
Intel Core 2 Duo E6550
Intel Core 2 Duo T8300
Intel Pentium E5500
Intel Pentium E5400
Location: Land Of The Long White Cloud
Contact:

Re: Estimate personal share on overall compute power in FAH

Post by PantherX »

ajm wrote:...I think that we will have to take the power consomption into account? Wouldn't it be a good "investment" to integrate in the client some secure ways to monitor the effective power consomption? This would flow into the stats and be freely available to the folders, possibly with some "official" FAH declaration...
You're not alone and there are some thoughts around it... however, let's see what happens since Nvidia (and potentially AMD) GPUs might get that feature before the CPUs do: https://github.com/FoldingAtHome/fah-issues/issues/1554
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time

Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
UofM.MartinK
Posts: 59
Joined: Tue Apr 07, 2020 8:53 pm

Re: Estimate personal share on overall compute power in FAH

Post by UofM.MartinK »

It's all connected :) Although I have higher hopes in getting nice(r) absolute contribution numbers (relative to FLOPS or similar), than reliable power.

But logging/reporting what the GPU drivers give us by default is a very good start!
ipkh
Posts: 173
Joined: Thu Jul 16, 2015 2:03 pm

Re: Estimate personal share on overall compute power in FAH

Post by ipkh »

It's a trick problem figuring out a good number. Especially as crazy folks like me and others are running 5+gpus at home. A weighted daily/weekly/monthly producer dashboard might be useful in that.
It's especially problematic to factor in users such as myself with 5 GPUs running mostly 24/7 at hone with 3.2 billion points already logged and ranking 250 overall.
MeeLee
Posts: 1339
Joined: Tue Feb 19, 2019 10:16 pm

Re: Estimate personal share on overall compute power in FAH

Post by MeeLee »

You'll have to account for a couple of things,
one being: System downtime. Not always having a fast and stable system, means consistent PPD. Sometimes the system is waiting for WUs.
Another being that CPU WUs generally are smaller in size, and quicker to finish, than GPU WUs. So you can't count on 'finished WUs' either.
Third, People upgrading. Perhaps once they spent years running WUs on older hardware (GTX series GPUs), and now will be buying an RTX 3000 GPU, that will basically get the same PPD in a tenth to a hundredth (or even 1/1000th) the time.
Fourth, core optimizations. We've gone through a few core optimizations. Whatever ran on older hardware, has been upgraded, to further make use of newer hardware feats; faster folding (both on CPU as GPU).

Considering the amount of WUs completed, and the amount of PPD distributed, even the highest folders with billions of PPDs, won't see anything more than 0.001% as their contribution.
There are about ~+250k teams, and some teams make more points per day, than even the fastest users do per entire year.
ThWuensche
Posts: 79
Joined: Fri May 29, 2020 4:10 pm

Re: Estimate personal share on overall compute power in FAH

Post by ThWuensche »

@Neil-B Of course any contribution is good, independent of the share in the total. But this still does not exclude interest in the share in the total. I also will go on folding independent from the figure representing the share.

@MeeLee Of course there are many things influencing the share. But that does not mean there is (or might be) no way of calculating it. The way of estimating it based on numbers was my initial question/goal.

@UofM.MartinK If you have progress with your effort on absolute contribution numbers, please let me know. Would be good to get that into official statistics in addition to PPD.
UofM.MartinK
Posts: 59
Joined: Tue Apr 07, 2020 8:53 pm

Re: Estimate personal share on overall compute power in FAH

Post by UofM.MartinK »

ThWuensche wrote:@UofM.MartinK If you have progress with your effort on absolute contribution numbers, please let me know. Would be good to get that into official statistics in addition to PPD.
Yes, that's my goal as well. I will soon have some things to show using a preliminary study based on the "imperfect" base credit, hopefully weighted with some calibration data per project.

And I think we can spark interest within the FAH team to "properly" count or estimate "floating point operations" or something similar per project or WU. They might even have something like that already, just no time yet to publish, make an API call for it or store it in the database.
HaloJones
Posts: 906
Joined: Thu Jul 24, 2008 10:16 am

Re: Estimate personal share on overall compute power in FAH

Post by HaloJones »

The contribution statistic will be so small for 99.9999% of users that it will simply put people off
single 1070

Image
Post Reply