Estimate personal share on overall compute power in FAH
Moderators: Site Moderators, FAHC Science Team
-
- Posts: 79
- Joined: Fri May 29, 2020 4:10 pm
Estimate personal share on overall compute power in FAH
Guess that question has been discussed before, however could not find that information.
I would be interested to estimate the part of compute power I'm contributing to the project. However all attempts have severe uncertainties. Taking the PPD and comparing it to the overall PPD (as published on EOC for example) has the influence of quick return bonus, as a result fast hardware will indicate to high, slow hardware to low share. Part of completed WUs probably is also misleading, as CPU WUs seem to finish much faster on my system than GPU WUs and in general the compute power requirements differ widely over the WUs. Base points per day I could not find published, furthermore I don't know statistics which show base points completed instead of PPD.
So in my case the estimate ranges from 1/5000 of compute power (200WU/d compared to a total somewhat above 1MWU/d in total) to 1/3000 (11MPPD compared to about 30GPPD in total). The PPD based calculation does not properly take into account the compute power supplied by clients without passkey.
Is there a better way of estimation?
This calculations however, even in the weaker case of 1/5000 of total power, lead to some interesting commercial considerations. If I roughly estimate my expenses for hardware in the range of EUR 7000, then the hardware value for providing the compute power of FAH is about 35M EUR. That seems quite cheap compared to supercomputers providing the same performance. That of course works only in case of workloads that can be divided in the way FAH does.
I would be interested to estimate the part of compute power I'm contributing to the project. However all attempts have severe uncertainties. Taking the PPD and comparing it to the overall PPD (as published on EOC for example) has the influence of quick return bonus, as a result fast hardware will indicate to high, slow hardware to low share. Part of completed WUs probably is also misleading, as CPU WUs seem to finish much faster on my system than GPU WUs and in general the compute power requirements differ widely over the WUs. Base points per day I could not find published, furthermore I don't know statistics which show base points completed instead of PPD.
So in my case the estimate ranges from 1/5000 of compute power (200WU/d compared to a total somewhat above 1MWU/d in total) to 1/3000 (11MPPD compared to about 30GPPD in total). The PPD based calculation does not properly take into account the compute power supplied by clients without passkey.
Is there a better way of estimation?
This calculations however, even in the weaker case of 1/5000 of total power, lead to some interesting commercial considerations. If I roughly estimate my expenses for hardware in the range of EUR 7000, then the hardware value for providing the compute power of FAH is about 35M EUR. That seems quite cheap compared to supercomputers providing the same performance. That of course works only in case of workloads that can be divided in the way FAH does.
-
- Posts: 59
- Joined: Tue Apr 07, 2020 8:53 pm
Re: Estimate personal share on overall compute power in FAH
I am actually working on that, and I am currently using base_credit as the basis of actual work performed.
Re: Estimate personal share on overall compute power in FAH
For these considerations, ultimately, I think that we will have to take the power consomption into account? Wouldn't it be a good "investment" to integrate in the client some secure ways to monitor the effective power consomption? This would flow into the stats and be freely available to the folders, possibly with some "official" FAH declaration.
If it works, it would provide a solid basis for folders to optimize their systems' efficiency and their FAH-related acquisitions (computers and/or power production hardware like PV panels), and negotiate subsidies, tax-deductions, and special tarifs with their local state authorities and/or power producers.
If it works, it would provide a solid basis for folders to optimize their systems' efficiency and their FAH-related acquisitions (computers and/or power production hardware like PV panels), and negotiate subsidies, tax-deductions, and special tarifs with their local state authorities and/or power producers.
-
- Posts: 1996
- Joined: Sun Mar 22, 2020 5:52 pm
- Hardware configuration: 1: 2x Xeon [email protected], 512GB DDR4 LRDIMM, SSD Raid, Win10 Ent 20H2, Quadro K420 1GB, FAH 7.6.21
2: Xeon [email protected], 32GB DDR4, NVME, Win10 Pro 20H2, Quadro M1000M 2GB, FAH 7.6.21 (actually have two of these)
3: [email protected], 12GB DDR3, SSD, Win10 Pro 20H2, GTX 750Ti 2GB, GTX 1080Ti 11GB, FAH 7.6.21 - Location: UK
Re: Estimate personal share on overall compute power in FAH
In the big scheme of things I am contribution about 0% - but I am quite proud of the statistically insignificant amount I am doing and will continue to do it
2x Xeon E5-2697v3, 512GB DDR4 LRDIMM, SSD Raid, W10-Ent, Quadro K420
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070
(Green/Bold = Active)
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070
(Green/Bold = Active)
-
- Site Moderator
- Posts: 6986
- Joined: Wed Dec 23, 2009 9:33 am
- Hardware configuration: V7.6.21 -> Multi-purpose 24/7
Windows 10 64-bit
CPU:2/3/4/6 -> Intel i7-6700K
GPU:1 -> Nvidia GTX 1080 Ti
§
Retired:
2x Nvidia GTX 1070
Nvidia GTX 675M
Nvidia GTX 660 Ti
Nvidia GTX 650 SC
Nvidia GTX 260 896 MB SOC
Nvidia 9600GT 1 GB OC
Nvidia 9500M GS
Nvidia 8800GTS 320 MB
Intel Core i7-860
Intel Core i7-3840QM
Intel i3-3240
Intel Core 2 Duo E8200
Intel Core 2 Duo E6550
Intel Core 2 Duo T8300
Intel Pentium E5500
Intel Pentium E5400 - Location: Land Of The Long White Cloud
- Contact:
Re: Estimate personal share on overall compute power in FAH
You're not alone and there are some thoughts around it... however, let's see what happens since Nvidia (and potentially AMD) GPUs might get that feature before the CPUs do: https://github.com/FoldingAtHome/fah-issues/issues/1554ajm wrote:...I think that we will have to take the power consomption into account? Wouldn't it be a good "investment" to integrate in the client some secure ways to monitor the effective power consomption? This would flow into the stats and be freely available to the folders, possibly with some "official" FAH declaration...
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time
Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time
Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
-
- Posts: 59
- Joined: Tue Apr 07, 2020 8:53 pm
Re: Estimate personal share on overall compute power in FAH
It's all connected Although I have higher hopes in getting nice(r) absolute contribution numbers (relative to FLOPS or similar), than reliable power.
But logging/reporting what the GPU drivers give us by default is a very good start!
But logging/reporting what the GPU drivers give us by default is a very good start!
Re: Estimate personal share on overall compute power in FAH
It's a trick problem figuring out a good number. Especially as crazy folks like me and others are running 5+gpus at home. A weighted daily/weekly/monthly producer dashboard might be useful in that.
It's especially problematic to factor in users such as myself with 5 GPUs running mostly 24/7 at hone with 3.2 billion points already logged and ranking 250 overall.
It's especially problematic to factor in users such as myself with 5 GPUs running mostly 24/7 at hone with 3.2 billion points already logged and ranking 250 overall.
Re: Estimate personal share on overall compute power in FAH
You'll have to account for a couple of things,
one being: System downtime. Not always having a fast and stable system, means consistent PPD. Sometimes the system is waiting for WUs.
Another being that CPU WUs generally are smaller in size, and quicker to finish, than GPU WUs. So you can't count on 'finished WUs' either.
Third, People upgrading. Perhaps once they spent years running WUs on older hardware (GTX series GPUs), and now will be buying an RTX 3000 GPU, that will basically get the same PPD in a tenth to a hundredth (or even 1/1000th) the time.
Fourth, core optimizations. We've gone through a few core optimizations. Whatever ran on older hardware, has been upgraded, to further make use of newer hardware feats; faster folding (both on CPU as GPU).
Considering the amount of WUs completed, and the amount of PPD distributed, even the highest folders with billions of PPDs, won't see anything more than 0.001% as their contribution.
There are about ~+250k teams, and some teams make more points per day, than even the fastest users do per entire year.
one being: System downtime. Not always having a fast and stable system, means consistent PPD. Sometimes the system is waiting for WUs.
Another being that CPU WUs generally are smaller in size, and quicker to finish, than GPU WUs. So you can't count on 'finished WUs' either.
Third, People upgrading. Perhaps once they spent years running WUs on older hardware (GTX series GPUs), and now will be buying an RTX 3000 GPU, that will basically get the same PPD in a tenth to a hundredth (or even 1/1000th) the time.
Fourth, core optimizations. We've gone through a few core optimizations. Whatever ran on older hardware, has been upgraded, to further make use of newer hardware feats; faster folding (both on CPU as GPU).
Considering the amount of WUs completed, and the amount of PPD distributed, even the highest folders with billions of PPDs, won't see anything more than 0.001% as their contribution.
There are about ~+250k teams, and some teams make more points per day, than even the fastest users do per entire year.
-
- Posts: 79
- Joined: Fri May 29, 2020 4:10 pm
Re: Estimate personal share on overall compute power in FAH
@Neil-B Of course any contribution is good, independent of the share in the total. But this still does not exclude interest in the share in the total. I also will go on folding independent from the figure representing the share.
@MeeLee Of course there are many things influencing the share. But that does not mean there is (or might be) no way of calculating it. The way of estimating it based on numbers was my initial question/goal.
@UofM.MartinK If you have progress with your effort on absolute contribution numbers, please let me know. Would be good to get that into official statistics in addition to PPD.
@MeeLee Of course there are many things influencing the share. But that does not mean there is (or might be) no way of calculating it. The way of estimating it based on numbers was my initial question/goal.
@UofM.MartinK If you have progress with your effort on absolute contribution numbers, please let me know. Would be good to get that into official statistics in addition to PPD.
-
- Posts: 59
- Joined: Tue Apr 07, 2020 8:53 pm
Re: Estimate personal share on overall compute power in FAH
Yes, that's my goal as well. I will soon have some things to show using a preliminary study based on the "imperfect" base credit, hopefully weighted with some calibration data per project.ThWuensche wrote:@UofM.MartinK If you have progress with your effort on absolute contribution numbers, please let me know. Would be good to get that into official statistics in addition to PPD.
And I think we can spark interest within the FAH team to "properly" count or estimate "floating point operations" or something similar per project or WU. They might even have something like that already, just no time yet to publish, make an API call for it or store it in the database.
Re: Estimate personal share on overall compute power in FAH
The contribution statistic will be so small for 99.9999% of users that it will simply put people off
single 1070