Need advise for server farm

If you're new to FAH and need help getting started or you have very basic questions, start here.

Moderators: Site Moderators, FAHC Science Team

mark5365
Posts: 14
Joined: Wed May 01, 2013 12:27 am

Need advise for server farm

Post by mark5365 »

I would like to start off with saying thank you for taking the time to read this post, especially if you have some advise for me.
What i have is a 5 poweredge 2950 given to me working with a sick cabinet setup for this project. I want to make sure we can get the most out of them if im going to pay the power bill and upkeep them myself. I think im going to load all 5 with WinServer 2012. I have been folding on my main office server for about a 1 or more years on the old client and just realized that their is a new client out. I have been playing with it on one of the servers i have already loaded. Im looking for some advise on how to do this to save time, i am very busy and need to be fast with deployment. Should i run VMware client? just run 1 client on each server? Can i manage all of this from 1 console when everything is setup?
What is the best, most efective way?

Thank you again
Mark
PantherX
Site Moderator
Posts: 6986
Joined: Wed Dec 23, 2009 9:33 am
Hardware configuration: V7.6.21 -> Multi-purpose 24/7
Windows 10 64-bit
CPU:2/3/4/6 -> Intel i7-6700K
GPU:1 -> Nvidia GTX 1080 Ti
§
Retired:
2x Nvidia GTX 1070
Nvidia GTX 675M
Nvidia GTX 660 Ti
Nvidia GTX 650 SC
Nvidia GTX 260 896 MB SOC
Nvidia 9600GT 1 GB OC
Nvidia 9500M GS
Nvidia 8800GTS 320 MB

Intel Core i7-860
Intel Core i7-3840QM
Intel i3-3240
Intel Core 2 Duo E8200
Intel Core 2 Duo E6550
Intel Core 2 Duo T8300
Intel Pentium E5500
Intel Pentium E5400
Location: Land Of The Long White Cloud
Contact:

Re: Need advise for server farm

Post by PantherX »

Welcome to the F@H Forum mark5365,

If those systems are dedicated, then this is what I would do:
1) Install Linux 64-bit version of your choice (no need to pay extra when a free alternative is available)
2) Setup FAHClient to use all available CPU in each system (clustering doesn't work)
3) On your monitoring system (can be laptop, desktop, etc), you can install FAHControl and then configure the servers such that all clients can be monitored from a single location. If done properly, you can monitor FAHClient across different OS with out any issues.

VMWare client will give less performance than a native client. Moreover, currently, SMP WUs are faster on Linux when compared to Windows. However, this can change with a new FahCore is released (this isn't very frequent).
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time

Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Need advise for server farm

Post by bruce »

You said you were going to run WinServer 2012. PantherX recommended Linux. Either one will work. You have to decide if there's a strong reason why you want one or the other, but I would base that choice on whatever else you might want to do with those machines. [If they're to be use ONLY for FAH, then Linux is the right choice, as PantherX suggests.]
mark5365
Posts: 14
Joined: Wed May 01, 2013 12:27 am

Re: Need advise for server farm

Post by mark5365 »

I really want to use Server 2012 so i can play with them while they are Folding. I have very little linux knowledge and would take more time than i have to setup. I will be loading them today and setting up remote access to each.
So i guess i should ask what the best way to fold with them in windows environment would be. I can run single client on them for now.
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Need advise for server farm

Post by bruce »

Running a single client on Windows Server 2012 is a fine alternative. It can use as many threads (CPUs) as you allocate to it and will also fold on recent model GPUs if you choose to install them. On the CPUs, it runs at an extremely low priority which yields resources to whatever else runs on the hardware but will use as much as 100% when other tasks are idle, although the default is to leave one CPU for other tasks. That's probably the only adjustment you MIGHT want to make.
PantherX
Site Moderator
Posts: 6986
Joined: Wed Dec 23, 2009 9:33 am
Hardware configuration: V7.6.21 -> Multi-purpose 24/7
Windows 10 64-bit
CPU:2/3/4/6 -> Intel i7-6700K
GPU:1 -> Nvidia GTX 1080 Ti
§
Retired:
2x Nvidia GTX 1070
Nvidia GTX 675M
Nvidia GTX 660 Ti
Nvidia GTX 650 SC
Nvidia GTX 260 896 MB SOC
Nvidia 9600GT 1 GB OC
Nvidia 9500M GS
Nvidia 8800GTS 320 MB

Intel Core i7-860
Intel Core i7-3840QM
Intel i3-3240
Intel Core 2 Duo E8200
Intel Core 2 Duo E6550
Intel Core 2 Duo T8300
Intel Pentium E5500
Intel Pentium E5400
Location: Land Of The Long White Cloud
Contact:

Re: Need advise for server farm

Post by PantherX »

If you plan to use the servers as a test lab, than do note that SMP will run as fast as the slowest thread. That means that if you have 8 CPUs, and you have set-up SMP:8 plus are running tasks which require about 10% of the CPU, the SMP will be severely effected in a negative way. In this case, it would be better to run as SMP:7 or SMP:6 (depending on how much resources your other tasks would require). Thus, if you could tell us the number of CPUs, we might be able to offer some suggestions to optimize your F@H contributions based on your needs.

Do note that setting up F@H in Ubuntu 12.10 64-bit is a task that can be accomplished completely via the GUI in under 5 minutes. I am not a Linux expert and found it very easy to do so. Having said that, you could have a Linux VM that is running in a Windows environment and still get higher PPD when compared to native Windows but less than native Linux. However, this is more dependent of the hardware in use so YMMV. If lack of time is a concern, you can always set-up in Windows native environment and experiment with VMs whenever you have the chance to do so, if you're still interested.
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time

Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
mark5365
Posts: 14
Joined: Wed May 01, 2013 12:27 am

Re: Need advise for server farm

Post by mark5365 »

What i like about the idea of using VMware is i can pause the VMbox when playing with the servers. I can also save their state when i restart and allocate the power easier. A few years back when i was big into overclocking i found out about F@H i was running a VMware with a pre 4 core setup i got from OCN. i cant remember what the name was, but that would be ideal. Do you guys have any links to VMware save thats already setup for 4-8 cores? I have just installed the Os on the servers and running updates as we speak.
mark5365
Posts: 14
Joined: Wed May 01, 2013 12:27 am

Re: Need advise for server farm

Post by mark5365 »

- Update -

So i only have 3 of the 5 poweredge servers up each with 2 x duel core xeons with 8gb ram running F@H v7.3.6 @100%. Also have my main poweredge 2x Quad xeon running @ 30%. The other 2 units have issues to im going to replace it with a proliant with 4x 6 core optron's with 32gb ram :). I have the server just need the c19 power cords ><. Im going to try to get 3 more of thouse in the next few months, ill keep you guys in the loop. I wounder how many points this will give me?
Zagen30
Posts: 823
Joined: Tue Mar 25, 2008 12:45 am
Hardware configuration: Core i7 3770K @3.5 GHz (not folding), 8 GB DDR3 @2133 MHz, 2xGTX 780 @1215 MHz, Windows 7 Pro 64-bit running 7.3.6 w/ 1xSMP, 2xGPU

4P E5-4650 @3.1 GHz, 64 GB DDR3 @1333MHz, Ubuntu Desktop 13.10 64-bit

Re: Need advise for server farm

Post by Zagen30 »

Kind of hard to speculate on PPD without knowing what generation chips those are. The 2x2 cores won't be terribly effective. If you run bigadv units on the 4x6 core, which requires you to run Linux, that should put out a couple hundred thousand PPD.
Image
PantherX
Site Moderator
Posts: 6986
Joined: Wed Dec 23, 2009 9:33 am
Hardware configuration: V7.6.21 -> Multi-purpose 24/7
Windows 10 64-bit
CPU:2/3/4/6 -> Intel i7-6700K
GPU:1 -> Nvidia GTX 1080 Ti
§
Retired:
2x Nvidia GTX 1070
Nvidia GTX 675M
Nvidia GTX 660 Ti
Nvidia GTX 650 SC
Nvidia GTX 260 896 MB SOC
Nvidia 9600GT 1 GB OC
Nvidia 9500M GS
Nvidia 8800GTS 320 MB

Intel Core i7-860
Intel Core i7-3840QM
Intel i3-3240
Intel Core 2 Duo E8200
Intel Core 2 Duo E6550
Intel Core 2 Duo T8300
Intel Pentium E5500
Intel Pentium E5400
Location: Land Of The Long White Cloud
Contact:

Re: Need advise for server farm

Post by PantherX »

Just make sure that you are using a passkey (http://folding.stanford.edu/English/FAQ-passkey) so that once qualified, you will be getting quick return bonus points.
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time

Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
P5-133XL
Posts: 2948
Joined: Sun Dec 02, 2007 4:36 am
Hardware configuration: Machine #1:

Intel Q9450; 2x2GB=8GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460; Windows Server 2008 X64 (SP1).

Machine #2:

Intel Q6600; 2x2GB=4GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460 video card; Windows 7 X64.

Machine 3:

Dell Dimension 8400, 3.2GHz P4 4x512GB Ram, Video card GTX 460, Windows 7 X32

I am currently folding just on the 5x GTX 460's for aprox. 70K PPD
Location: Salem. OR USA

Re: Need advise for server farm

Post by P5-133XL »

Zagen30 wrote:If you run bigadv units on the 4x6 core, which requires you to run Linux, that should put out a couple hundred thousand PPD.
Without knowing the specifics of the chips, you do not even know if it will even come close to completing bigadv's in time.
Image
mark5365
Posts: 14
Joined: Wed May 01, 2013 12:27 am

Re: Need advise for server farm

Post by mark5365 »

P5-133XL wrote:
Zagen30 wrote:If you run bigadv units on the 4x6 core, which requires you to run Linux, that should put out a couple hundred thousand PPD.
Without knowing the specifics of the chips, you do not even know if it will even come close to completing bigadv's in time.
What dose that mean?
mark5365
Posts: 14
Joined: Wed May 01, 2013 12:27 am

Re: Need advise for server farm

Post by mark5365 »

PantherX wrote:Just make sure that you are using a passkey (http://folding.stanford.edu/English/FAQ-passkey) so that once qualified, you will be getting quick return bonus points.
Thank you Panther. I have just setup a passkey, i didnt even know if that was important.
Zagen30
Posts: 823
Joined: Tue Mar 25, 2008 12:45 am
Hardware configuration: Core i7 3770K @3.5 GHz (not folding), 8 GB DDR3 @2133 MHz, 2xGTX 780 @1215 MHz, Windows 7 Pro 64-bit running 7.3.6 w/ 1xSMP, 2xGPU

4P E5-4650 @3.1 GHz, 64 GB DDR3 @1333MHz, Ubuntu Desktop 13.10 64-bit

Re: Need advise for server farm

Post by Zagen30 »

P5-133XL wrote:Without knowing the specifics of the chips, you do not even know if it will even come close to completing bigadv's in time.
The oldest hexacore Opterons are the from Istanbul line. A number of people over at EVGA have put together those rigs, and they've been able to make the deadlines on 8101 with some of the slower hexacores in the series, no overclocking (don't think anyone's made a custom BIOS for Socket F mobos anyway). There's enough headroom that even the slowest ones should make the deadlines.

I will clarify my PPD estimate, however. On some of the slower hexacores one would see closer to 100-120k PPD on 8101, which I wouldn't classify as "a couple hundred thousand." That estimate would probably be more accurate on the other 810x projects.
Image
P5-133XL
Posts: 2948
Joined: Sun Dec 02, 2007 4:36 am
Hardware configuration: Machine #1:

Intel Q9450; 2x2GB=8GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460; Windows Server 2008 X64 (SP1).

Machine #2:

Intel Q6600; 2x2GB=4GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460 video card; Windows 7 X64.

Machine 3:

Dell Dimension 8400, 3.2GHz P4 4x512GB Ram, Video card GTX 460, Windows 7 X32

I am currently folding just on the 5x GTX 460's for aprox. 70K PPD
Location: Salem. OR USA

Re: Need advise for server farm

Post by P5-133XL »

mark5365 wrote:
P5-133XL wrote:
Zagen30 wrote:If you run bigadv units on the 4x6 core, which requires you to run Linux, that should put out a couple hundred thousand PPD.
Without knowing the specifics of the chips, you do not even know if it will even come close to completing bigadv's in time.
What dose that mean?
There is a special class of SMP WU's called bigadv that give more points than standard SMP WU's. They require very high performance machines with a minimum of 16 cores and have very tight deadlines. Those deadlines are severe enough that many 4 processor machines with enough cores but using older or lower-end processors running 24x7 will still not finish them in time. So without knowing the processors used it is pure speculation as to the points you may get or even the suitability of running bigadv's.
Image
Post Reply