PCIE4 @ x8 mode for 2nd GPU?

A forum for discussing FAH-related hardware choices and info on actual products (not speculation).

Moderator: Site Moderators

Forum rules
Please read the forum rules before posting.
Post Reply
hrsetrdr
Posts: 112
Joined: Sun Dec 02, 2007 4:29 pm
Location: In the Fold somewhere in SoCal.

PCIE4 @ x8 mode for 2nd GPU?

Post by hrsetrdr »

I'm looking to double up my FAH GPUs, 2 in one rig. My X79 board has: 3 x PCI Express 3.0 x16 slots (PCIE1 @ x16 mode; PCIE3 @ x16 mode; PCIE4 @ x8 mode).
Will the PCIE4 @ x8 mode affect PPD for the GPU installed there?
Folding rig:Supermicro X9DRD-7LN4F-JBOD | (2) Xeon E5-2670 | 128GB DDR3 ECC Registered

Image
Install Folding@Home on Linux without Python dependancy issues
MeeLee
Posts: 1339
Joined: Tue Feb 19, 2019 10:16 pm

Re: PCIE4 @ x8 mode for 2nd GPU?

Post by MeeLee »

hrsetrdr wrote: Thu Apr 28, 2022 4:15 pm I'm looking to double up my FAH GPUs, 2 in one rig. My X79 board has: 3 x PCI Express 3.0 x16 slots (PCIE1 @ x16 mode; PCIE3 @ x16 mode; PCIE4 @ x8 mode).
Will the PCIE4 @ x8 mode affect PPD for the GPU installed there?
It will. However, very minor.
Most GPUs will see a degradation at PCIE 3.0 x4, but PCIE 3.0 x8 usually runs fine (without much PPD loss; PCIE 3.0 x8 is about as fast as PCIE 4.0 x4).

So long your GPU accepts the PCIE 4.0 standard, you'll have to get something faster than an RTX 3090, to be bottlenecked by the PCIE 4.0 x8 bandwidth.
bikeaddict
Posts: 210
Joined: Sun May 03, 2020 1:20 am

Re: PCIE4 @ x8 mode for 2nd GPU?

Post by bikeaddict »

Since PCIE4 @ x8 has the same throughput as PCIE3 @ x16 (what my machines and many other folders use) it shouldn't limit the speed at all. My NVIDIA Setting app shows I'm using 1% bandwidth.
kiore
Posts: 921
Joined: Fri Jan 16, 2009 5:45 pm
Location: USA

Re: PCIE4 @ x8 mode for 2nd GPU?

Post by kiore »

bikeaddict wrote: Fri Apr 29, 2022 11:14 pm Since PCIE4 @ x8 has the same throughput as PCIE3 @ x16 (what my machines and many other folders use) it shouldn't limit the speed at all. My NVIDIA Setting app shows I'm using 1% bandwidth.
Thanks for this, was wondering if this would be the case, my experience even on PCIE 3 at 8 the difference is noticeable but not huge, I think it those populating PCIE 3 x2 slots that were used for mining that suddenly see this critical drop.
Image
i7 7800x RTX 3070 OS= win10. AMD 3700x RTX 2080ti OS= win10 .

Team page: https://www.rationalskepticism.org/viewtopic.php?t=616
hrsetrdr
Posts: 112
Joined: Sun Dec 02, 2007 4:29 pm
Location: In the Fold somewhere in SoCal.

Re: PCIE4 @ x8 mode for 2nd GPU?

Post by hrsetrdr »

MeeLee wrote: Fri Apr 29, 2022 7:35 pm
hrsetrdr wrote: Thu Apr 28, 2022 4:15 pm I'm looking to double up my FAH GPUs, 2 in one rig. My X79 board has: 3 x PCI Express 3.0 x16 slots (PCIE1 @ x16 mode; PCIE3 @ x16 mode; PCIE4 @ x8 mode).
Will the PCIE4 @ x8 mode affect PPD for the GPU installed there?
It will. However, very minor.
Most GPUs will see a degradation at PCIE 3.0 x4, but PCIE 3.0 x8 usually runs fine (without much PPD loss; PCIE 3.0 x8 is about as fast as PCIE 4.0 x4).

So long your GPU accepts the PCIE 4.0 standard, you'll have to get something faster than an RTX 3090, to be bottlenecked by the PCIE 4.0 x8 bandwidth.
bikeaddict wrote: Fri Apr 29, 2022 11:14 pm Since PCIE4 @ x8 has the same throughput as PCIE3 @ x16 (what my machines and many other folders use) it shouldn't limit the speed at all. My NVIDIA Setting app shows I'm using 1% bandwidth.
OK, thanks for defining this, if there were to be a significant impact on performance I would then have opted to run the GPUs in separate machines.
Folding rig:Supermicro X9DRD-7LN4F-JBOD | (2) Xeon E5-2670 | 128GB DDR3 ECC Registered

Image
Install Folding@Home on Linux without Python dependancy issues
Neil-B
Posts: 1996
Joined: Sun Mar 22, 2020 5:52 pm
Hardware configuration: 1: 2x Xeon [email protected], 512GB DDR4 LRDIMM, SSD Raid, Win10 Ent 20H2, Quadro K420 1GB, FAH 7.6.21
2: Xeon [email protected], 32GB DDR4, NVME, Win10 Pro 20H2, Quadro M1000M 2GB, FAH 7.6.21 (actually have two of these)
3: [email protected], 12GB DDR3, SSD, Win10 Pro 20H2, GTX 750Ti 2GB, GTX 1080Ti 11GB, FAH 7.6.21
Location: UK

Re: PCIE4 @ x8 mode for 2nd GPU?

Post by Neil-B »

The biggest issue you may have is the thermal impact ... with two gpus in case the chances are the air flow will be impacted ... one or both gpus may potentially have thermal issues - either running hot or even getting to the point of thermally throttling.

Good airflow case with lots of fans and relatively low ambient temps you shouldn't have any issues but worth monitoring ... Cluttered case with minimal fans and you may have sub-optimal experiences.
2x Xeon E5-2697v3, 512GB DDR4 LRDIMM, SSD Raid, W10-Ent, Quadro K420
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070

(Green/Bold = Active)
gunnarre
Posts: 559
Joined: Sun May 24, 2020 7:23 pm
Location: Norway

Re: PCIE4 @ x8 mode for 2nd GPU?

Post by gunnarre »

Yes, so physical spacing between the slots you're going to use on the motherboard may be important too. Even in a good case, if the cards are sandwiched together with millimeter clearance, they may be thermally throttled.
Image
Online: GTX 1660 Super + occasional CPU folding in the cold.
Offline: Radeon HD 7770, GTX 1050 Ti 4G OC, RX580
hrsetrdr
Posts: 112
Joined: Sun Dec 02, 2007 4:29 pm
Location: In the Fold somewhere in SoCal.

Re: PCIE4 @ x8 mode for 2nd GPU?

Post by hrsetrdr »

Neil-B wrote: Tue May 03, 2022 9:27 am The biggest issue you may have is the thermal impact ... with two gpus in case the chances are the air flow will be impacted ... one or both gpus may potentially have thermal issues - either running hot or even getting to the point of thermally throttling.

Good airflow case with lots of fans and relatively low ambient temps you shouldn't have any issues but worth monitoring ... Cluttered case with minimal fans and you may have sub-optimal experiences.
I was concerned, even-though my new build has all kinds of air flow the case is a mid-tower, and I'm thinking two fire breathing GPUs running 24/7 would cause an excessive heat build-up all around. So, whenever my new PSU gets here I've decided to put the RTX 3060 in with my GTX 1080, which is housed in a roomier server case.
Folding rig:Supermicro X9DRD-7LN4F-JBOD | (2) Xeon E5-2670 | 128GB DDR3 ECC Registered

Image
Install Folding@Home on Linux without Python dependancy issues
MeeLee
Posts: 1339
Joined: Tue Feb 19, 2019 10:16 pm

Re: PCIE4 @ x8 mode for 2nd GPU?

Post by MeeLee »

Neil-B wrote: Tue May 03, 2022 9:27 am The biggest issue you may have is the thermal impact ... with two gpus in case the chances are the air flow will be impacted ... one or both gpus may potentially have thermal issues - either running hot or even getting to the point of thermally throttling.

Good airflow case with lots of fans and relatively low ambient temps you shouldn't have any issues but worth monitoring ... Cluttered case with minimal fans and you may have sub-optimal experiences.
A good option is to get a high quality, 1 or 2 inch riser, that will allow the GPU to be mechanically mounted in a slot above or below the standard slot.
hrsetrdr
Posts: 112
Joined: Sun Dec 02, 2007 4:29 pm
Location: In the Fold somewhere in SoCal.

Re: PCIE4 @ x8 mode for 2nd GPU?

Post by hrsetrdr »

MeeLee wrote: Wed May 04, 2022 12:22 am
Neil-B wrote: Tue May 03, 2022 9:27 am The biggest issue you may have is the thermal impact ... with two gpus in case the chances are the air flow will be impacted ... one or both gpus may potentially have thermal issues - either running hot or even getting to the point of thermally throttling.

Good airflow case with lots of fans and relatively low ambient temps you shouldn't have any issues but worth monitoring ... Cluttered case with minimal fans and you may have sub-optimal experiences.
A good option is to get a high quality, 1 or 2 inch riser, that will allow the GPU to be mechanically mounted in a slot above or below the standard slot.
Thanks, addressing the thermal issues is my current undertaking.
Folding rig:Supermicro X9DRD-7LN4F-JBOD | (2) Xeon E5-2670 | 128GB DDR3 ECC Registered

Image
Install Folding@Home on Linux without Python dependancy issues
Post Reply