A Look At Triple-GPU Performance And Multi-GPU Scaling, Part 1by Ryan Smith on April 3, 2011 7:00 AM EST
It’s been quite a while since we’ve looked at triple-GPU CrossFire and SLI performance – or for that matter looking at GPU scaling in-depth. While NVIDIA in particular likes to promote multi-GPU configurations as a price-practical upgrade path, such configurations are still almost always the domain of the high-end gamer. At $700 we have the recently launched GeForce GTX 590 and Radeon HD 6990, dual-GPU cards whose existence is hedged on how well games will scale across multiple GPUs. Beyond that we move into the truly exotic: triple-GPU configurations using three single-GPU cards, and quad-GPU configurations using a pair of the aforementioned dual-GPU cards. If you have the money, NVIDIA and AMD will gladly sell you upwards of $1500 in video cards to maximize your gaming performance.
These days multi-GPU scaling is a given – at least to some extent. Below the price of a single high-end card our recommendation is always going to be to get a bigger card before you get more cards, as multi-GPU scaling is rarely perfect and with equally cutting-edge games there’s often a lag between a game’s release and when a driver profile is released to enable multi-GPU scaling. Once we’re looking at the Radeon HD 6900 series or GF110-based GeForce GTX 500 series though, going faster is no longer an option, and thus we have to look at going wider.
Today we’re going to be looking at the state of GPU scaling for dual-GPU and triple-GPU configurations. While we accept that multi-GPU scaling will rarely (if ever) hit 100%, just how much performance are you getting out of that 2nd or 3rd GPU versus how much money you’ve put into it? That’s the question we’re going to try to answer today.
From the perspective of a GPU review, we find ourselves in an interesting situation in the high-end market right now. AMD and NVIDIA just finished their major pushes for this high-end generation, but the CPU market is not in sync. In January Intel launched their next-generation Sandy Bridge architecture, but unlike the past launches of Nehalem and Conroe, the high-end market has been initially passed over. For $330 we can get a Core i7 2600K and crank it up to 4GHz or more, but what we get to pair it with is lacking.
Sandy Bridge only supports a single PCIe x16 link coming from the CPU – an awesome CPU is being held back by a limited amount of off-chip connectivity; DMI and a single PCIe x16 link. For two GPUs we can split that out to x8 and x8 which shouldn’t be too bad. But what about three GPUs? With PCIe bridges we can mitigate the issue some by allowing the GPUs to talk to each other at x16 speeds and dynamically allocate CPU-to-GPU bandwidth based on need, but at the end of the day we’re splitting a single x16 lane across three GPUs.
The alternative is to take a step back and work with Nehalem and the x58 chipset. Here we have 32 PCIe lanes to work with, doubling the amount of CPU-to-GPU bandwidth, but the tradeoff is the CPU. Gulftown and Nehalm are capable chips on its own, but per-clock the Nehalem architecture is normally slower than Sandy Bridge, and neither chip can clock quite as high on average. Gulftown does offer more cores – 6 versus 4 – but very few games are held back by the number of cores. Instead the ideal configuration is to maximize performance of a few cores.
Later this year Sandy Bridge E will correct this by offering a Sandy Bridge platform with more memory channels, more PCIe lanes, and more cores; the best of both worlds. Until then it comes down to choosing from one of two platforms: a faster CPU or more PCIe bandwidth. For dual-GPU configurations this should be an easy choice, but for triple-GPU configurations it’s not quite as clear cut. For now we’re going to be looking at the latter by testing on our trusty Nehalem + x58 testbed, which largely eliminates a bandwidth bottleneck in a tradeoff for a CPU bottleneck.
Moving on, today we’ll be looking at multi-GPU performance under dual-GPU and triple-GPU configurations; quad-GPU will have to wait. Normally we only have two reference-style cards of any product on hand, so we’d like to thank Zotac and PowerColor for providing a reference-style GTX 580 and Radeon HD 6970 respectively.
Post Your CommentPlease log in or sign up to comment.
View All Comments
masterchi - Sunday, April 3, 2011 - link"Going from 1 GPU to 2 GPUs also gives AMD a minor advantage, with the average gain being 182% for NVIDIA versus 186% for AMD"
This should be 78.6 and 87.7, respectively.
Ryan Smith - Sunday, April 3, 2011 - linkTo be clear, there I'm only including the average FPS (and not the min FPS) of all the games except HAWX (CPU limited). Performance is as the numbers indicate, 182% and 186% of a single card's performance respectively.
eddman - Sunday, April 3, 2011 - linkDoesn't make sense. Are you saying that, for example, 580 SLI is 2.77 times faster than a single 580?
SagaciousFoo - Sunday, April 3, 2011 - linkThink of it this way: A single 580 card is 100% performance. Two cards equals 186% performance. So the SLI setup is 14% shy of being 2x the performance of a single card.
AnnihilatorX - Sunday, April 3, 2011 - linkThis is typical percentile jargon. It's author's miss really.
When you say 186% average gain, you mean 2.86 times the performance.
When you say 86% average gain, you mean 186% the performance, and that's what you mean.
The keyword gain there ais unecessary and misleading.
80% increase -> x 1.8
180% increase -> x 2.8
SlyNine - Sunday, April 3, 2011 - linkCorrect, it should read, 186% of (multiplication) a single card.
But I am making the assumption that gain means addition.
DaFox - Sunday, April 3, 2011 - linkThat's unfortunately how it works when it come to multi GPU scaling. Ryan is just continuing the standard trend set by everyone else in the industry.
Bremen7000 - Sunday, April 3, 2011 - linkNo, he's just using misleading wording. The chart should either read "Performance: 186%" or "Performance gain: 86%", etc. This isn't hard.
sigmatau - Monday, April 4, 2011 - linkThe OP is correct. You cannot use "gain" and include the 100% of the first card. This is simple percentages.
If I have one gallon of gas in my car and add one gallon, I gain 100%.
I also have a total of 200% of what I had at the start.
Kaboose - Sunday, April 3, 2011 - linkFinally, it has taken awhile but finally and thank you!!! Multi-monitor is exactly what we need in these reviews, especially the 6990 and 590 reviews.