Share:

Honey, I shrunk the GPU Superserver! Or 6-GPU eGPU success  

  RSS

mcarver316
(@mcarver316)
Estimable Member
Joined: 2 years ago
Posts: 133
June 6, 2017 12:07 pm  

This is a placeholder post for proof of concept, testing eGPU limitations via Thunderbolt 3.

TL;DR:

- Save your money and buy the right components

- You will not be able to spend less than $1000 once you cross the single GPU eGPU territory

- Buy a laptop with an unlocked BIOS, or can be flashed with one - it's the only way to completely get rid of error code 12

- There is no benefit to having more than one GPU for gaming due to Thunderbolt bandwidth limitation

- No SLI

- Despite the above, for hash decryption at least, a Thunderbolt eGPU can go toe to toe against a traditional server, due to GPU optimization and less reliance on number of PCIe lanes and bandwidth.

- The Cubix is only 1/3 larger than the Aki Node

- You can stuff a 2 double wide slot Cubix with 3 full size GPUs (one 1080, two 1080 Ti) with room to spare for Aki Node controller board

IMG 2813
IMG 2808

 

UPDATE 01: Bill of Lading

DIY Multi-eGPU enclosure: $1162.00

---

Aki Node: $299

Aki T3: $272

Cubix PCIE cable: $19

Cubix: $594

Caldigit 6ft Thunderbolt cable: $59 (now jacked to $109!)

The GPUs: $1832

1080 Ti: $650 each

1080: $532

Host machine: $2018

MSI GT73VR dual 1070

BIOS unlock: $20

Total eGPU w/ GPUs: $2,975

Total with laptop: $5,052

2015 17" MSI GT73VR-6RF 2xGTX1070 + [email protected] (AKiTiO Node driving Cubix Chassis) + Win10 > 365Gigahashes per second


Koohyaar, wimpzilla, goalque and 5 people liked
Quote
Flint Ironstag
(@flint-ironstag)
Estimable Member
Joined: 2 years ago
Posts: 166
June 6, 2017 6:15 pm  

Nice work.  There's definitely a market for multiple GPU enclosures.  Price needs to come down a bit.

MP 6,1 | 4c | d700
MP 6,1 | 6c | d500


ReplyQuote
lifecom
(@lifecom)
Eminent Member
Joined: 2 years ago
Posts: 27
June 7, 2017 9:33 am  

I think you can use this adapter instead akitio board and host-card... It can be more universal

Onle i-pass PCIe cable is needed, like this

Pending: Add my system information and expected eGPU configuration to my signature to give context to my posts


ReplyQuote
mcarver316
(@mcarver316)
Estimable Member
Joined: 2 years ago
Posts: 133
June 7, 2017 9:45 am  
Posted by: lifecom

I think you can use this adapter instead akitio board and host-card... It can be more universal

Onle i-pass PCIe cable is needed, like this

This guy?

IMG 2846

2015 17" MSI GT73VR-6RF 2xGTX1070 + [email protected] (AKiTiO Node driving Cubix Chassis) + Win10 > 365Gigahashes per second


ReplyQuote
lifecom
(@lifecom)
Eminent Member
Joined: 2 years ago
Posts: 27
June 7, 2017 12:24 pm  
Posted by: mcarver316

This guy?

No. This x8-to-x8 cable. If you use Sonnet adapter, you'll need x4-to-x8 cable.

x8-side to Cubix and x4-side to Sonnet adapter.

PCIe cables 448x298

Pending: Add my system information and expected eGPU configuration to my signature to give context to my posts


ReplyQuote
mcarver316
(@mcarver316)
Estimable Member
Joined: 2 years ago
Posts: 133
June 7, 2017 12:39 pm  
Posted by: lifecom

No. This x8-to-x8 cable. If you use Sonnet adapter, you'll need x4-to-x8 cable.

x8-side to Cubix and x4-side to Sonnet adapter.

PCIe cables 448x298

Now I get it - thanks!

IMG 2853

 

 

2015 17" MSI GT73VR-6RF 2xGTX1070 + [email protected] (AKiTiO Node driving Cubix Chassis) + Win10 > 365Gigahashes per second


ReplyQuote
mcarver316
(@mcarver316)
Estimable Member
Joined: 2 years ago
Posts: 133

ReplyQuote
mcarver316
(@mcarver316)
Estimable Member
Joined: 2 years ago
Posts: 133
June 7, 2017 1:03 pm  
Posted by: lifecom

I think you can use this adapter instead akitio board and host-card... It can be more universal

Onle i-pass PCIe cable is needed, like this

By the way, I did order a Sonnet SE 1 before, which should have the TI83* controller, but unfortunately, did not work with the Cubix.

That was when my laptop BIOS was still locked however. I will try your recommendation once the Sonnet DX adapter becomes officially sold by Amazon (for free return shipping if it doesn't work).

*TI83 is necessary for devices not officially certified to work with Thunderbolt.

2015 17" MSI GT73VR-6RF 2xGTX1070 + [email protected] (AKiTiO Node driving Cubix Chassis) + Win10 > 365Gigahashes per second


ReplyQuote
lifecom
(@lifecom)
Eminent Member
Joined: 2 years ago
Posts: 27
June 7, 2017 1:30 pm  
Posted by: mcarver316

I will try your recommendation once the Sonnet DX adapter becomes officially sold by Amazon (for free return shipping if it doesn't work).

One clarification: it's a TB2

Pending: Add my system information and expected eGPU configuration to my signature to give context to my posts


ReplyQuote
mcarver316
(@mcarver316)
Estimable Member
Joined: 2 years ago
Posts: 133
June 7, 2017 1:42 pm  
Posted by: lifecom
Posted by: mcarver316

I will try your recommendation once the Sonnet DX adapter becomes officially sold by Amazon (for free return shipping if it doesn't work).

One clarification: it's a TB2

Needs an adapter for the adapter- Lol

At least until a TB3 version comes out.

2015 17" MSI GT73VR-6RF 2xGTX1070 + [email protected] (AKiTiO Node driving Cubix Chassis) + Win10 > 365Gigahashes per second


ReplyQuote
lifecom
(@lifecom)
Eminent Member
Joined: 2 years ago
Posts: 27
June 7, 2017 2:19 pm  

Best solution; connect host-card directly to motherboard )

Pending: Add my system information and expected eGPU configuration to my signature to give context to my posts


ReplyQuote
mcarver316
(@mcarver316)
Estimable Member
Joined: 2 years ago
Posts: 133
June 7, 2017 2:35 pm  
Posted by: lifecom

Best solution; connect host-card directly to motherboard )

Yes, agree and already did that- built an itty bitty Mini-ITX desktop only an inch or two bigger than a Gigabyte Brix. Then installed the Cubix PCI host card in the ITX PCIE slot.

I'm building the eGPU for a team scenario. Each member only needs a laptop with Thunderbolt port to connect to the eGPU chassis. The eGPU can be passed around and each team member is only responsible for maintaining his or her own laptop and preferred GPUs.

2015 17" MSI GT73VR-6RF 2xGTX1070 + [email protected] (AKiTiO Node driving Cubix Chassis) + Win10 > 365Gigahashes per second


ReplyQuote
wimpzilla
(@wimpzilla)
Reputable Member
Joined: 2 years ago
Posts: 463
June 7, 2017 4:38 pm  

Awesome job, congrats!

You slowly getting what you looked for.

Can you daisy chain, add, more than one of these beast?

2012 13-inch Dell Latitude E6320 + R9 [email protected] (EXP GDC 8.4) + Win10
E=Mc²


ReplyQuote
mcarver316
(@mcarver316)
Estimable Member
Joined: 2 years ago
Posts: 133
June 7, 2017 5:09 pm  
Posted by: wimpzilla

Awesome job, congrats!

You slowly getting what you looked for.

Can you daisy chain, add, more than one of these beast?

I've daisy chained the Cubix and the Node through Aki T3. Yes, it works.

If I ever come across a second bargain Cubix, I'll try it.

The true limit is the available PCIE addresses in the BIOS. Many of them are already assigned, including the internal discrete GPUs, M.2 slots, Wifi, etc.

Windows 10 is also pretty bad at initially allocating available address on newly added cards, often hijacking another address already taken by another GPU.

2015 17" MSI GT73VR-6RF 2xGTX1070 + [email protected] (AKiTiO Node driving Cubix Chassis) + Win10 > 365Gigahashes per second


ReplyQuote