Gigabyte WRX80 Motherboard and GB TR TB3 AIC difficulties
I have a WRX80 motherboard to go with my Threadripper Pro. The reason I went with this mobo, was that it actually has a thunderbolt motherboard header (giving dirty looks at Asrock!). I have a Gigabyte Titan Ridge TB3 add in card. Gigabyte TB3 card with Gigabyte motherboard, so everything should work, right? Not so much. Every time I go into BIOS and enable TB3, save settings, reboot, get to Windows and then shutdown, install the card, power on the computer, it always gives me a error code of d4 on the motherboard which is a "PCI resource allocation error. Out of resources" error. This can't be true, because the CPU has 128 PCIe lanes! And no, I don't have a million things plugged in... yet. No SATA drives; no RAID cards; etc. Just GPU and 1 nvme boot ssd.
I wrote to Gigabyte asking for guidance, but basically a month of silence (got a message finally today asking for patience due to Covid). So I thought I'd ask here for some advice.
Some things I thought of but haven't tested: I've always put the TB3 card in a "lower" slot (ie, slot # 1, 2, or 3) and the GPU's are always in higher numbered slots. Perhaps the BIOS doesn't like that, even though you can specifically specify which slot the TB3 card is inserted?
Maybe the TB3 card needs a firmware update? Not sure how to do this if the darned computer won't boot.
I've made sure everything is plugged in correctly (motherboard header, PCIe power, USB2 header).
@dregpu, Have you tried jumping the THB cable connector instead of connecting the header? Another thing to try is to enable ABOVE 4GB DECODING in the BIOS.
I haven't tried jumping the THB header. Above 4G is enabled already. There are quite a few TB options/settings in BIOS. I tried googling them, but haven't been able to really figure out which ones I should enable and which ones to disable. I did leave security to "none" or level 0, but aside from selecting the slot, I haven't changed anything else. Most things seem to be disabled. I'll have to reboot the system and take a phone pic of the BIOS menu, since the thunderbolt settings option aren't listed anywhere, including the manual!
@dregpu, the mb_manual_wrx80-su8-ipmi_0519.pdf manual says Thunderbolt options are under the PBS options (you have to scroll down below slot 7).
I think Slot 1 is meant for the GPU because a two slot GPU will remove the usability of slot 2. That's why slot 2 is only x8 lanes.
One recommendation though is to use slot 2 for the Thunderbolt card. One reason is because the Thunderbolt card is only x4 so putting it in a x8 slot only wastes 4 lanes. Not sure if wasting lanes is a problem with 7 slots though.
This video explains Thunderbolt BIOS settings:
You need secure boot enabled and you need to restart the computer after enabling Thunderbolt to see more options and you need to put the AIC in a slot specified in the BIOS settings.
@joevt, thanks for the video. I hadn’t actually seen that one. Yeah, I definitely found the bios settings. It’s just that manual doesn’t display them and there’s no information about what the settings are and what they do. I realize they’re TB3 settings and not really motherboard settings, per se. As for secure boot, there might be some kind weird incompatibility with secure boot and nvidia cards, though.
@joevt @itsage I focused on getting TB3 to work this evening and have failed. I removed all GPU's and the RAID card. Installed my crappy AMD Wx5100 single slot wonder for video out. I turned on secure boot and enabled TB3 in BIOS. The best I can do is Code 43 in Win10 while Linux can detects the TR TB3 card and even detects what kind of device (TekQ SSD; Razer Core X), but can't detect the actual device (ie, no disk volume or GPU available). I've moved the TB3 card around in different slots, all the while specifying that slot in BIOS settings. I tried messing around with a few of the esoteric settings and haven't found the right combo, as of now. Interestingly, the USB controller works just fine so it does add an extra 2 USB-c ports, which is something I suppose. Cold boot, warm boot hasn't made a difference so far. I will say that I am still using the THB header on the motherboard.
Also, as I'm sure we all know, you can disable secure boot on Mac's and TB3 will work just fine. This seems to be a pure Gigabyte issue, requiring secureboot for TB3.
@dregpu, I wouldn't short out anything - might damage something. Use a pull up or pull down resistor.
But before that, consider doing more research and tests. Check BIOS settings. What's an IPMI?