RX 580 Expresscard awful gaming performance
Does the laptop have a dGPU? If so try disabling it. Sorry can't think of much else. You might review similar builds from the database and see if you are getting similar results on the games mentioned in them. Most seem to only post the benchmarks, however.
@lwf, Yeah it has a quadro k1100, disabled it from the device manager and it didn't help. And yes surprisingly not many game benchmarks for comparable setups online, I have no clue what performance I should expect on a game by game basis.