New spec for AI work and SW development with memory intense processes

[gmconte]

Hi,

I'm considering buying a high end PC to work on AI LLM inference and maybe also training.
I did a bit of research but the PCSpecialist wizard is giving me some errors + incomplete options:

1. I can't see the NVIDIA RTX4090 in the graphic card selection even if the 5090 is about to be released (so I wonder if I have to buy it separately). Even if it weren't in stock it would still show in the list... so I wonder if there's something wrong with my setup
2. the wizard says that the RAM I selected is not compatible with the motherboard, while both the corsair website and Asus website confirm compatibility and up to 8000mhz support

Can anybody have a quick look and let me know your thoughts?
Thanks!

Here is my build:

Case
be quiet! SHADOW BASE 800 FX GAMING CASE
Processor (CPU)
Intel® Core™ i9 24-Core Processor i9-14900KS (Up to 6.2 GHz) 36MB Cache
Motherboard
ASUS® ROG MAXIMUS Z790 DARK HERO (LGA1700, DDR5, PCIe 5.0, Wi-Fi 7)
Memory (RAM)
32GB Corsair DOMINATOR TITANIUM DDR5 7200MHz (2 x 16GB) KIT
Graphics Card
INTEGRATED GRAPHICS ACCELERATOR (GPU) ---> ideally I would install an NVIDIA RTX 4090 or 5090
1st M.2 SSD Drive
1TB SAMSUNG 990 PRO M.2, PCIe 4.0 NVMe (up to 7450MB/R, 6900MB/W)
1st M.2 SSD Drive
1TB SAMSUNG 990 PRO M.2, PCIe 4.0 NVMe (up to 7450MB/R, 6900MB/W)
Power Supply
CORSAIR 1600W PRO SERIES™ TITANIUM AX1600i DIGITAL MODULAR PSU
Power Cable
1 x 1.5 Metre IEC C19 UK Power Cable
Processor Cooling
CORSAIR iCUE H150i ELITE LCD XT RGB CPU Cooler
Thermal Paste
ARCTIC MX-4 EXTREME THERMAL CONDUCTIVITY COMPOUND

 

[SpyderTracks]

1. I can't see the NVIDIA RTX4090 in the graphic card selection even if the 5090 is about to be released (so I wonder if I have to buy it separately). Even if it weren't in stock it would still show in the list... so I wonder if there's something wrong with my setup

The 4090 stopped production a while ago and stocks have gone, there won’t be any more, they’re end of life

The RAM thing is because of stability, PCS will only fit kits they’ve tested to be fully stable. As you scale up RAM quantity, the timings that are supported reduce quite significantly.

But that Intel platform is compromised anyway and wouldn’t be recommended in the first place

An AMD system would outperform it and at an equivalent cost.

 

[gmconte]

But that Intel platform is compromised anyway and wouldn’t be recommended in the first place

Hi @SpyderTracks ,
thanks for your reply. I didn't know the stock for the 4090 are already gone, so that's really useful.
I wonder what you mean by what you said about the intel platform? do you mean I would be better off with the Ryzen AI300 series?

For the graphics card, I'm trying to stick with NVidia as it's supposedly better supported and performant on AI workloads.

 

[Martinr36]

I wonder what you mean by what you said about the intel platform? do you mean I would be better off with the Ryzen AI300 series?

Intel 13th and 14th Gen confirmed defective

So there's been a lot of upset gathering steam on the inter webs with intermittent games crashes on Intel 13th and 14th gen. Workarounds range from underclocking to disabling ecores. BUT, there are a lot of people finding that simply disabling hyperthreading is a proper solution. The findings...

www.pcspecialist.co.uk

 

[SpyderTracks]

do you mean I would be better off with the Ryzen AI300 series?

If you needed it immediately an AMD desktop platform would smash Intel, and actually work long term.

The intel platform is totally broken and the chips literally melt at the core, but Intel are weak anyway with AMD far outperforming them at the same price point

Intel 13th and 14th Gen confirmed defective

So there's been a lot of upset gathering steam on the inter webs with intermittent games crashes on Intel 13th and 14th gen. Workarounds range from underclocking to disabling ecores. BUT, there are a lot of people finding that simply disabling hyperthreading is a proper solution. The findings...

www.pcspecialist.co.uk

If you can post your max budget we can offer better advice

 

[gmconte]

Hi @SpyderTracks ,
thanks for the links. Sorry I didn't reply earlier but I really appreciate your advice.
My budget was around 3K GBP but I decided to go over that to have the latest RTX with more RAM and best CUDA power to try new things with LLMs and AI. I wouldn't replace Nvidia in favour of AMD (even if it would be a lot cheaper) because it seems to me that on AI calculations it's still the best.

But I decided to follow your advice about intel.
After a long (very long) decision process, I increased some of the specs and included the MSI RTX 5090. I went over budget by quite a bit (4.7K including VAT) but I think every piece is worth and should last for a long time.

Hopefully the NVidia cable gate that affected the 40x series won't be a problem with the new 12V-2x6 cables that the 50x series comes with.

Here is the setup I ordered in the end:

Case
be quiet! SHADOW BASE 800 FX GAMING CASE
Promotional Item
Get a discount code for 20% off select peripherals at Corsair.com
Processor (CPU)
AMD Ryzen 9 9950X 16 Core CPU (4.3GHz-5.7GHz/80MB CACHE/AM5)
Motherboard
ASUS® ROG CROSSHAIR X870E HERO (AM5, DDR5, M.2 PCIe 5.0, Wi-Fi 7)
Memory (RAM)
64GB Corsair VENGEANCE DDR5 6000MHz CL40 (2 x 32GB) KIT
Graphics Card
32GB MSI GEFORCE RTX 5090 VENTUS 3X OC - HDMI, 3 x DP
1st M.2 SSD Drive
2TB SAMSUNG 990 PRO M.2, PCIe 4.0 NVMe (up to 7450MB/R, 6900MB/W)
1st M.2 SSD Drive
2TB SAMSUNG 990 PRO M.2, PCIe 4.0 NVMe (up to 7450MB/R, 6900MB/W)
Power Supply
CORSAIR 1000W RMx SERIES™ ATX 3.1, MODULAR, CYBENETICS GOLD
Power Cable
1 x 1.5 Metre UK Power Cable (Kettle Lead, 1.0mm Core)
Processor Cooling
CORSAIR ICUE LINK TITAN 360 RX RGB HIGH PERFORMANCE CPU COOLER

I joined the queue of people waiting for the 5090 supply, hopefully it won't take too long.
I think it will do the job nicely.

I only wonder if the power supply is a bit tight considering the CPU with a max drawing power of 230w and the RTX being on 575w, leaving a small room for the other components, fans and cooler.

The PCSpecialists automated calculation shows 901W and on pcpartpicker it shows 913W.
These calculations should be considering the "unrealistic" case (how unrealistic though I don't know) of all components drawing the maximum power at the same time, meaning that 1000w power supply would be more than enough.

What do you think? I would really appreciate your opinion on this.

Thanks!