There is so much I don't know...

[zenkinobe]

Hi,

I am running a startup that is involved in making predictions of the future. We take data from a plethora of sources and plan to run natural language processing and machine learning to decipher insights on particular topics. We are bootstrapping (meaning, we are not looking for funding) so we don't have a big budget. I have 2 3090 GPUs on order (should be with me next month) but need to figure out a server setup to house them. They will be used to execute the AI scripts.

The trouble is, that I don't know anything about server hardware. What do I need in terms of hardware and OS? I could stretch to a 5k budget. I would need an easy to use OS and approx 3-5tb of SDD. I have no clue what I need in terms of CPU, cooling, etc.

Any help is gratefully received.

 

[SpyderTracks]

Hi,

I am running a startup that is involved in making predictions of the future. We take data from a plethora of sources and plan to run natural language processing and machine learning to decipher insights on particular topics. We are bootstrapping (meaning, we are not looking for funding) so we don't have a big budget. I have 2 3090 GPUs on order (should be with me next month) but need to figure out a server setup to house them. They will be used to execute the AI scripts.

The trouble is, that I don't know anything about server hardware. What do I need in terms of hardware and OS? I could stretch to a 5k budget. I would need an easy to use OS and approx 3-5tb of SDD. I have no clue what I need in terms of CPU, cooling, etc.

Any help is gratefully received.

PCSPECIALIST are a system integrator and sell full systems. We can only advise on PCS systems if that’s what you’re looking for?

What are the scripts or programs you use? Are they windows based or Linux?

 

[zenkinobe]

PCSPECIALIST are a system integrator and sell full systems. We can only advise on PCS systems if that’s what you’re looking for?

What are the scripts or programs you use? Are they windows based or Linux?

Yes, I have always bought from PCS and am looking to do so this time.

The scripts are python and or java script. They run on Windows today.

Thanks

 

[SpyderTracks]

This is quite a monster. I've kept RAM at 64Gb as unsure what your particular use case will be, 64Gb is a LOT. It's ECC Registered RAM as well which means it autocorrects errors on the fly which leads to more accurate outputs and any issues that crop up are heavily documented so you know exactly where the failure is. It's worth it's weight in gold at this level.

Case
COOLERMASTER MASTERBOX NR600P MID TOWER CASE
Processor (CPU)
AMD Ryzen Threadripper PRO 3975WX 32 Core CPU (3.5GHz - 4.2GHz, 144MB CACHE)
Motherboard
ASUS® Pro WS WRX80E-SAGE SE WIFI (Intel dual 10 G LAN, USB 3.2 Gen 2x2 Type-C port, SLI)
Memory (RAM)
64GB Kingston DDR4 2666MHz ECC Registered (2 x 32GB)
Graphics Card
NONE, I ALREADY HAVE A GRAPHICS CARD
1st M.2 SSD Drive
500GB SAMSUNG 980 PRO M.2, PCIe NVMe (up to 6900MB/R, 5000MB/W)
1st M.2 SSD Drive
2TB SAMSUNG 980 PRO M.2, PCIe NVMe (up to 7000MB/R, 5000MB/W)
1st M.2 SSD Drive
2TB SAMSUNG 980 PRO M.2, PCIe NVMe (up to 7000MB/R, 5000MB/W)
Power Supply
CORSAIR 1600W PRO SERIES™ TITANIUM AX1600i DIGITAL MODULAR PSU
Power Cable
1 x 1 Metre IEC C19 UK Power Cable
Processor Cooling
Corsair H150i RGB PRO XT Hydro Series High Performance CPU Cooler
Thermal Paste
STANDARD THERMAL PASTE FOR SUFFICIENT COOLING
Sound Card
ONBOARD 6 CHANNEL (5.1) HIGH DEF AUDIO (AS STANDARD)
Network Card
2 x 10 GIGABIT ETHERNET PORTS
Wireless Network Card
WIRELESS INTEL® Wi-Fi 6 AX200 (2.4 Gbps) + BT 5.0
USB/Thunderbolt Options
MIN. 2 x USB 3.0 & 2 x USB 2.0 PORTS @ BACK PANEL + MIN. 2 FRONT PORTS
Operating System
Windows 10 Professional 64 Bit - inc. Single Licence [MUP-00003]
Operating System Language
United Kingdom - English Language
Windows Recovery Media
Windows 10 Multi-Language Recovery Image - Unlimited Downloads from Online Account
Office Software
FREE 30 Day Trial of Microsoft 365® (Operating System Required)
Anti-Virus
NO ANTI-VIRUS SOFTWARE
Browser
Firefox™
Warranty
3 Year Silver Warranty (1 Year Collect & Return, 1 Year Parts, 3 Year Labour)
Delivery
STANDARD INSURED DELIVERY TO UK MAINLAND (MON-FRI)
Build Time
Standard Build - Subject to stock availability on pre-order products
Price: £4,817.00 including VAT and Delivery

Unique URL to re-configure: https://www.pcspecialist.co.uk/saved-configurations/amd-wrx80-pc/wtdYhCUZYZ/

 

[zenkinobe]

This is quite a monster. I've kept RAM at 64Gb as unsure what your particular use case will be, 64Gb is a LOT. It's ECC Registered RAM as well which means it autocorrects errors on the fly which leads to more accurate outputs and any issues that crop up are heavily documented so you know exactly where the failure is. It's worth it's weight in gold at this level.

Case
COOLERMASTER MASTERBOX NR600P MID TOWER CASE
Processor (CPU)
AMD Ryzen Threadripper PRO 3975WX 32 Core CPU (3.5GHz - 4.2GHz, 144MB CACHE)
Motherboard
ASUS® Pro WS WRX80E-SAGE SE WIFI (Intel dual 10 G LAN, USB 3.2 Gen 2x2 Type-C port, SLI)
Memory (RAM)
64GB Kingston DDR4 2666MHz ECC Registered (2 x 32GB)
Graphics Card
NONE, I ALREADY HAVE A GRAPHICS CARD
1st M.2 SSD Drive
500GB SAMSUNG 980 PRO M.2, PCIe NVMe (up to 6900MB/R, 5000MB/W)
1st M.2 SSD Drive
2TB SAMSUNG 980 PRO M.2, PCIe NVMe (up to 7000MB/R, 5000MB/W)
1st M.2 SSD Drive
2TB SAMSUNG 980 PRO M.2, PCIe NVMe (up to 7000MB/R, 5000MB/W)
Power Supply
CORSAIR 1600W PRO SERIES™ TITANIUM AX1600i DIGITAL MODULAR PSU
Power Cable
1 x 1 Metre IEC C19 UK Power Cable
Processor Cooling
Corsair H150i RGB PRO XT Hydro Series High Performance CPU Cooler
Thermal Paste
STANDARD THERMAL PASTE FOR SUFFICIENT COOLING
Sound Card
ONBOARD 6 CHANNEL (5.1) HIGH DEF AUDIO (AS STANDARD)
Network Card
2 x 10 GIGABIT ETHERNET PORTS
Wireless Network Card
WIRELESS INTEL® Wi-Fi 6 AX200 (2.4 Gbps) + BT 5.0
USB/Thunderbolt Options
MIN. 2 x USB 3.0 & 2 x USB 2.0 PORTS @ BACK PANEL + MIN. 2 FRONT PORTS
Operating System
Windows 10 Professional 64 Bit - inc. Single Licence [MUP-00003]
Operating System Language
United Kingdom - English Language
Windows Recovery Media
Windows 10 Multi-Language Recovery Image - Unlimited Downloads from Online Account
Office Software
FREE 30 Day Trial of Microsoft 365® (Operating System Required)
Anti-Virus
NO ANTI-VIRUS SOFTWARE
Browser
Firefox™
Warranty
3 Year Silver Warranty (1 Year Collect & Return, 1 Year Parts, 3 Year Labour)
Delivery
STANDARD INSURED DELIVERY TO UK MAINLAND (MON-FRI)
Build Time
Standard Build - Subject to stock availability on pre-order products
Price: £4,817.00 including VAT and Delivery

Unique URL to re-configure: https://www.pcspecialist.co.uk/saved-configurations/amd-wrx80-pc/wtdYhCUZYZ/

Thanks so.much. Will check this out.

 

[richard_pcs]

To put in my 2 cents, if you're after a rack solution the one below would be the equivalent:

Case
ASUS ESC4000A-E10 2U RACK CHASSIS
Processor (CPU)
AMD EPYC™ 7452 32 Core CPU (2.35GHz, 3.35GHz Turbo, 128MB CACHE)
Processor (CPU)
NONE
Motherboard
ASUS® KRPG-U8 (DDR4 RDIMM, iKVM)
Memory (RAM)
64GB Kingston DDR4 2666MHz ECC Registered (4 x 16GB)
Graphics Card
ASPEED INTEGRATED GRAPHICS ACCELERATOR (GPU)
1st Storage Drive
2 X 1.6TB Intel DC P4610 2.5" SSD, U.2 (up to 3200MB/sR | 2100MB/sW)
1st M.2 SSD Drive
500GB SAMSUNG 970 EVO PLUS M.2, PCIe NVMe (up to 3500MB/R, 3200MB/W)
Power Supply
ASUS REDUNDANT INTEGRATED 1600W 80+ PLATINUM POWER SUPPLY
Power Cable
1 x 1 Metre European Power Cable (Kettle Lead)
Processor Cooling
Asus Passive 2U Heatsink
Processor Cooling
Asus Passive 2U Heatsink
Thermal Paste
STANDARD THERMAL PASTE FOR SUFFICIENT COOLING
Network Card
2 x 10/100/1000 GIGABIT LAN PORTS (Wi-Fi NOT INCLUDED)
Remote Management Chip
INTEGRATED ASUS ASMB9-IKVM
Rails
Integrated Asus Friction Rail Kit
Trusted Platform Module (TPM)
NONE
Operating System
Windows 10 Professional for Workstation 64 Bit - inc. Licence (>4 Core)
Operating System Language
United Kingdom - English Language
Warranty
3 Year Silver Warranty (1 Year Collect & Return, 1 Year Parts, 3 Year Labour)
Delivery
STANDARD INSURED DELIVERY TO UK MAINLAND (MON-FRI)


Price: £6,122.00 including VAT and Delivery
Unique URL to re-configure: https://www.pcspecialist.co.uk/saved-configurations/amd-sp3-2u/dbfjqQ7t7V/

Something to note is the 3090s that you've purchased. If you're after 2 in the same system, you should really be looking at blower cards like the ASUS Turbo SKU. With the more gaming centric recirc cards, the thickness of the cooling solutions means that they're really most suitable for single GPU builds and won't fit into rack chassis at all.

 

[Scott]

A little side note for this. It's possible they haven't been tested on the server platforms but there are 4TB Corsair M2 drives available now. It would be an excellent solution for the fast storage.

Do you have a server rack already in place? As suggested, you need to be careful with the GPU selection for this kind of install. Even with a conventional case you may need to consider a riser card, the 3090s are VERY large.

 

[richard_pcs]

A little side note for this. It's possible they haven't been tested on the server platforms but there are 4TB Corsair M2 drives available now. It would be an excellent solution for the fast storage.

Do you have a server rack already in place? As suggested, you need to be careful with the GPU selection for this kind of install. Even with a conventional case you may need to consider a riser card, the 3090s are VERY large.

Very, very good point. I'll add the MP400s today to the server configs alongside the EVO drives for better flexbility.

Thanks @Scott