Looking for 8x 4090 Servers

loweendspirit202310

I'm in search of a GPU server for AI inference with the following specifications:

8x RTX 4090 GPUs (Need more clusters)
Bare metal SSH access
1Gbps network connection preferred
Flexible billing: week-to-week payments, cryptocurrency also accepted

crunchbits

Are you asking for 8x 4090 in a single chassis, or just 8x 4090 GPUs however deliverable?

Calin

@loweendspirit202310 said: 8x RTX 4090 GPUs (Need more clusters)

Hello , you like 6x Nvidia Tesla m10 ? per cluster? If yes we possible give you

6x Nvidia Tesla m10
32 Gb ram
2x e5-2630 v4
1 Gbs port speed
869$/month

Regards

loweendspirit202310

@crunchbits said:
Are you asking for 8x 4090 in a single chassis, or just 8x 4090 GPUs however deliverable?

8x 4090 in a single chassis preferable. We can also do 4x. We need around 24x 4090GPUs in total.

loweendspirit202310

@Calin said:

@loweendspirit202310 said: 8x RTX 4090 GPUs (Need more clusters)

Hello , you like 6x Nvidia Tesla m10 ? per cluster? If yes we possible give you

6x Nvidia Tesla m10
32 Gb ram
2x e5-2630 v4
1 Gbs port speed
869$/month

Regards

Thanks of offering. However m10 not work

crunchbits

@loweendspirit202310 said:

@crunchbits said:
Are you asking for 8x 4090 in a single chassis, or just 8x 4090 GPUs however deliverable?

8x 4090 in a single chassis preferable. We can also do 4x. We need around 24x 4090GPUs in total.

Appreciate the info. Unfortunately we're only at 2x per chassis on those. The blower style earlier models that allowed us to get 4-6x per chassis just could not maintain clocks/boost at the higher power draws. Coupled with must haves (internal requirements) on full x16 lanes and PCIe 4+ and the absolute physical unit that is the 4090 that's just as dense as I can reasonably get them here. If it works for you let me know, happy to share more info.

KenTech

vast.ai?

loweendspirit202310

@KenTech said:
vast.ai?

We prefer bare metal so the direct offer from dc is a better choice