H100cloud.com — Dutch Auction Exchange for NVIDIA H100 GPUs | Looking for Beta Testers

edited July 10 in General

Hey LES!

We’re Thomas and Andrew, and we just built a Dutch auction exchange for cloud H100 rentals. It’s live at https://www.H100cloud.com. We're looking for feedback / beta testers :)

Auctions traditionally start at a base price and work their way up. That doesn’t work for cloud computing — would you ever want to be outbid and lose your data?

Our Dutch auction model starts at a ceiling — $3.50/hr per H100. We lower prices every six hours until servers are picked up by buyers. We stop lowering them when prices reach a $2.20 floor. If you've used Hetzner auctions before, it's just like that.

When you rent a server, the price is locked until you delete the server. You’ll never get kicked off.

It’s difficult for clouds to price well. Too low, and you’ll run out of inventory. Too high, and you won’t see adequate utilization. We hope Dutch auctions will let customers find the right balance. If H100s work out well, we'll expand into other GPU types, and maybe traditional CPU servers.

We have 224 H100s on the platform right now. We’d love for you to give it a spin & give us some feedback below! The first few hundred accounts created will have $5 in free credits deposited, enough for an hour or two of an H100. If you comment or DM me with some feedback, I'll add another $25 of account credit :)

~ Andrew

Thanked by (1)iandk

Comments

  • why would a descending orientation protect losing your data? also, why would an ascending orientation risk data? i dont get that part but kudos on the market

    Thanked by (1)zandrew
  • @mikewazar said:
    why would a descending orientation protect losing your data? also, why would an ascending orientation risk data? i dont get that part but kudos on the market

    Apologies, I should have explained that better :))

    Traditional spot instances use more of a “bid up” design. You can bid $X, and as long as you’re winning, you receive the allocation. But if someone bids $X+0.10, your workload gets interrupted.

    This is bad for the supplier and customer:

    • hosting providers earn less because fewer customers are willing to take risk of data loss so there are fewer bidders
    • customers overbid — above dedicated on-demand rates — to ensure they won’t lose data. Most customers just hope that the market price for spot instances stays below the on-demand price

    In our market, prices fall until someone claims the server. When they do, they won’t ever lose access to it, as long as they don’t delete it. When they do, the server is listed at a high price again and falls in price until someone else claims it.

    Ideally, this should lead to lower prices than if we had to price like a traditional cloud, while giving people the on-demand guarantee as opposed to a “if someone outbids you, you might lose your instance” spot scheme

  • if someone gets an allocation at $x in a traditional auction, why would they lose their allocation if someone bids higher? once allocated, its no longer in the auction pool

  • i do like the idea of matching supply to demand (if supply is a function of volume and price) but i just dont understand the above

  • edited July 11

    @mikewazar said:
    if someone gets an allocation at $x in a traditional auction, why would they lose their allocation if someone bids higher? once allocated, its no longer in the auction pool

    https://aws.amazon.com/ec2/spot/

    This is what he means. These instances can be terminated at any time.

  • Hmmmmm interesting concept. Seems more like Hetzner's server auction?
    BTW Are you the ones behind tensordock?

  • edited July 11

    Hello, just curious. Why would I choose you guys over vast.ai and on that note why not just sell through vast.ai

  • It's a white label of tensordock

  • @entrailz said:
    It's a white label of tensordock

    do you have any proof? it looks to be its own thing from what I can see.

  • @sanvit said: Seems more like Hetzner's server auction?

    Yes! It is just like Hetzner server auctions, just with more stock and the same servers :)

    @entrailz said: It's a white label of tensordock

    Yep! We are one of their hosts. They help operate the site. Pricing is the same on both sites by nature that these are the same servers. If you have a TensorDock account already, you can use our graph to track price decreases on TensorDock H100s :)

    @BruhGamer12 said: why not just sell through vast.ai

    Vast charges fees for providing the compute (25%) and also cashing out. I would much rather give a discount on our servers directly to customers than sell through Vast :)

    Also, Vast only provides Docker containers. I don't think that's as secure as KVM virtualization, and you can't run a Docker container within that :)

    Thanked by (1)BruhGamer12
Sign In or Register to comment.