Product updates

DigitalOcean Bare Metal GPUs: Dedicated GPU machines for advanced AI workloads

Posted: November 21, 20243 min read
<- Back to Blog Home

Share

    Try DigitalOcean for free

    Click below to sign up and get $200 of credit to try our products over 60 days!Sign up

    For serious AI builders who need more control, more power, and less noise in your cloud infrastructure, it’s time to explore DigitalOcean Bare Metal GPUs with NVIDIA accelerated computing. These servers are purpose-built to tackle the most demanding AI/ML workloads, model training, and custom infrastructure setups. With 8 NVIDIA Hopper GPUs and powerful hardware, these servers offer high-performance compute capabilities and customization options designed for intense processing needs.

    Why DigitalOcean Bare Metal GPUs?

    DigitalOcean Bare Metal GPUs with NVIDIA accelerated computing offer dedicated, single-tenant infrastructure with no neighbors, so you have full access to all your GPUs. These servers are tailored for projects that require direct control over hardware to achieve optimal performance and privacy, and are well-suited for use cases like large-scale model training, real-time inference, and complex orchestration. With dedicated hardware you get direct access to all resources, ideal for pushing the limits of what your applications can achieve.

    “The most important thing for our company is to continue delivering a really exceptional user experience and continuing to make that even better. So that’s going to involve research and development for the models, which requires heavy duty GPU computing power that DigitalOcean provides.”

    Jacob Jackson, CEO and Founder, Supermaven

    Benefits of choosing Bare Metal GPUs

    1. Model training at scale: Tackle large datasets with ease. Bare Metal GPUs allow you to fully optimize model training, offering privacy, performance, and control over the entire process.
    2. Model fine-tuning: Start with a pre-trained model and adapt it to your specific use cases by fine-tuning with specialized datasets. Bare Metal’s high-performance GPUs and isolated environment make it possible to get the accuracy and performance needed for specialized applications.
    3. High-speed inference: With Hopper GPUs handling inference, your applications can achieve real-time performance for live predictions and decision-making—ideal for user-facing products that demand responsiveness.
    4. Custom use cases: Bare Metal GPUs are ideal for custom workloads that demand high configurability and dependable, dedicated infrastructure. Whether deploying Kubernetes clusters or custom orchestration setups, these servers provide the flexibility needed to build and scale complex architectures.

    Bare Metal GPUs vs. GPU Droplets

    Our Bare Metal GPUs and GPU Droplets are designed to suit different workloads. GPU Droplets provide easy scalability and quick provisioning, perfect for teams focused on training, fine-tuning, or running inference on LLMs. In contrast, Bare Metal GPUs deliver maximum performance and control, ideal for sustained, high-throughput workloads that demand direct access to hardware resources and customization.

    Bare Metal GPU Droplet H100 GPU Droplet H100x8
    diGPU Memory 640 GB 80 GB 640 GB
    (v)CPUs 192 20 160
    CPU Type 2 Intel® Xeon® Platinum 8468 2x Intel Xeon Platinum 8458P processors 2x Intel Xeon Platinum 8458P processors
    Network Cards 8x Mellanox Network Adapter; Mellanox Technologies MT2910 Family [ConnectX-7]; link speed 400 Gbps, 4x Mellanox Technologies MT2892 Family [ConnectX-6 Dx]; link speed 100Gps Nvidia/Mellanox ConnectX-6 2x100GE NIC Nvidia/Mellanox ConnectX-6 2x100GE NIC
    Machine Memory 2.0 TiB 240 GiB 1920 GiB
    Local Storage (Boot) 56 TB 720 GiB NVMe 2 TiB NVMe
    Local Storage (Scratch) - 5 TiB NVMe 40 TiB NVMe

    Get started

    Bare Metal GPUs with NVIDIA accelerated computing are available in New York, USA and Amsterdam, Netherlands, with more data centers coming soon.

    Share

      Try DigitalOcean for free

      Click below to sign up and get $200 of credit to try our products over 60 days!Sign up

      Related Articles

      Introducing Maintenance Mode and Restart Apps for DigitalOcean App Platform

      Introducing Maintenance Mode and Restart Apps for DigitalOcean App Platform

      VPC: Behind The Scenes

      VPC: Behind The Scenes

      DigitalOcean Expands New York Footprint: NYC2 Data Center Reopens to New Customers

      DigitalOcean Expands New York Footprint: NYC2 Data Center Reopens to New Customers