Local Boot Support for DGX H200 with BCM 11

Local Boot Support for DGX H200 with BCM 11

Overview

This Knowledge Base (KB) article explains the supported method for deploying and managing a DGX H200 system using Bright Cluster Manager (BCM) 11 while booting the operating system from the node's local NVMe storage. To be managed by BCM, the node must be provisioned from a BCM-controlled software image, and local-NVMe boot is then configured on top of that. 

Requirements for local boot order

As per the BCM 11 Administrator Manual, Section 5.4.10 (Booting From The Local Hard Drive), three things must be in place :

  1. In the node BIOS, the local drive must be higher in the boot order than network boot. Otherwise the node attempts PXE regardless of the BCM setting.
  2. A working bootloader and boot record on the local disk. BCM writes the boot record when installbootrecord is enabled. The default bootloader is SYSLINUX; it can be set to GRUB, which is the usual choice on UEFI systems like the DGX H200.
  3. The provisioning interface must be changed from BOOTIF to the node's real network device name. BOOTIF is only defined inside the BCM provisioning environment; during local-disk boot that environment is not running, so a node left on BOOTIF comes up with no network and is therefore not manageable. This is the step most often missed.
The cmsh sequence, run on the head node, is:

# cmsh
% device use <dgx-node-name>
% set installbootrecord yes
% set bootloader grub
% commit

Then change the boot interface from BOOTIF to the node's real device name (find it with ip link on the node; the example below uses eth0):

% device interfaces <dgx-node-name>
% set bootif networkdevicename eth0
% commit

A reboot alone is not enough here: the boot record (and, on UEFI, the local boot entry) is written during image synchronization, not at commit time. So provision the node once more with a normal PXE / image-sync pass to write it. After that pass, with the BIOS set to prefer the local drive (point 1 above), the node boots from the local NVMe as a standalone, managed node on every subsequent boot.

Because the DGX H200 is UEFI, the exact bootloader and boot-record behavior depends on the disk and EFI-partition layout.

Verify the following after deployment using the below command outputs :

The node's real network device name (from ip link on the node); that the disk setup includes an EFI system partition on the intended local boot NVMe; and your installed DGX OS release

# cmsh

% device use <dgx-node-name>

% get disksetup


Conclusion :

BCM 11 fully supports DGX H200 local boot deployments, provided the node is first provisioned using a BCM-controlled software image.

The factory-installed DGX OS cannot be directly adopted as a managed BCM node. After provisioning, BCM can configure the system to boot from local NVMe storage while maintaining full node management, monitoring, configuration synchronization, and Kubernetes cluster participation.





    • Related Articles

    • Fix: DGX Spark Kernal Panic - OS Reinstall via System Recovery

      The Issue : Kernel Panic: VFS Unable to Mount Root FS on Unknown-Block(0,0) This error is one of the more alarming things you can encounter on a Linux-based system. When the DGX Spark throws a kernel panic with the message VFS: Unable to mount root ...
    • Fix: Installation Errors for Unsloth Studio on DGX Spark (ARM64)

      Problem: When installing Unsloth Studio on DGX Spark systems, the default installation process may fail or lead to ModuleNotFoundError during startup. This is primarily due to the ARM64 (aarch64) architecture of the DGX Spark, which can cause certain ...
    • What is Boot Process in Linux OS.

      Boot Process in Linux OS. Have you ever wondered what happens behind the scenes from the time you press the power button until the Linux login prompt appears? Press the power button on your system, and after few moments you see the Linux login ...
    • How to trigger a Support Bundle on NetApp Appliance

      Purpose This article provides the steps to collect and trigger a full support bundle on a NetApp Storage Appliance. Support Bundles are used to collect diagnostics data for troubleshooting performance, connectivity, or I/O issues. Steps Login to the ...
    • How to create a Support ticket for Ruijie devices

      Create an account for Ruijie support Go t following site for Ruijie support https://www.ruijienetworks.com/support Create an account or log in to the existing account for vendor support Support center Go to Support page Click on Case Portal d Select ...
    • Popular Articles

    • CP Plus Camera and NVR Configuration

      NVR Configuration The CP Plus Pro Series of NVRs have been meticulously designed for providing you with upgraded performance and higher recording quality in your IP video surveillance solution. The robust processor that has been inculcated in this ...
    • Kerberos Authentication – Overview

      What is Kerberos? Kerberos is a secure authentication method used in our Active Directory (AD) environment (mbuzztech.com). It allows users to: Access multiple systems without re-entering passwords (Single Sign-On – SSO) Log in once Where We Use It ...
    • How to Remove and Reinstall NVIDIA Drivers on Ubuntu

      This article provides step by step guide to completely remove existing NVIDIA drivers and reinstall specific version of the NVIDIA driver on the Ubuntu system Prerequisites Administrative (sudo) access to the Ubuntu system. Internet access to ...
    • Personal Computers and Servers - Classification and Point of Contact

      We can classify the computers that MBUZZ handles based on their form-factor as below: Tower Workstations, Desktops, Gaming PCs and SFF (Small form factor) PCs fall under this category. These are computers people would use on a desk and rarely move. ...
    • M.2 SSD Tier List

      The sequential read and write speeds, which are usually the most advertised number, are not a proper benchmark of real-world performance or the quality of an SSD. This article categorizes and tiers SSDs based on factors like the type of NAND flash, ...