KB 422345 - Fixing "Cable Data Invalid EEPROM" Error on NVIDIA QM9700 InfiniBand Switch
Issue
On NVIDIA QM9700 InfiniBand switches, some ports may appear down and show an
error such as:
This issue is often caused by outdated CPLD firmware and can be resolved by
updating the CPLD version on the switch.
Root Cause
The EEPROM error is typically due to compatibility or communication issues
between the switch and the optical cables/transceivers. A CPLD firmware update
resolves low-level hardware interface bugs related to EEPROM communication.
Solution: Update CPLD Firmware
NVIDIA Article: https://enterprise-support.nvidia.com/s/article/updateswitchcpld-for-Quantum1-Quantum2-Spectrum2-and-Spectrum3-based-Systems
Requirements
· Linux server with SSH access to the switch
·
updateswitchcpld_v3.1.tgz
CPLD update tool · Switch IP (management or IPoIB)
· Admin username and password
Step-by-Step Procedure
1. Transfer and Extract the
Update Tool
Copy
updateswitchcpld_v3.1.tgz
to your Linux host having connectivity to ib switch and extract it:tar xzf updateswitchcpld_v3.1.tgz cd updateswitchcpld_v3.1
2. Run the CPLD Update Tool
Use the following command to start the CPLD update process:
./updateswitchcpld --managed -t <SWITCH_IP> -u <ADMIN_USERNAME> -p <PASSWORD> --os mlnx-os
Example:
./updateswitchcpld --managed -t 10.152.15.55 -u admin -p <password> --os mlnx-os
· The switch will reboot during the CPLD update.
· Save configuration before
running this step.
3. OS Version Compatibility
Note
There is a known compatibility issue with MLNX-OS version 3.11.4002
when running the CPLD update script. If you are using this version:
· Upgrade temporarily to a compatible version like
3.12.1000 or 3.11.4000
· Run the CPLD update
· Revert back if needed
Switch OS Upgrade/Downgrade
Commands
show images image boot next <image_name> configuration write reload
4. Confirm CPLD Upgrade
After reboot, validate the CPLD version:updateswitchcpld --managed -t <SWITCH_IP> -u <ADMIN_USERNAME> -p <PASSWORD> --os mlnx-os --verbose --check_cpld
Post-Update
· Ensure ports previously showing “EEPROM” errors
are now active.
· Validate the cables using
ibdiagnet or the switch web UI/CLI.Related Articles
KB 471506 - How to Fetch Transceiver Details of All Ports in an InfiniBand QM9700 Switch
Overview On NVIDIA/Mellanox QM9700 InfiniBand switches, you may need to view the transceiver details (e.g., vendor, part number, and serial number) for connected optical modules or cables. This can be useful for troubleshooting, inventory tracking, ...KB 471509 - Installing Cumulus VX on Proxmox VE
This document describes how to deploy NVIDIA Cumulus VX (Cumulus Linux 5.x) on Proxmox VE using the QCOW2 disk image provided by NVIDIA. Cumulus VX allows you to simulate a Cumulus Linux switch using KVM. 1. Requirements Item Details Hypervisor ...KB 754079 - How to do a remote power cycle on NVIDIA QM9700 Switch?
1. Purpose To perform a remote reboot of NVIDIA QM9700 switch using the NVIDIA's Web GUI. If the remote reboot does not resolve any issues occurred, a physical power-cycle should be carried out onsite as per OEM recommendations. 2. Scope This MOP ...KB 638778 - Mapping mlx5_x Names to Actual InfiniBand Ports
Purpose In large GPU/AI clusters, each compute node often has multiple InfiniBand (IB) Host Channel Adapters (HCAs). On Linux, these HCAs appear as mlx5_x devices. To troubleshoot connectivity or performance issues, it is essential to map: mlx5_x ...KB 666015 - Network Switches
What is a Network Switch? A Switch is a network device that is used to segment the networks into different subnetworks called subnets or LAN segments. It is responsible for filtering and forwarding the packets between LAN segments based on the MAC ...
Recent Articles
KB-630208 | How to use Find and Locate to search for files in Linux
Purpose To provide Linux administrators and Field Engineers with guidance on using the find and locate utilities to efficiently search for files and directories within a Linux filesystem based on criteria such as name, type, size, timestamps, ...KB-630164 | How to use rsync to Synchronize Files
Purpose To provide a clear and practical procedure for using the rsync utility to synchronize files and directories between local systems and remote hosts, including push and pull operations, while preserving file attributes and optimizing data ...KB-630107 | How to create a Linux swap file
Purpose To provide Field Engineers and Linux administrators with a standardized procedure for creating, configuring, and validating a Linux swap file. This procedure helps ensure sufficient virtual memory is available when physical RAM is exhausted ...MSI All-in-One (AIO) PC – Physical Damage Policy for Warranty Claims
MSI All-in-One (AIO) PC – Physical Damage Policy for Warranty Claims MSI's standard warranty does not cover physical or accidental damage to an All-in-One (AIO) PC. If the damage is determined to be caused by external factors rather than a ...KB 134833 - Troubleshooting NVSM Alert NV-CPU-XX – Unrecoverable CPU Internal Error
Purpose This document provides a general troubleshooting procedure for the NVIDIA System Management (NVSM) alert NV-CPU-XX, which indicates that a CPU has reported an internal error. The article outlines how to verify whether the alert represents an ...
Popular Articles
CP Plus Camera and NVR Configuration
NVR Configuration The CP Plus Pro Series of NVRs have been meticulously designed for providing you with upgraded performance and higher recording quality in your IP video surveillance solution. The robust processor that has been inculcated in this ...KB 775235 - Kerberos Authentication – Overview
What is Kerberos? Kerberos is a secure authentication method used in our Active Directory (AD) environment (mbuzztech.com). It allows users to: Access multiple systems without re-entering passwords (Single Sign-On – SSO) Log in once Where We Use It ...How to Remove and Reinstall NVIDIA Drivers on Ubuntu
This article provides step by step guide to completely remove existing NVIDIA drivers and reinstall specific version of the NVIDIA driver on the Ubuntu system Prerequisites Administrative (sudo) access to the Ubuntu system. Internet access to ...KB 692001 - Personal Computers and Servers - Classification and Point of Contact
We can classify the computers that MBUZZ handles based on their form-factor as below: Tower Workstations, Desktops, Gaming PCs and SFF (Small form factor) PCs fall under this category. These are computers people would use on a desk and rarely move. ...KB 298031 - M.2 SSD Tier List
The sequential read and write speeds, which are usually the most advertised number, are not a proper benchmark of real-world performance or the quality of an SSD. This article categorizes and tiers SSDs based on factors like the type of NAND flash, ...