...
A Nexus 9000 series switch being continuously monitored via SNMP may encounter the following errors when executing "show running-config" (or any of its subcommands): switch# show runnning-config API snmp_get_mgmt_conf_last_change_time return ERROR Furthermore, an error message similar to the following may be observed when attempting to save the configuration of the device with the "copy running-config startup-config" command: switch(config)# copy running-config startup-config [########################################] 99% 2020 May 18 12:18:27 switch %$ VDC-1 %$ %SYSMGR-3-CFGWRITE_SRVTIMEOUT: Service "snmpd" failed to store its configuration in the timeout period 2020 May 18 12:18:27 switch %$ VDC-1 %$ %SYSMGR-2-CFGWRITE_ABORTED: Configuration copy aborted. 2020 May 18 12:18:27 switch %$ VDC-1 %$ %SYSMGR-3-CFGWRITE_FAILED: Configuration copy failed (error-id 0x401E0045). Configuration update aborted: timed out The MTS (Message & Transaction System) receive queue buffers for the snmpd process may be full of MTS messages, which the snmpd process fails to drain: switch# show system internal mts buffers summary * recv_q: not received yet (slow receiver) * pers_q/npers_q/log_q: received not dropped (leak) node sapno recv_q pers_q npers_q log_q app/sap_description sup 5192 16384 0 0 0 snmpd/udp socket sup 1545 409 0 0 0 snmpd/SNMP Master Agent SAP Additionally, the snmpd process may crash under extended exposure to these conditions.
This issue is observed under the following conditions: 1. Nexus 9000 series switch 2. Switch is being continuously polled via SNMP, likely from an NMS (Network Management/Monitoring Station/System) for an extended amount of time (typically several days continuously)
There is no known workaround for this issue. A reload of the switch is required to recover from this failure.
The message and transaction service (MTS) is a high-performance interprocess communications (IPC) message broker that specializes in high-availability semantics. MTS handles message routing and queuing between services on and across modules and between supervisors. MTS facilitates the exchange of messages such as event notification, synchronization, and message persistency between system services and system components. In this defect, the snmpd process hangs and becomes largely unresponsive. As a result, MTS messages destined to the snmpd process are not received by the snmpd process or drained from the snmpd process's MTS receive queue buffer. Eventually, NX-OS detects that the snmpd process is no longer responsive and will attempt to restart it, generating a core file in the process.