Launching soon: The world's first vendor agnostic bug scrubLearn more & join waitlist
OPERATIONAL DEFECT DATABASE
...
...
A nexus 9k will leak memory when running SNMP OID MIB walk on IFMIB, leading to an eventually reload due to a kernel panic. A kernel core will not be written. The following logs will be shown: 2015 Sep 29 20:17:06 Core-199-B %$ VDC-1 %$ %PLATFORM-2-MEMORY_ALERT: Memory Status Alert : CRITICAL. Usage 91% of Available Memory 2015 Sep 29 20:17:15 Core-199-B %$ VDC-1 %$ %PLATFORM-2-MEMORY_ALERT_RECOVERED: Memory Status Alert : CRITICAL ALERT RECOVERED 2015 Sep 29 20:17:16 Core-199-B %$ VDC-1 %$ %PLATFORM-2-MEMORY_ALERT: Memory Status Alert : SEVERE. Usage 91% of Available Memory 2015 Sep 29 23:17:07 Core-199-B %$ VDC-1 %$ %PLATFORM-2-MEMORY_ALERT: Memory Status Alert : CRITICAL. Usage 91% of Available Memory 2015 Oct 1 04:11:04 Core-199-B %$ VDC-1 %$ Oct 1 04:11:04 %KERN-0-SYSTEM_MSG: [982247.800000] [1443690664] Kernel panic - not syncing: Out of memory: system-wide panic_on_oom is enabled - kernel 2015 Oct 1 04:11:04 Core-199-B %$ VDC-1 %$ Oct 1 04:11:04 %KERN-0-SYSTEM_MSG: [982247.800001] [1443690664] - kernel 2015 Oct 1 04:11:10 Core-199-B %$ VDC-1 %$ Oct 1 04:11:09 %KERN-0-SYSTEM_MSG: [982249.398446] [1443690665] Dumping interrupt statistics ? kernel
A nexus 9k will leak memory when running SNMP OID MIB walk on IFMIB, leading to an eventually reload due to a kernel panic. A kernel core will not be written. The following logs will be shown: 2015 Sep 29 20:17:06 N9K-1 %$ VDC-1 %$ %PLATFORM-2-MEMORY_ALERT: Memory Status Alert : CRITICAL. Usage 91% of Available Memory 2015 Sep 29 20:17:15 N9K-1 %$ VDC-1 %$ %PLATFORM-2-MEMORY_ALERT_RECOVERED: Memory Status Alert : CRITICAL ALERT RECOVERED 2015 Sep 29 20:17:16 N9K-1 %$ VDC-1 %$ %PLATFORM-2-MEMORY_ALERT: Memory Status Alert : SEVERE. Usage 91% of Available Memory 2015 Sep 29 23:17:07 N9K-1 %$ VDC-1 %$ %PLATFORM-2-MEMORY_ALERT: Memory Status Alert : CRITICAL. Usage 91% of Available Memory 2015 Oct 1 04:11:04 N9K-1 %$ VDC-1 %$ Oct 1 04:11:04 %KERN-0-SYSTEM_MSG: [982247.800000] [1443690664] Kernel panic - not syncing: Out of memory: system-wide panic_on_oom is enabled - kernel 2015 Oct 1 04:11:04 N9K-1 %$ VDC-1 %$ Oct 1 04:11:04 %KERN-0-SYSTEM_MSG: [982247.800001] [1443690664] - kernel 2015 Oct 1 04:11:10 N9K-1 %$ VDC-1 %$ Oct 1 04:11:09 %KERN-0-SYSTEM_MSG: [982249.398446] [1443690665] Dumping interrupt statistics ? kernel
SNMP is enabled and MIB walk for IFMIB is done frequently. The extent of the leak depends on how frequently IFMIB is being polled.
Disable SNMP on the switch no snmp-server protocol enable or you can disable just polling of IFMIB, but continue with other SNMP functions (like SNMP traps) and do not execute any bash CLIs. To be safe bash access can also be disabled using: no feature bash (if feature bash is enabled)
Fix for this is present in 7.0(3)I2(1a). Both N9K and Nexus 3K running 7.0(3)I2(1) are affected. Only this specific release 7.0(3)I2(1) is affected. No other release prior to this version or after, is affected.