Symptoms

After configuring IPMI on the cluster, you are unable to reach the IPMI interface, from the cluster you cannot ping the gateway and if you run: # ipmitool lan print 1 The output shows that you do not have a configured gateway.

Cause

The IPMI network interface is disabled on one or more nodes in the cluster.

Resolution

To enable the interface and configure IPMI, you must run the following commands. In this example, we are using the 192.168.1.0/24 network: 1. Reset the ipmi interface and clear any configuration that you may have created. # isi_for_array -sX "ipmitool raw 0x30 0x52 0x52 0x53 0x54 0x1" # isi_for_array -sX "ipmitool mc reset cold" # isi ipmi network modify --delete-config -f # isi ipmi settings modify --enabled=false -f 2. Check the IPMI interface state for the cluster. # isi_for_array -sX "ipmitool raw 0x30 0x7d 0x1" If all the nodes respond with "01", you can move on to step 3. If any node responds to that command with "00", run the following command on that node: # ipmitool raw 0x30 0x7c 0x1 0x1 0x1 If there are multiple nodes showing "00", you can use isi_for_array to run that command. Re-run # isi_for_array -sX "ipmitool raw 0x30 0x7d 0x1" And confirm all nodes return a "01" response.3. Enable IPMI using the isi ipmi command: # isi ipmi settings modify --enabled=True --allocation-type=static You are about to modify the global remote IPMI settings. Are you sure? (yes/[no]): yes # isi ipmi network modify --add-ranges=192.168.X.X-192.168.X.X --gateway=192.168.X.X --prefixlen=24 You are about to modify the remote IPMI network settings. Are you sure? (yes/[no]): yes 4. Confirm that the nodes get addresses # isi ipmi nodes list Lnn IP Addr Remote Ipmi Capable -------------------------------------------- 1 XXX.XXX.X.X Yes 2 XXX.XXX.X.X Yes 3 XXX.XXX.X.X Yes 4 XXX.XXX.X.X Yes -------------------------------------------- Total: 4 NOTE: It can take several minutes for addresses to be assigned, and you may see the same address assigned multiple times. Be patient and continue to check until flexnet has settled the configuration. 5. Confirm that the information for your node is configured using the ipmitool command and confirm that the gateway is set: # ipmitool lan print 1 Set in Progress : Set Complete Auth Type Support : Auth Type Enable : Callback : : User : : Operator : : Admin : : OEM : IP Address Source : Static Address IP Address : XXX.XXX.X.X Subnet Mask : 255.255.255.0 MAC Address : xx:xx:xx:xx:xx:xx SNMP Community String : public IP Header : TTL=0x40 Flags=0x40 Precedence=0x00 TOS=0x10 Default Gateway IP : XXX.XXX.X.X Default Gateway MAC : 00:00:00:00:00:00 Backup Gateway IP : 0.0.0.0 Backup Gateway MAC : 00:00:00:00:00:00 802.1q VLAN ID : Disabled RMCP+ Cipher Suites : 1,3,8,12 Cipher Suite Priv Max : XaXaXXXXaXXXaXX : X=Cipher Suite Unused : c=CALLBACK : u=USER : o=OPERATOR : a=ADMIN : O=OEM Bad Password Threshold : Not Available 6. Turn on wanted IPMI controls by running one or both of the following: # isi ipmi features modify Power-Control --enabled=True # isi ipmi features modify SOL --enabled=True 7. Confirm IPMI feature state matches what was set in the previous step: # isi ipmi features list ID Feature Description Enabled ---------------------------------------------------- Power-Control Remote power control commands Yes SOL Serial over Lan functionality Yes ---------------------------------------------------- Total: 2 8. Set user and password: # isi ipmi user modify --username=[Username] --set-password NOTE: Password must be between 16 and 20 characters. 9. Confirm user: # isi ipmi user view At this point, you could run ipmi commands to control power or connect using serial-over-lan, if enabled. # ipmitool -I lanplus -H -U -L OPERATOR -P sol info Set in progress : set-in-progress Enabled : false Force Encryption : true Force Authentication : false Privilege Level : OPERATOR Character Accumulate Level (ms) : 50 Character Send Threshold : 255 Retry Count : 7 Retry Interval (ms) : 480 Volatile Bit Rate (kbps) : 115.2 Non-Volatile Bit Rate (kbps) : 115.2 Payload Channel : 4 (0x04) Payload Port : 623

Support Cases