Administration and Diagnostics Utilities - Oracle Exadata Recipes: A Problem-Solution Approach - page 179

-W- Suboptimal rate for group. Lowest member rate:40Gbps > group-rate:10Gbps
-I---------------------------------------------------
-I- Bad Links Info
-I- No bad link were found
-I---------------------------------------------------
----------------------------------------------------------------
-I- Stages Status Report:
STAGE Errors Warnings
Bad GUIDs/LIDs Check 0 0
Link State Active Check 0 0
Performance Counters Report 0 0
Partitions Check 0 0
IPoIB Subnets Check 0 1
Please see /tmp/ibdiagnet.log for complete log
----------------------------------------------------------------
-I- Done. Run time was 1 seconds.
[root@cm01dbm01 ibdiagtools]#

2. Run /usr/sbin/ibqueryerrors.pl to check whether any errors are returned. In the

example below, we can see a small number of relay errors for each of our switches:

[root@cm01dbm01 ibdiagtools]# ibqueryerrors.pl
Errors for 0x2128469c6da0a0 "SUN DCS 36P QDR cm01sw-ib3"
GUID 0x2128469c6da0a0 port 7: [RcvSwRelayErrors == 1] [XmtDiscards == 4]
[XmtWait == 2534716]
GUID 0x2128469c6da0a0 port 10: [XmtWait == 5716382]
GUID 0x2128469c6da0a0 port 13: [XmtWait == 10210]
GUID 0x2128469c6da0a0 port 14: [XmtWait == 7434]
GUID 0x2128469c6da0a0 port 17: [XmtWait == 5748]
Errors for 0x21284697f9a0a0 "SUN DCS 36P QDR cm01sw-ib2"
GUID 0x21284697f9a0a0 port 1: [RcvSwRelayErrors == 48] [XmtWait == 16528234]
GUID 0x21284697f9a0a0 port 2: [RcvSwRelayErrors == 48] [XmtWait == 16088954]
GUID 0x21284697f9a0a0 port 4: [RcvSwRelayErrors == 48] [XmtWait == 16789105]
GUID 0x21284697f9a0a0 port 7: [XmtDiscards == 2] [XmtWait == 1273404511]
GUID 0x21284697f9a0a0 port 10: [RcvSwRelayErrors == 83] [XmtDiscards == 1]
[XmtWait == 1331113845]
GUID 0x21284697f9a0a0 port 15: [XmtWait == 2388489]
GUID 0x21284697f9a0a0 port 16: [XmtWait == 5043445]
[root@cm01dbm01 ibdiagtools]#

3. To check your InfiniBand network performance, run the /opt/oracle.SupportTools/

ibdiagtools/infinicheck command. For this test, you will need SSH keys to be
distributed to the nodes in your Exadata cluster; if not already performed as the root user,
issue the following command:

[root@cm01dbm01 ibdiagtools]# ssh-keygen -t dsa
Generating public/private dsa key pair.
Enter file in which to save the key (/root/.ssh/id_dsa):
Enter passphrase (empty for no passphrase):
Enter same passphrase again:
Your identification has been saved in /root/.ssh/id_dsa.
Your public key has been saved in /root/.ssh/id_dsa.pub.