Cisco SFS 7012 manual

Corporate He adquarters Cisco System s, Inc . 170 West Ta sman Drive San Jos e, CA 95134 -1706 USA http://www.ci sco.com Tel: 408 526-4000 800 553- NETS (638 7) Fax: 408 526-4100 Cisco SFS 70 1 2 Inf iniBand S erver S witc h Hardware Users Guide Text Pa rt Num ber: OL -8787-05[...]

THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCT S IN THIS MANUAL ARE SUBJECT TO CHANGE WITHOUT NOTICE. ALL STATEMENT S, INFORMATI ON, AND RECOMMENDA TIONS IN T HIS MANUAL ARE BELIEVED TO BE ACCURATE BU T ARE PRESEN TED WITHOUT WARRANTY OF ANY KIND, EXPRE SS OR IMPLIED. USERS MUST TAKE FULL RESPONSIBILITY FOR THEIR APPLICATION OF ANY PRODUC[...]

Content s i Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 New and Changed Inf ormation v Preface vii Audienc e vii Organi zation vi i Conv enti ons viii Relat ed Do cume ntatio n viii Obtain ing Docu mentati on, Obtai ning Suppo rt, an d Securit y Guideline s vii i CHAPTER 1 Insta lla tion 1-1 Statemen t 1019—Mai n [...]

Cont ents ii Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 SFS 7012 Comp onent LEDs 1-28 SFS 7012 Lea f and Spine Module LEDs 1-29 Shutdown Proced ures 1-30 Hot Swappi ng Component s 1-3 0 Hot Swappi ng Spin e and Leaf Modu les 1-3 0 Hot Swappi ng the Fan Uni t 1-31 Hot Swappi ng Power S upplies 1-31 CHAPTER 2 Operati on[...]

Content s iii Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 HTTP/CLI Session Config uration 2-19 SNMP 2-20 Targ et Conf igur ation 2-20 Filt er Sta tus 2-2 3 Setti ng Community Strings 2-24 Confi gura tion F ile A dmini stra tion 2-25 Admi nist er 2-25 Host Up load/Down load 2-26 Trap C ontrol 2-28 Chassi s Traps 2-29[...]

Cont ents iv Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Acce ssing th e CLI B-3 Groups an d Commands B-4 General B-4 Depreca ted B-19 Chassi s B-2 0 Network B-24 Firmware B-29 SubnetMan agement B- 34 Log B-49 KeyManage ment B-53 IbSw itchInfo B-54 Time Mana geme nt B-68 SNMP B-71 Captur e B-7 6 APPENDI X C Troubles ho[...]

v Cisco SFS 7012 Infin iBand Serve r Switch Hardwa re Users Guide OL-8787-05 New and Changed Information The Cisco SFS 701 2 InfiniBand Serve r Switch Har d war e Users Guide applies to the SFS 7012 Release 3.1 or later . Ta b l e 1 lists the new and change d features av ailable with each supported SFS 7012 release. Ta b l e 1 Document ed F e at ur[...]

vi Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 User auth enticati on via co mman d line inte rface ( CLI), serial co nsole and Chassis V iewer GUI User login and passwor d required to access the SFS 7024 4.1.1.1 .11 LD AP Configur ation, page 2- 18 HTTP/ CLI Se ssion Configuration, page 2- 19 Acce ssing the CLI, page B[...]

vii Cisco SFS 7012 Infin iBand Serve r Switch Hardwa re Users Guide OL-8787-05 Preface This pr eface d escribes the a udience, organizatio n, an d conventions of the Cisco SFS 70 12 InfiniBand Ser ver Switch Hardwar e Use rs Guide . It al so provides in format ion on how to obtain relat ed documentation. Audience The inte nded audie nce for this do[...]

viii Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Conven tions This document use s the follo wing con ventions for notes, cautions, and safety warnings. Notes and Ca utions cont ain impo rtant infor matio n that you shoul d be aware of. Note Means r eader t ak e note . Not es co ntain helpf u l s ugges tion s or refer e[...]

C HAPTER 1-1 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 1 Installation This chap ter des cribes ho w to install the Cisco SFS 7012™ and its component s, and it includes the follo wing information: • Planning t he Installa tion, page 1-7 • Installation T asks, page 1-12 • Hot Swappin g Compone nts, page 1-30 Note[...]

1-2 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 War ni ng IMPO RT ANT SAFETY INST RUCTIONS This warning symbol means dang er . Y ou are in a sit uation that could cause bodily injury. Be fore you work on any equipment, be awa re of the hazards involved with electrical circuitry and be familiar with standard practices f[...]

1-3 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 Statement 1045—Short-circuit Protection Avi s o A combinação ficha-tomada deverá ser sempre acessível, porque funciona como interruptor principal. ¡Advertenc ia! El conjunto de clavija y toma ha de encontrars e siempre accesible ya que hace las veces de dispositivo d[...]

1-4 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Avi s o Este produto requer proteção contra curto-circuito s (sobreintensidade de corrente), que deve e star instalada nos edifícios. Instal e apenas de acordo com as normas de inst alação elétrica nacionais e locais. Advertenci a Este producto necesita estar conect[...]

1-5 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 Statement 1074—Comply with Loca l and National Electrical Codes War ni ng Installation of the equipment must comply with local and national electrical codes. Statement 107 4 Waarschuwing Bij installati e van de appa ratuur moet worden voldaan aan de loka le en nationale e[...]

1-6 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Stat ement 1 075—Hazar dous Voltage or En ergy Pres ent on DC Power Termin als War ni ng Hazardous voltage or energy may be present on DC power terminals. Alway s replace cover when terminals are not in service. Be sure unins ulated condu ctors are not accessible when c[...]

1-7 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 Planning the Installation Rack Specificat ions and Recommendat ions The SFS 7012 switch is designed to be installed in an existing 19-inch equipm ent rack or server rack. Note The SFS 7024 sw itch is design ed for a fo ur-post server cabin et. It is no t designe d for a two[...]

1-8 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Cable Requirem ents Cable Dista nces When planning the loc ation of the switches, consi der the distance limitat ions for signaling, EMI, an d connect or compatibilit y . It is rec ommended that th e user d oes not e x ceed spec ifie d transmission r ate and distan ce li [...]

1-9 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 Installation Tasks Checklist T o perform the a ctual switch in stallation, t he site implem entation e ngineer must pe rform the follo wing tasks, which are detai led in this section. Cautio n Be sure t o review the Sa fety I nformati on on page 1-9 befor e starting the ins[...]

1-10 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 War ni ng After installing sy stem components in a rack never pull more than one compon ent at one time out of the rack on its slide assemblies. The weight of more than one exte nded component could cause the rack to tip over . War ni ng Do not step on or stand on any co[...]

1-11 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 War ni ng T o avoid potential electrical shock, operate this unit only when the cover is in place. War ni ng T o avoid poten tial electrical shock, use only a grounded (three wire) electrical outlet. War ni ng Keep objects that might damage this unit and li quids that migh[...]

1-12 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Be sure of the follo wing: • The cabinet has a full e arth g round t o provide reliabl e grou nding. • Ther e is enough ro om to work on the equipme nt. • The e quipment will h av e enough cl earance for front and rear acc ess. • The I B cabl es can be accesse d [...]

1-13 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 Step 1 If appl icable , rem ov e the doors of the r ack. Step 2 Mark th e rack, a llo wing 7 U (12.25 i nches) of vert ical spac e to install the SFS 7012 switch. Step 3 Install t he suppo rt rails. Step 4 Rack mount the switch. Step 5 If appl icable , repla ce the doors o[...]

1-14 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Note The 2 front holes should match up with the top and botto m holes of the ra il fron t flange. All hol es should corr espond t o the ra il moun ting p ositions (i.e., the hole s marked with pe n or t ape). Step 2 Fasten the rail back flange (chassis leaf module side) [...]

1-15 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 T o install the sw itch int o the rack, p erform the follo wing st eps: Step 1 Clear th e area of an y unneces sary mate rials. Step 2 Attach th e clip of the ESD wr istband (strap) to bare metal on the ca binet. Put th e wristband around one wrist with the metal b utton a[...]

1-16 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Figur e 4 Secur e Chassis t o Rac k Step 6 Using tw o scre ws, insta ll the lo wer mounting brac ket to the rail a ssembly and chassis a s sho wn in Figure 5 . Figur e 5 Instal l the Lo wer Mount ing Brac ke t and He yclip Step 7 Install the he yclip to the rail assembly[...]

1-17 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 Step 1 On the swit ch fa n side, inser t the notche s on the top o f the f ascia into the two slo ts on the ch assis frame. Snap t he botto m of t h e f aceplate in p lace. Removing a Module or Blank The handl es ar e sel f-lo cking. T o unl ock, p ush up on t he ha ndle s[...]

1-18 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Figur e 1- 6 SFS 70 12 Chassis — Spine Module Sl ot Number ing b. Leaf Mo dules— Leaf mo dules should be populated beginni ng with slot 1, then slo t 2, then slots 3 through 12 r espectively . Refe r to Figu re 1-7 : Figur e 1- 7 SFS 70 12 Chassis — Lea f Module Sl[...]

1-19 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 Figur e 1- 8 SFS 70 12 Chassis F r ont V iew Figur e 1- 9 SFS 70 12 Chassis Bac k V iew Step 1 Connect a Cate gory 5 or 6 (Cat 5/6) Ethernet cable to one of the RJ-45 connectors on the SFS 7012. Conn ect the ot her end of the Cat 5/6 to the OOB LA N wo rkstat ion. Refer to[...]

1-20 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Note Whe n handling IB connector s, make certa in to remove the connec tors by pulling on the center of the lanyard only as shown in Figur e 1-10 below . Pulling abru ptly on the lany ard, or pu lling on only o ne side of the lanyard w ill prevent the latch/ unlatch oper[...]

1-21 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 Note If the spine module RS-232 port is conne cted to a terminal emula tion program, the user will be able to view the switch boot pr ocess. Be cer tain to use a nul l-modem/crossover serial cable fo r the conso le port. The settings for the terminal emulation de vice shou[...]

1-22 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 • Use the Chassis V ie wer GUI f rom a s ystem th at can reac h the chassis u sing th e def ault I P addr ess (192.168 .100.9 ). Using the RS 232 Serial Port Step 1 Connect n ull-mode m/cros sov er seria l cables t o the RS- 232 por t of spin e 1. If using a terminal e[...]

1-23 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 super The system responds with: Welcome to the SFS 7012 CLI. Type 'list' for the list of commands. Step 6 T o chang e the SFS 7012 default IP address enter: setChassisIpAddr -h ipaddress -m netMask where -h ipa ddress is the new IP address i n dotted d ecimal (i.[...]

1-24 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Figur e 12 SFS 70 12 W eb A uthentication Ent er the us er name super and pa ssw ord super . Step 5 From the chas sis OOB LAN IP submenu, c lick Set OO B LAN IP . The Se t OOB LAN IP is displayed: Step 6 Click in the OOB IP A ddress fie ld . Figur e 13 Set OOB LAN IP Win[...]

1-25 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 Step 13 Enter the ne w switch default g ate way IP address. Step 14 Clic k Appl y . Note A reboot i s requi red to activate the new gateway IP address. Updating Management Spin e IP Addresses in a Redundant M anagement Configuration Note Th is procedure shou ld be perform [...]

1-26 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Step 5 At t he [boo t]: prompt, enter reboot , and pr ess Enter . Upon reboo t the ma naged s pine will d isplay information similar to the follo wing: Unified Boot Manager For The T3 Platform. Image Date: Jan 19 2006, 15:03:31 Checking L2 functionality... BCM1125 L2 cac[...]

1-27 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 CPU0 flushing caches L2 flush complete Start type = 0xBFC006A0 Jumping to romStart Initializing HyperTransport bus HyperTransport initialization completed rintf MBOX connect interrupt_source=28 vector=62 status=0 Printf MBOX intEnable status=0 Found Intel Strata Flash 128 [...]

1-28 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 sbe1 speed=100 fullDuplex=1 flowControl=0 Note Th e comm and spineip changes the IP ad dress for image 1 and image2 , SFS 7012 Component LEDs Chassis Status LED The ch ass is statu s LED is Green when the system is functioning normally . The ch ass is statu s LED is Ambe[...]

1-29 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 • Amber indicates that the follo wing warning condi tion exist s: – A single fan rotat ion failure at less than 400 0 RPM or greater th an 10950 RPM. • Red indicates a possible problem , includ ing: – The fan tray is not responding to co mman ds for c onfiguration [...]

1-30 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 – The mo dule c an no lo nger function properly . The sy stem wi ll take t he appr opriate a ctions t o ensur e that no damage is done to its compon ents. • Blinking Amber (once every four seco nds) - LED te st state. Spine Modul e Management LED s Each SFS 7012 spin[...]

1-31 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 • Hot sw ap one module at a time, allo wing the ch assis to com pletely upd ate it b efore hot-sw apping the ne xt module. Th e module updat e is complete when it b ecomes visible with in the Chassis V ie wer GUI. List ed below are the approxim ate tim es to fully upda t[...]

1-32 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Step 8 T ighten the capti ve panel screw .[...]

C HAPTER 2-1 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 2 Operations and Administration This c hapter de scribes h ow to admi nister an d configure the Cisco SFS 7012™ and its compon ents , and it includ es the fo llowin g informatio n: • Logging , page 2-12 • Mainte nance, page 2-17 • SNMP , page 2 -20 • Conf[...]

2-2 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Figur e 1 SFS 70 12 W eb A uthentication • Ent er the de faul t user name an d passw ord: – Administr ator-le vel user name: super – Administr ator-le vel password: super – Operat or -lev el user name: adm in – Operat or -lev el passwor d: admin • The Cha ssis[...]

2-3 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 ? (Help) Button Figur e 2-3 Help Butt on The ? (HELP) b utton displays online he lp. Each help screen gi ves the user a high -le vel, topic -specific descript ion. Support Button Figur e 2-4 Suppor t Butt on The Support button displays key contact in formati on for support,[...]

2-4 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Figur e 2-6 Leaf Modu le Mous eov er Left cli ck the mous e. The leaf mod ule view will be displa yed. Figur e 2-7 Leaf Modu le View Spine Module View T o display the spine module vie w for the SFS 701 2: Step 1 Mouse over the spin e module to display . The edges of the s[...]

2-5 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 Figur e 2-9 Spine M odule V iew Leaf and S pine Modu le Componen t Details Area The Component Details Area contain s three areas. • Details He ader • Infor mation a rea. • Menu Figur e 2-1 0 Leaf and S pine Comp onent Details Ar ea Leaf and Spine Details Header The le[...]

2-6 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 • The gra y fie lds are tied to li ve da ta from the select ed hardw a re comp onent as w ell as li ve system inform ation. Additi onally , the Com ponen t Informat ion Area ha s A pply and Ref resh b uttons, which perform the following func tional ity: App ly : Sav es [...]

2-7 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 Figur e 2-14 Chassis V iew er Component Deta ils Ar ea Chassis V iew Compon ent Deta ils Area The Component Details Area contain s three areas. • Details He ader • Infor mation a rea. • Menu Chassis Details Header The Chassis Details Header allows the user to ex ecute[...]

2-8 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Figur e 2-16 Reboot Scr een Step 2 Select the radio button of the spine(s) to be rebooted, or select the Reboot Entire Chassis radio b utto n to r eboot the SFS 7012 cha ssi s and al l sp in es. Step 3 Click Reboot . Chassis V iew Compon ent Information Area Figur e 2-17 [...]

2-9 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 • Fan information • Swit ch back plane i nform ation LEDs and Se nsors Tab The LE Ds and Sensors ta b displa ys: • Switch compo nent LED info rmation fo r chassis status, chassis SMA , fan and po wer suppli es. • Slot-b ased tempe rature an d A C-power sensor da ta [...]

2-10 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 System Uptime The elapsed time since the last time switch was re-initi alized. System Contact The te xtual identif ication of the con tact pers on and th eir contact informati on for this sy stem, assigne d by the administ rator . System Name The n ame for th e syste m, [...]

2-11 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 Status Displays t he status of the c omponent. Part Nu m Displa ys the pa rt number of th e compone n t. Detail A button fo r each r ow that displays addit ional d etail about the c omponent. Additi onal de tails inclu de: Mode l, V ersion, Manufac turer N ame, Pr oduct N [...]

2-12 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Configuration a nd Monitoring Feature s The fol lo wing section provid es detailed, t ask-oriented descriptions for conf iguring and monito ring the SFS 7012 sw itch and its feature functionality . Chassi s View M enu Figur e 2- 20 Ch assis Vi ew Men u The Chassis V i ew[...]

2-13 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 Step 1 From th e menu, select Loggi ng. Step 2 From L ogging , select Set L ev e l . The Log Syst em Configurato r (Device T a b) window is displayed: Figur e 2-23 Log S ystem Configur at or (Device T ab) The De vice tab prese nts current log le vel co nfigur ation setting[...]

2-14 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 – FATA L – Indicat es that a non-re cov erable system problem has occ urred. T he user should reboot the syste m or comp onent and verif y that th e subsy stem is full y functi onal to de termine w hether the fau lt has b een co rrect ed. If the probl em pe rsists, t[...]

2-15 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 Figur e 2-25 Log S ystem Configur at or: Pr eset T ab T o change the log le vel settings: Step 1 Click the On-O ff checkbox to the right of the setting(s). Step 2 Click the Submit button to save any change s. Syslog Tab Figur e 2-26 Log S ystem Configur ator: Sys log Host [...]

2-16 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Note T o centra lize logging for all switc hes in an IB fabric, the user ca n conf igure each switch to point to th e same syslog se rver that has the sy slog daemon ( syslogd ) running. When messages a re sent to a syslog serv er, the y wil l appea r in th e log as be i[...]

2-17 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 Maintenan ce Figur e 2-29 Maint enance Me nu Note For re bootin g infor mation, see Re booting C omponents from Cha ssis V iewer , page 2-7 Firmware Update Figur e 2-30 Fir mwar e Updat e Butt on The Firmware Update button all ows the user to selec t an alternate f irmware[...]

2-18 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Note If there ar e multiple spine modul es, the u ser can sel ect all applicable slo ts. Step 4 From the Image to Over write drop-down list, choose a firmware image to overwrite. Step 5 In the Firm ware Upd ate Pack age: text b ox, enter the path to the a lternate f irmw[...]

2-19 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 HTTP/CLI Session Configuration Figur e 2-34 HTTP/CLI Session Con figur ation But ton The hy per text tran sfer pro tocol (H TTP) an d command line in terface ( CLI) sessi on configurat ion fea ture allo ws th e user to set HTTP an d CLI session timeout parameters, as well [...]

2-20 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 • Login Disabl ed - Does not re quire usernam e or password. Step 8 When f inished, click t he A pply button. SNMP The SNM P submen u allo ws the us er to conf igure and fil ter SNM P trap informati o n. Figur e 2- 37 SN MP S ubm enu Target Configur ation The T arget C[...]

2-21 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 Figur e 2-39 SNMP T ar g et Configur ation Window The t op secti on of t he wind o w , SNM P T a rget Addresse s, allows the user t o deter mine wha t type of SNMP trap s are sent, and where t hey are sen t. The ro ws p rovid e an a rea fo r specif ying multiple trap desti[...]

2-22 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Note The combination of the T ransport Doma in and the T ransport Address deter mines the trap destina tion. • Port Specifi es the TCP or UDP port that the SNMP trap is sent. • Ti m e o u t Specifies the time (in milliseconds) that the trap sen der waits on a respons[...]

2-23 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 The Message Processin g Model to be used when generati ng SNMP message s for entry . V a lues for this field are 0 for SNMP v1, 1 for SNMP v2 and 3 for SNMP v3. • Security Model The Secu rity Model t o be us ed when g enerating SN MP messages using this en try . V alues [...]

2-24 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Figur e 2- 40 Fi lter S tatus Button T o view the SNMP filter status: Step 1 From th e menu, select SNMP Step 2 Click Filter Status . The SNMP Filter St atus sc reen i s di spla yed. Figur e 2-41 Filt er Status Scr een Setting Community Strings The Set Community Stings s[...]

2-25 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 Step 1 Click SNMP Step 2 Click Set C ommunity Strings . The Set Community Strings scree n is displayed. Figur e 2-43 Set Community Str ings Window The first field, " Read Only Comm. Name ," is the commun ity string th at when specif ied in a n SNMP client, allows[...]

2-26 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Step 2 Click Config File Ad min . Step 3 Click Administer . Th e Configurati on File Administration screen is displayed: Figur e 2-46 Configur ation Fil e Admini stration Scr een Step 4 Click on the line card to be modif ied. The ro w changes to orange. Step 5 In th e Mo[...]

2-27 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 • Do wnload sa ve d config uration f iles from the CMU to a serv er . Figur e 2-48 Configur ation Fil e Admini stra tion - Host Up/D ownl oad Step 1 Click the chassis vie w . Step 2 Click Config File Ad min. Step 3 Clic k Host U p/D ow nloa d. The C onf igurati on File U[...]

2-28 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Trap Control The T rap C ontrol screen allows th e user to set default tra p scenarios related to conf iguration files. Figur e 2-51 T rap Contr ol Step 1 Click the chassis vie w . Step 2 Click Config File Ad min . Step 3 Click Tr a p C o n t r o l . The Tr a p C o n t r[...]

2-29 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 The co nfiguration files have been suc cessfully backed up for a parti cular slot. • CfgS rvMo deDis abled An ev ent has occu rred that has caused the slot m ode to be set to disabled. T he user should resolve the err or and re set th e mode to th e prope r v alue fo r t[...]

2-30 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 This trap indicates th at the chassis failed one or more of its self-test(s). icsChassisT rapSystemReboot This trap indicates th at the chassis is in the process of rebooting. icsChassisT rapSystemMgm tSrvcStarted This tr ap indicates that the internal service us ed to s[...]

2-31 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 icsChassisT rapPowerSupplyRe moved This trap indic ates that a power supply was r emov ed from the chassis. icsChassisT rapPowerSupplyF ai led This trap i ndicates that a po wer supply has failed and is no t operationa l. icsChassisT rapPowerSupplyEEPR O MReadF ailur e Thi[...]

2-32 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 SFS 7012 Port Statistics The Chassis V iew Port Stat istics area provides I B port informatio n for all of the e xternal and internal ports of the SFS 7012. Figur e 2-55 IB P ort Sta tistics T o view por t statistical informat ion, do the follo wing: Step 1 From the Chas[...]

2-33 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 Note Spin e chips are refe renced b y the spine number a nd the switch chi p identif ier . Each spine m odule contains two swit ch chips (Switch c hip A and B). Port Statistics Field Descriptions Po rt Name/P ort Number: Correspon ds to ext ernal le af modu le num ber/por [...]

2-34 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Infini Band Stati stics: T ra nsmit 32 Bit W ords: The number of 32- bit data words transmitted by the port, not including flow control and VCRC d ata. Recei ve 32 B it W ords: The num ber of 32-bit data wo rds rec ei ved by the port, not includ ing flow con trol and VCR[...]

2-35 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 Pkey V iolations Outbound: Indicates the number o f times an in v alid PKe y was sent. PKe ys support an adv anced Inf iniBand feature for logica lly partiti oning a p hysical subnet into log ical acce ss domains. Raw V iolations Inbound: Number of ti mes a raw inbo und pa[...]

2-36 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Step 2 From the Spine Port Stats menu, select IB Port Stats. Figur e 2-59 Spine P ort Sta ts Menu The spine port statistics wi ndo w is displayed : Figur e 2-60 Spine P ort Stati stics Windo w For inform ation on the each IB port st atistic f ield, refe r to the sect ion[...]

2-37 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 Figur e 2-62 Set Er ror Report ing Thre sholds Scr een Step 3 T o change a thre shold v alue for an y f ield: a. Click in the Thr eshold fi e l d . b. Enter a new threshol d value. Note F or thos e f ields wit h a “ Perc en t of Ma x ” time un it, t he user m ay enter [...]

2-38 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Note Th e threshol ds for the fo llowing fields are set ba sed upon the number of error me ssage which c an occu r in one second. T he value ca n be f rom 1 t o 65,535 . portSymbolErrThr esh The thre shold for t he number of times a 8B10 B encodi ng violatio n, or a disp[...]

2-39 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 Figur e 2-63 Switc h Time Service T o set the system time: Step 1 From th e menu, click Tim e Se rvic e . Step 2 Click Set System T ime . Th e System T ime Inf ormation scree n is displa yed: Figur e 2-64 Sys tem Time Inf or mation Scr een To u s e N T P : Step 1 Click the[...]

2-40 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Step 1 Make sure the Use Netwo rk T ime Pr otocol? checkbox i s unche cked. Step 2 Set the cur rent date and time using the drop-do wns for Month , Day , and Ye a r as well as Hour , M inute , Seconds , and AM/PM . Step 3 T o s ave , cl ick on Apply . Figur e 2-66 Time S[...]

2-41 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 Configuring the Sw itch OOB IP Address T o conf igure the Switch IP address : Step 1 From the OO B LAN IP subm enu, click Set OOB LAN IP . Figur e 2-68 Set Sw itch OO B IP A ddre ss But to n Step 2 Click in the OOB IP Addr ess fie ld . Figur e 2-69 Set OOB LAN IP Win dow S[...]

2-42 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Figur e 2-71 Set S witc h Def ault Gat ewa y IP Addr ess But ton Step 2 Click in the Gateway A ddress fie l d. Figur e 2-72 Set Def ault Gatew ay IP Windo w Step 3 T ype in the correct switch def ault gate way IP address. Step 4 Click A pply . Note A reboot i s requi red[...]

2-43 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 Spin e View Me nu Figur e 2-73 Spine V iew Menu Note For i nformat ion on IB port statistic s refe r to t he sect ion SFS 70 12 Port Statisti cs, page 2- 32 . Logging The Lo gging submenu allows the user to view , set levels, reset lev els, a nd purge the message log file.[...]

2-44 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Step 1 From th e menu, select Loggi ng. Step 2 Click Vi ew L o g . The log m essage window is displaye d: Figur e 2-76 Sample Mess age L og T o save a log message for fur ther ana lysis, per form the following ste ps: Step 1 From the Messa ges window , select Edi t , Sel[...]

2-45 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 Figur e 2-78 Purg e Log Confirm ation Windo w Step 3 Click OK . Step 4 The messa ge log file is now pur ged. Maintenan ce Select Boot Image The Select Boot Image button allows the user to cho ose an alternativ e bo ot image for the SFS 7012 . T o select a boot image: Figur[...]

2-46 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 License K eys; Key A dministra tion The License Ke y submenu allo ws the user to acti vate an d deacti vate fea ture functionalit y that is sold as an add-on to the SFS 7012. Adding a New License Key Step 1 Click Lice nse K eys . The K ey A dministration b utton is displ[...]

2-47 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-05 Step 3 T o delete a license ke y , click the Delete b utton . T he sy stem p rompt s with t he fo llo wing: Figur e 2-85 License Ke y Delet e Pr ompt Step 4 Click OK to dele te.[...]

2-48 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05[...]

A- 1 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 APPEND IX A Technical Specifications Ta b l e A -1 SFS 70 12 T ech nical Specifica tions Switch Phys ical Dime ns io ns • 7U high ( 24.5”) • 19" rac k moun t (17. 32" w ide) • 25 3/4" deep (without cable s) W eight • 100 lb. (includi ng power [...]

A- 2 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Power S upply • Up to si x redundan t, hot plug su pplies • 90/264 V AC operation • 350 W max powe r per su pply • Input: • 90–264 V AC, 50-60Hz, 1 Phase, 4. 0A max current at 115 V AC • Inrush C urrent: • 15A @ 1 15V AC (25 ° C cold s tart) 30A @ 2 30V [...]

B-1 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 APPEND IX B Command Line Interface This a ppendix include s the following inf ormatio n: • Command s and Func tional G roups, p age B- 2 • Accessi ng the CLI, page B -3 • Groups a nd Comm ands, pa ge B-4 Overview This section detai ls the usage of the Command Lin[...]

B-2 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 The CLI is also accessible through the RS232 serial port of the SFS 7012. Providing access t hrough the serial port m eans that users wi ll alw ays hav e acce ss to the SFS 7012, e ven if T elnet and SSH ar e not functi oning. Commands and Fun ctional Groups The li st of [...]

B-3 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 Pro vides comma nds for co nfig uring SNMP tr ap destina tions and sec urity pa rameters r equired to access the SFS 7012 from an SNMP manager . Captur e: Pro vides com mands for cap turin g switch-spe cif ic information fo r the purpos es of analy sis and debugging. T[...]

B-4 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Step 2 The syste m prompts for a use rname. The CLI has the following default user names: – Operat or a ccess: admin – Administrator access: super T ype the appro priat e usernam e and press Ente r . Step 3 The syste m prompts for a pa ssword. The CLI has the followin[...]

B-5 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 NO TES: General Help T ype list or ? for the li st of commands. T o get help on a part icular co mmand ty pe: comman dnam e help. For con vienen ce purposes you can also typ e: help com mandnam e Use th e Up a nd Down arrow keys to browse comm and h istory , Le ft an d[...]

B-6 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 history Displa ys the hist ory of a co mmand. Syntax: Options: Sample O utput: reboot Reboots the device. Syntax: Options: history None. -> history command history [30 max lines]: list Deprecated Network Firmware Log IbSwitchInfo TimeManagement Snmp Ethernet help list [...]

B-7 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 Sample O utput: NO TES: Y ou may reboot t he local (Master) Spine or the remote (S lave) Spine w ith one or m ultipl e arguments. Non-disrupti ve arg uments will not interfere with switch traf fic. Providing argume nt all performs disrupt iv e reboot of all present Spi[...]

B-8 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 NO TES: Displays a list of curr ently acti ve CLI sess ions. Note that a session can be 'acti ve', b u t no user in form ation a vailab le (i n mos t case s, thi s indi cates t he sess ion i s wai ting for the user to ent er login info rmation) . For each sessio[...]

B-9 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 setT ermWidth Change the termin al width for t ext fo rmattin g purposes . Syntax: Options: Sample O utput: NO TES: Allows modificatio n of the te rminal w idth used f or text format ting purpose s. Note t hat not all comm ands adhe re to this setting. The minimu m wid[...]

B-10 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 NO TES: This c hanges the pr ompt for all C LI sessions. The p rompt may not exc eed 11 characte rs and is not saved across rebo ots. If the p rompt co ntains a spac e, ast erick , comm a, par enthesis or semico lon it mu st be encl osed with do uble quo tes ". For [...]

B-11 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 Sample O utput: NO TES: This command allo ws users to open a termin al to l ocal I/O de vices within the chas sis/he misph ere. The command rcmd is a n alias of r login. See a lso h ostSho w . resetCar d Reboot a specif ic slot in the chas sis. Syntax: Options: Sample[...]

B-12 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Options: Sample O utput: NO TES: Use this command to change to the 'operator' acco unt, or to the 'admi n' account. p asswd Change users password(s) . Syntax: Options: Sample O utput: NO TES: Allows the modificati on of the user 's password. user[...]

B-13 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 Sample O utput: During a T elnet session, if a user is added with user Add the fi rst time that user atte mpts to lo g in the u ser will see a m essage: If the password is not entered (ie Ctrl+C is done) th en the ne xt time this us er logs i n the same message will b[...]

B-14 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Options: Sample O utput: loginMode Change the login auth entication mode. Syntax: Options: Sample O utput: NO TES: This sets the authentica tion for the CLI. By disabling logins alto gether the user is logge d in the a dmin accou nt by default. There is no way to modify [...]

B-15 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 setldapSvr Port Modify the LD AP Serve r Port. Syntax: Options: Sample O utput: NO TES: This sets the LD AP server port . The LD AP server will be conta cted for remote authenti cation. idleTimeoutGet Get the CLI and Chassis V ie wer GUI idle timeo ut v alues. Syntax:[...]

B-16 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Sample O utput: NO TES: Modif ies the idle timeo ut for the CLI or GUI interf aces. T imeouts are in number of second s, with zero meaning the timeo ut is dis abled. sessionTimeo utDisable Disable the idle timeout for the current CL I session. Syntax: Options: Sample O u[...]

B-17 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 Sample O utput: NO TES: Displays the curren t login welc ome messa ge for the CLI. This me ssage can be custom ized with the loginMsgSet command. loginMsgSet Set the CLI logi n message for th is device. Syntax: Options: Sample O utput: NO TES: This co mman d can be us[...]

B-18 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Syntax: Options: Sample O utput: NO TES: The login na me is an arbi trary str ing displaye d prior to a use r attemp ting a login to a new CLI session. This command modif ies this string. serialAuth Get Displays the cu rrent serial auth entication status. Syntax: Options[...]

B-19 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 NO TES: This com mand is used to enab le or disa ble user authe nticatio n on the s erial console. U se 1 as th e only parameter to enab le authen tication, or 0 to disable au thenticatio n. exit Exit t he CLI. Syntax: Options: Sample O utput: Deprecated • smDisplay[...]

B-20 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Chassis hwMonitor Displa ys cur rent p ort st ates, f an speeds, tempe ratur es, and v oltages. Syntax: Options: Sample O utput: NO TES: T o e xit monitoring, press the enter ke y . showIBNodeDesc Display s the I B Node subnet ma nagem ent agen t (SMA ) Descript ion. Syn[...]

B-21 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 NO TES: Enterin g this comm and with no pa rameters displays the current Nod e Descriptio n. The -d option will display the unit's default v alue. setIBNode Desc Changes the IB Node (SMA ) Descript ion. Syntax: Options: Sample O utput: NO TES: New node name must [...]

B-22 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 chassisQu ery Displays infor mation about the line car ds in a chassis. Syntax: Options: Sample O utput: NO TES: Entering this comman d with no parameters will disp lay all currently occu pied card slots. chassisQuery [slot] [-showType] [-type card_type] [-ignoreInvalidT[...]

B-23 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 showInven tory Displays a detailed list of all hard ware with in the ch assis. Syntax: Options: Sample O utput: showInventory None. MasterSpine1-> showInventory NAME: "Slot 2", DESCR: "4X 12-Port Card" PID: 74-4316-02, VID: V02, SN: SST0639000C [...]

B-24 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Network ifShow Displays in formation for all the n etwork interfa ces for the switch, i ncluding the m anagement port and the i nterna l Etherne t network. Syntax: Options: Sample O utput: ifShow [ifName] [ifName] The net work inte rface name. MasterS pine2 -> ifSh ow[...]

B-25 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 NO TES: In th e sb e0 out put, th e first Int ernet Addr ess shown is th e spine IP add ress. T he sec ond Internet Addre ss sho wn is the chassis IP address. routeShow Displays the OOB LAN IP routes. Syntax: Options: Sample O utput: ping Send ping packe ts to a speci[...]

B-26 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Sample O utput: NO TES: This routine spa wns a pro cess to send ping packe ts to the sp ecif ied IP add ress. If pack etCount is gi ven , the proces s exits after that nu mber of pack ets are sen t. If pack etCount is ommitted, a def ault the number of pack ets defaults [...]

B-27 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 NO TES: Chan ging the chassis I P address will dro p the connec tion to the C LI if not using t he console port, and may c ause the device t o become un reachabl e. showDefaultRoute Displays the defaul t gateway IP address. Syntax: Options: Sample O utput: NO TES: Thi[...]

B-28 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Sample O utput: hostShow Displays a list of remote hosts names, internet addr ess and alias(es). Syntax: Options: Sample O utput: -> arpShow LINK LEVEL ARP TABLE destination gateway flags Refcnt Use Interface ------------------------------------------ ----------------[...]

B-29 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 Firmware fwUp dateSlot Update s the fir mware on a specif ic line card . Syntax: Options: Sample O utput: NO TES: Firmware update works by using ftp to retrie ve the firmw are f ile, then writes the f ile to flash. Omittin g any of the optio ns causes the user to be p[...]

B-30 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Options: Sample O utput: NO TES: Firmware update works by re triev ing the f irmware f ile from an ftp serv er . The f ile is sav ed locally an d then writt en to flash . Using the ’ all’ option, a ll cards in the chassis will be updated . This assumes that all f irm[...]

B-31 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 fwSetUpdateParams Change the defau lt update firmw are settin gs. Syntax: Options: NO TES: Modif ies the def ault upda te fir mware parameters. Excep t for the f ilename optio n, all param eters ar e shared acr oss all card types. Th e cardtyp e parame ter is onl y re[...]

B-32 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Options: Sample O utput: NO TES: This allo ws for automated systems to determine if a SCP fi rmware push was successful or not. fwV ersion Displays the f irmware versio ns for a unit. Syntax: Options: Sample O utput: bootQuery Display s boot i mage version i nform ation.[...]

B-33 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 Options: Sample O utput: bootSelec t Select t he next bo ot imag e to be use d. Syntax: Options: -slot Slot nu mber . -active Displays the v ersion of the a ctive firmware image. -alternate Displays the ve rsion of the al ternate firmware image. -all Display s the ver[...]

B-34 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Sample O utput: NO TES: This comma nd allows t he user to set the next boot imag e for t he device. A '*' next to the image entr y indicate s the curre ntly selecte d bootimag e. A '#' indicate s the curren tly acti ve bootimag e. SubnetManagement Not[...]

B-35 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 Syntax: Options: Sample O utput: NO TES: Use t his co mman d to c onfigure the subnet mana ger . Note th at fo r run time-ty pe par ameters the Sub net mana ger ma y need to be restart ed for them t o take effect . smShowLids Display all fab ric LID infor mation as kn[...]

B-36 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 NO TES: Use this command to di splay the curre nt LID assignme nts for the de vices in the Inf iniBand fab r ic.[...]

B-37 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 smSho wPriori ty Get the pr iority of t he embedd ed subnet m anager . Syntax: Options: Sample O utput: NO TES: Use this co mmand to displ ay the prio rity of the subn et manager . smSetPriority Set the priority of the embedded subnet manager . Syntax: Options: Sample[...]

B-38 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 NO TES: Use this command to set the sweep rate (in seconds) of the subnet manager . V alid v a lues are 3- 86400, or 0 t o turn the s weep o ff. bmSe tSw eepR ate Set the sweep ra te of the embedde d baseboa rd manager . Syntax: Options: Sample O utput: NO TES: Use t his[...]

B-39 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 NO TES: Use this co mmand to fo rce a swee p by the baseboard manager. smShowGr oups Display multicast group information in the embed ded subnet manager . Syntax: Options: Sample O utput: NO TES: Use th is command to d isplay multic ast group i nformation in the subne[...]

B-40 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Sample O utput: NO TES: The compo nents(f ields) of eac h service re cord are displayed . Each serv ice recor d is stored in a loc ation ide ntified by a 'Sl ot' numbe r which is displa yed bef ore any co mponent of that Service Record. If a group of slots do n[...]

B-41 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 Sample O utput: NO TES: Use this command to display the e vent forward ing (subscriptio n) table in the subnet manager . smShowMast erLMC Display the Maste r SM's LMC v alue to be used on CA ports. Syntax: Options: -> smShowSubscriptions **********************[...]

B-42 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Sample O utput: NO TES: Use this co mmand to displa y the Master SM' s LMC value to be used on CA port s. smSetMas terLMC Set the SM's LMC value to be used on CA ports. Syntax: Options: Sample O utput: NO TES: Use this command to set the SM's LMC va lue to[...]

B-43 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 Sample O utput: NO TES: Use this co mmand to displ ay the LID -to-por t GUID map of the subnet ma nager . smShowMaxL id Display the highest LI D allocated b y the subnet manager . Syntax: Options: Sample O utput: NO TES: Use th is command to display t he highest L ID [...]

B-44 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Options: Sample O utput: NO TES: Use this command to set the head of queu e lifetime in the subnet manage r . smSetVLSta ll Set the VL stall v alue in the su bnet manager . Syntax: Options: Sample O utput: NO TES: Use th is command to set the VL stall v alue in the su bn[...]

B-45 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 Sample O utput: NO TES: Use t his co mmand t o displa y a sam pling of subnet manag er param eters. smSetPKey Conf igure a PK ey in the PK ey table. Syntax: Options: Sample O utput: NO TES: PKe ys are used for partit ioning the subnet. Only conf igure PKe ys if the ho[...]

B-46 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Sample O utput: NO TES: PK e ys are u sed fo r parti tioni ng the subnet. Only c onf igure PK eys if it is supp orted b y the host driv er . smSetKey Set the subne t manager key (SMInfo) value. Syntax: Options: Sample O utput: NO TES: Use t his co mmand t o set t he SM k[...]

B-47 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 Sample O utput: NO TES: Use this command to set the SM management k ey . SM must be of fline and mk ey v alue is up to 8 byte hex. smShowMKey Display s the m anagem ent key (MKey) of th e subnet mana ger . Syntax: Options: Sample O utput: NO TES: The Mana geme nt K e [...]

B-48 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 smSetDefBcGr oup Set a default bro adcast gr oup in the su bnet man ager . Syntax: Options: Sample O utput: NO TES: This will create a de fault broadca st group with 1 member with a GUID of 0x0006 6A00F A CADE01 ull. Exec uting th is com mand w ith no pa ramete rs crea t[...]

B-49 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 smSetGid Prefix Set the subne t's Subnet Prefix (defa ult=0xfe800 000000 00000). Syntax: Options: Sample O utput: NO TES: Use th is command to set the SM's Subnet Prefi x . SM m ust be of fline and Subnet Prefix v alue is 8 byte he x. smShowGi dPrefix Displa[...]

B-50 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 NO TES: Use this command to tune the SM to handle the co nfig ured fabric si ze. This should be expr essed in terms of the upper limit of HCA ports on the subnet. Setting this v alue will not take ef fect un til the Sub net Manag er is r estarted. smShowSubne tSize Displ[...]

B-51 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 Sample O utput: logClear Clears the log f ile. Syntax: Options: Sample O utput: logConfigure Conf igures the log se ttings. Syntax: -> logshow W|2006/10/04 20:26:31.176U: Thread "Log" (0x8fdab3b0) Log: Unable to Send Trap: 523:Bad:65535 W|2006/10/04 20:26[...]

B-52 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Options: Sample O utput: NO TES: This is an interacti ve command to config ure log settin gs. This in vo lves setting which l og le vels are acti ve. Definitions: – Preset: En able or disa ble each lo g le vel that may be gen erated on the syst em – Device: Enab le a[...]

B-53 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 Sample O utput: logSyslogConfig Configure the syslog ho st IP addr ess. Syntax: Options: Sample O utput: NO TES: The device can fo rward its l og message s to a syslog host if con figured. This command allo ws a user to conf igure the h ost and port to send messages t[...]

B-54 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Sample O utput: KeyManagement showKeys Display the lice nse keys for th e unit. Syntax: Options: Sample O utput: -> logShowConfig Log Configuration for Slot 3: ------------------------------ Configurable devices index : name : |D|F|E|A|W|P|C|I|P|1|2|3|4|5| -----------[...]

B-55 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 NO TES: Lice nse keys unlock various soft ware fea tures of the pr oduct. addKey Add a license ke y . Syntax: Options: Sample O utput: removeKe y Re move a li ce ns e key . Syntax: Options: Sample O utput: NO TES: After ente ring this command a list of av ailable k ey[...]

B-56 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 • ismChassisSetEnable • ismPortDisable • ismPortSetSpeed • ismIslSet12x • ismChassisSetMtu • ismIslSetSpeed i s m P o r t S ta ts Displays link error i nformation a ssociated with each switch port. These statisti cs include errors, dropped packets , discard e[...]

B-57 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 Sample O utput: Note Port statistic descriptio ns: – PhysStat e - The physic al state of the po rt. – PortState - T he st ate of the link on this p ort. – LinkWidth - The currently activ e link widt h on this por t. – LinkSpeed - T he currently acti ve link sp[...]

B-58 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Syntax: Options: Sample O utput: Note Port co unter descr iptions: – T ransmit, Pack ets - The number of packe ts transmitted b y the port, not includin g flow con trol packets. – T ransmit, W o rds - The nu mber of data words tr ansmitted b y the port, not inclu din[...]

B-59 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 Syntax: Options: Sample O utput: ismMultiFwdb Sho w Multica st F orwardi ng Database f or switch. Syntax: Options: Sample O utput: Note This comma nd is best display ed with a term inal widt h of at least 120 co lumns . ismAutoClearConf This featur e will clear the In[...]

B-60 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Syntax: Options: Sample O utput: Note This feature will log ev ery time a counter has reached its maxi mum capacity . This may be useful for dia gnostic s purpose s, spe cifi cally for bad cables. This feat ure is only av ailable on cer tain switch ha rdware platf orms. [...]

B-61 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 Note Th is comm and work s only o n platf orms suppo rting 12X lin k aggregati on. The opt ion po rtName is ca se sensi ti ve. If i t con tains spa ces, it must be bound ed by quot es (e.g ., ismPortSet12x "Ca ble 1", 1). Using this co mmand without the opti[...]

B-62 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 ism Chas sisS etS peed Allo ws the user to vie w and set port li nk speeds (includi ng external por ts) for the entire chassis to 2.5 (S DR), 5.0 (DDR) or Aut oNegotiate. Syntax: Options: Sample O utput: Note DDR links (5.0 ) are only a vailable on chassi s supportin g D[...]

B-63 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 Note The option portName is ca se sensitive. If it c ontains sp aces , it must be bound ed by quote s (e.g., ismPort Enable " Cable 1 "). A reboot i s requi red to a ctiv ate c hanges made wi th this comman d. This reboot will be disrupti ve an d will cause [...]

B-64 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Note The option port is case sensitive. If it contains spac es, it must be bounded by quotes (e.g. , ismPort Enable " Cable 1 "). A reboot i s requi red to a ctiv ate c hanges made wi th this comman d. This reboot will be disrupti ve an d will cause the af fect[...]

B-65 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 Note This comma nd works o nly on chassis supportin g 12X link aggregatio n. This c ommand enables 12X link aggregatio n so that internal switching will be 12X. E xternal ports r emain co nfigured to 4X and do not requi re special c abling co nfiguration t o functio n[...]

B-66 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Note Thi s command works only on chassis supporting DDR links. This command sets inter - switch link spe eds to either 2.5, 5. 0, or Aut oNegotiate. Externa l ports r emain c onfigured to SDR rate (2.5) an d do not re quire special ca bling con figuration t o functi on c[...]

B-67 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 – 8 portLinkD o wned : link error rec ov ery proc ess failed – 9 portRec vErr: e rrors rece iv ed – 10 portRe cvRemP hysErr: remo te physical er rors rece i ved – 12 portXmi tDiscard: por t transmit disc ards – 13 portPKeyV iolIn: PKe y inbound was in valid [...]

B-68 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 – portRe cvRemPhysE rr – portXmitDiscar d – portPK eyV iolIn – portPKeyV iolOut – portRawV iol In – portRawV iol Out – portLo calLinkInt eg – portExcBu f ferOverrun – portRe layedVL15D ropped – portLo calVL15 Dropped – portNonSMPDropped[...]

B-69 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 TimeManagement time Conf igure th e time on the de vice. Syntax: Options: Sample O utput: Note T im e can be configured locall y (using a loca l cloc k) or se t to be updated by an SNT P server . Please note th at if you set the time lo cally , the unit will unconf ig[...]

B-70 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Note The of fset paramete r specif ies a ti me zone the sy stem should use when setti ng the ti me. In the U.S. the f ollowing time zone s are in effect: E astern Standa rd T ime = G MT -5; Ce ntral Stand ard T ime = GMT -6; Mountain Standard T ime = GMT -7; Pa cifi c St[...]

B-71 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 Options: Sample O utput: Note W ith no ar guments, this co mmand displays th e current NTP tim eout settings. Th is is the amount of time (in sec onds) for the system to wait for a respo nse from the NTP serv er . This setting can be con f igure d by using the same co[...]

B-72 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 SNMP snmpCommunityConf Display s and allows the changing of th e SNMP comm unity strings. Syntax: Options: Sample O utput: Note If no opt ions ar e ent ered the current SNMP r ead-only commun ity stri ng and read-wr ite communi ty string is displayed. If options a re ent[...]

B-73 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 Options: Sample O utput: Note The output is in the form: 'mib : mib_object : table_ index : v alue' . For more details on the snmpT argetAddrT able se e SNMP-T ARG ET -MIB, RFC 2573. show Displays th e contents of the snmpTargetAddrTable . add Adds a row to [...]

B-74 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 snmpT argetParams Displays the snmpT arget Param sT able entries. Syntax: Options: Sample O utput: Note The output is in the form: 'mib : mib_object : table_ index : v alue' . For more details on the snmpT argetPa ramsT abl e see SN MP-T AR GET -MIB, RFC-2 573.[...]

B-75 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 snmpNotifyFilte r Displays the snmpNo tifyFil terT able entries. Syntax: Options: Sample O utput: Note The output is in the form: 'mib : mib_object : table_ index : v alue' . For more details on the snmpNotifyFilter T able see SNMP- NO TIFICA TION-MIB, RFC-2[...]

B-76 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 snmpSyst em Display s and allows the changing of the Mib-2 syst em entri es. Syntax: Options: Sample O utput: Note The output is in the form: 'mib : mib_object : table_ index : v alue'. snmpUsrSec Configure and display SN MP V3 u sers. Syntax: snmpSystem [show [...]

B-77 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 Options: Sample O utput: Note Handles co nfiguration an d display of SNMP v3 users. Su pporte d authent ication algorit hms are: NONE, MD 5, and SHA . A passphrase is re quired for a ll except the NON E algorithm . No priv a cy algorithms ar e curren tly support ed. C[...]

B-78 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Note This comm and is intende d for su pport p ersonnel . capture Fw Display f irmware info rmation fo r this de vice. Syntax: Options: Note This comm and is intende d for su pport p ersonnel . capture Log Display log informatio n for this device. Syntax: Options: Note T[...]

B-79 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 Syntax: Options: Note This comm and is intende d for su pport p ersonnel . capture Chassis Display chassis infor mation for this de vice. Syntax: Options: Note This comm and is intende d for su pport p ersonnel . captureNetwork Display chassis infor mation for this de[...]

B-80 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Note This comm and is intende d for su pport p ersonnel . capture Snmp Display SNMP informa tion for this dev ice. Syntax: Options: Note This comm and is intende d for su pport p ersonnel . capture Shell Display sh ell command in formation f or this de vice. Syntax: Opti[...]

C-1 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 APPEND IX C Troubleshooting This appe ndix describes ho w to trouble shoot the Cisco SFS 7012™, and it inclu des the following inform ation: • Hard war e Chec ks, pa ge C-1 • T r oublesh ooting Sc enarios, page C- 3 Hardware Checks Switch Powe r Supply Problem Fi[...]

C-2 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05 Fan OOB Ethernet RJ45 Port SFS 7012 Leaf Module IB Po rts Problem Fix Red LED is lit Call T ech Support Fan not ru nning Ensure fan is seated properly . If fan con tinues to be inoperable, ca ll T ech Support Problem Fix The SFS 7012 E thernet Port(s) ha ve a RJ45 Cable w[...]

C-3 Cisco SF S 7012 Infini Band Serve r Switch Ha rdware Users Gui de OL-8787-05 Troubleshooting Scenarios InfiniBand This section documents common problems seen with the SFS 7012 switch. Invalid IP Address entered via Console Port Symptoms Cannot access the Chassis V iewer brow ser window . The browser window times out and Chassis V ie wer will no[...]

C-4 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-05[...]