Cisco Systems SFS 7012 Bedienungsanleitung

Corporate He adquarters Cisc o Syst ems , Inc . 170 West Ta sman Drive San Jos e, CA 95 134-1706 USA http://www.ci sco.com Tel: 408 526-4000 800 553- NETS (638 7) Fax: 408 526-4100 Cisco SFS 70 1 2 Inf iniBand S erver S witc h Hardware Users Guide Text Pa rt Nu mber: OL-8787- 04[...]

THE SPECIFICATIONS AND INFORMATION REGARDING TH E PRODUCTS IN THIS MANUAL ARE SUBJE CT TO CHANGE WITHOUT NO TICE. ALL STATEMENT S, INFORMATI ON, AND RECOMMENDA TIONS IN T HIS MANUAL ARE BELIEVED TO BE ACCURATE BU T ARE PRESEN TED WITHOUT WARRANTY OF ANY KIND, EXPRE SS OR IMPLIED. USERS MUST TA KE FULL RESPONSIBILITY FOR THEIR AP PLICATION OF ANY PR[...]

Content s i Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 New and Changed Inf ormation vii Preface ix Audienc e ix Organi zation ix Conv enti ons x Relat ed D ocum ent atio n x Obtain ing Documentati on x Cisco. com x Produc t Documentat ion DVD xi Orderi ng Documenta tion xi Document ation F eedback xi Cisco Pr oduct Secu[...]

Cont ents ii Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Infin iBand Gene ral Servi ces Manager s and Agents 6 SNMP Supp ort 7 SNMP MIBs 7 CHAPTER 2 Insta lla tion 9 Statemen t 1019—Mai n Disconne ctin g Device 10 Statemen t 1045—Sho rt-ci rcuit Pr otect ion 11 Statemen t 10 74—Comply wi th Local a nd Nati onal E[...]

Content s iii Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Hot Swappi ng Component s 39 Hot Swappi ng Spin e and Leaf Modu les 39 Hot Swappi ng the Fan Uni t 40 Hot Swappi ng Power S upplies 40 CHAPTER 3 Operati ons and Administ ration 41 Chassi s Viewer 41 The C has sis View er Mana ges 41 Home Page 42 ? (Hel p) But ton [...]

Cont ents iv Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chassi s Traps 64 SFS 7012 Por t Stati stics 67 Port Sta tisti cs Field De scripti ons 68 Leaf an d Spi ne Mod ule IB Port St atis tics 70 Leaf Mo dules 70 Spine Modu les 70 Set Fiel d Thre sholds 71 Time Ser vice 73 Config urin g the Switch OOB IP Address 76 Con[...]

Cont ents v Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Captur e 92 Depreca ted 93 APPENDI X C Troubles hootin g 95 Hardwa re Chec ks 95 Switch 95 Pro blem 95 Fix 95 Powe r Sup ply 95 Pro blem 95 Fix 95 Pro blem 96 Fix 96 OOB Et her net RJ 45 Po rt 96 Pro blem 96 Fix 96 SFS 7012 Le af Modul e IB Ports 96 Pro blem 96 Fi[...]

Cont ents vi Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04[...]

vii Cisco SFS 7012 Infin iBand Serve r Switch Hardwa re Users Guide OL-8787-04 New and Changed Information The Cisco SFS 701 2 InfiniBand Se rver Switch Har dware Users Guide applies t o the SFS 7012 Release 3.1 or later . Ta b l e 1 lists the new and change d features av ailable with e ach suppor ted SFS 701 2 release. Ta b l e 1 Document ed Feat [...]

viii Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Red undan t Manage ment Added redundant man agement inf ormation. 3.3 Installing the Spine and Le af M odules, page 2- 26 Upda tin g Manageme nt Spin e IP Addresses in a Redund ant Manage ment Configuration, page 2- 31 Rebooting Multiple Manage d Spines, page 2- 38 Doubl[...]

ix Cisco SFS 7012 Infin iBand Serve r Switch Hardwa re Users Guide OL-8787-04 Preface This pr eface d escrib es th e audie nce, o rganizatio n, an d co n ventions o f th e Cisco SFS 70 12 InfiniBand Server Swit ch Har dware Users Guide . I t also provides in format ion on how to obtain relat ed documentation. Audience The inte nded audie nce for th[...]

x Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Conven tions This document use s the follo wing con ventions for notes, cautions, and safety warnings. Notes and Ca utions co ntain importa nt infor mation th at you shoul d be aware of. Note Means r eader tak e note . Not es co ntain help ful s ugges tion s or refer ence s[...]

xi Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Y ou can access inte rnational Cisco websites at th is URL: http://www .cisco.com/pub lic/countries_la nguages.shtml Product Docu mentation DVD The Product D ocu mentat ion DVD is a l ibrar y of tec hnica l produc t docu ment ation on a por table mediu m. The D VD enables yo[...]

xii Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 T o see security advisor ies, security notices, and securi ty respon ses as the y are upda ted in real time, you can sub scr ibe t o the P roduc t Secu ri ty Inc iden t Res ponse T eam Really Simple Syndication (PSIR T RSS) feed. I nformation about ho w to subscribe to th[...]

xiii Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Obtaining Tech nical Ass istance Cisco T echni cal Suppo rt provides 24- hour-a-day award-w inning tec hnica l assistan ce. Th e Cisco T echni cal Su pport & Docum entati on web site on Cisco .com f eature s extensive online sup port resourc es. In additio n, if you ha[...]

xiv Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Submitting a Se rvice Request Using the online T A C Service Request T oo l is the fa stest way to open S3 and S4 service r equest s. (S3 and S4 service re quests are those in which your net work is minimall y impaire d or for which you require product i nfor mation. ) Af[...]

xv Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 • The Cisco Pr oduct Quick Re fer ence Guide is a hand y , compa ct refere nce tool that include s brief product overviews, key feature s, sample par t numbers, and abb reviated technic al specifications for many Cisco prod ucts tha t are sold thr ough c hann el part ners.[...]

xvi Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04[...]

C HAPTER 1 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 1 Product Overview The Cisco SFS 7012™ is an i ndustry leading modular system used for crea ting large, single-system Grid/Cluster serv er fabr ics, or as a bu ilding block for lar ger fabrics. The SFS 7012 is designed to maxim ize perf ormanc e, str eamline ope ra[...]

2 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter SFS 7012 Product Spec ifications Mechanic al/Thermal/Pow er Specificatio ns • 7U - 1 9" ra ck mo unt envi ronm en t • Integrate d ther mal mana gement • Front-to-bac k airflo w • Hot plug, re dunda nt cool ing • Hot plug, re dundant power supplies •[...]

3 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter • A vaila ble power (all fiber): 879 W att s max • A vailab le air flo w: 200 cfm • Thermal stat us reporting to CME via IBML • Up to one hundre d fo rty-fou r (144 ) 4X IB exte rnal c opper ports • T wo ( 2) RJ-45 connec tors fo r 100BASE Et hernet con nect[...]

4 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter – Perform ma intena nce task s – Manage firmware up dates, i ncludin g upl oading new firmware and setti ng the active version.[...]

5 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Subnet Ma nager Every InfiniBand fabri c subnet re quires a sin gle active Subnet Manager (SM ) to initialize and maint ain the sub net. The fabri c ma y also have one or m ore standb y Subnet Mana gers. One of t he standby Subnet Manag ers can be con fi gured to be c[...]

6 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter An SMA also runs o n every InfiniBand-c apab le ser ver th at is equipp ed w ith an HCA . As shown i n Figure 1-3 the Subne t Mana ger interact s with t hese SM As to discover infor mati on ab out the nodes on the fa bric. Figur e 1 -3 InfiniBand M anage rs and A ge[...]

7 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter The PM and PMA exchange messa ges about performa nce stati stics and er ror inf ormatio n of InfiniBand devices on the fabric . SNMP Supp ort Built-in support f or Simple Network Man agement Prot o col (SNMP) allo ws users to integrate a SFS 7012 into their e xisting [...]

8 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter[...]

C HAPTER 9 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 2 Installation This chap ter des cribes ho w to install the Cisco SFS 7012™ and its components, and it includes the follo wing information: • Planning t he Install ation, pa ge 2-15 • Installation T asks, page 2-22 • Hot Swappin g Comp onents, pa ge 2-3 9 Not[...]

10 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter War ni n g IMPO RT ANT SAFETY INST RUCTIONS This warning symbol means dang er . Y ou are in a sit uation that could cause bodily injury. Before you work on any equipment, be awa re of the hazards involved with electrical circuitry and be familiar with standard prac[...]

11 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Statement 1045—Short-circuit Protection Avi s o A combinação ficha-tomada deverá ser sempre acessível, porque funciona como interruptor principal. ¡Advertenc ia! El conjunto de clavija y toma ha de encontrars e siempre accesible ya que hace las veces de dispos[...]

12 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Avi s o Este produto requer proteção contra curto-circuito s (sobreintensidade de corrente), que deve e star instalada nos edifícios. Instal e apenas de acordo com as normas de inst alação elétrica nacionais e locais. Advertenci a Este producto necesita estar[...]

13 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Statement 1074—Comply with Loca l and National Electrical Codes War ni n g Installation of the equipment must comply with local and national electrical codes. Statement 107 4 Waarschuwing Bij installati e van de apparatuur moet worde n voldaan aan de lokale en nati[...]

14 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Stat ement 1 075—Hazar dous Voltage or En ergy Pres ent on DC Power Term inals War ni n g Hazardous voltage or energy may be present on DC power terminals. Alway s replace cover when terminals are not in service. Be sure unins ulated condu ctors are not accessibl[...]

15 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Planning the Installation Environmental Requirements T o assure proper operation and a v oid unnecessary mainten ance, the installati on site must conform to certain e n v ironmental sp ecif ications. ¡Advertenc ia! Puede haber energía o voltaje peligrosos en los t[...]

16 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Rack Specificati ons and R ecommendations The SFS 7 012 switch is d esigned to be installed in an existing 1 9-inch equipm ent rack or server rack. The SFS 7012 switch i s designed for a four-pos t server cabin et. It i s not de signed for a two -post t elco cabine[...]

17 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Figur e 2-3 Bend Radius Measur ement Diagra m • Support c able using a cable mana ger mount ed above connector s to av oid unne cessary weight on the cable bundles. • Bund le ca bles usin g v elc ro s trap s to a voi d damagi ng cables . • Keep all ports an d c[...]

18 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Installation Tasks Checklist T o perform the a ctual switch in stallation, t he site implem entation e ngineer must perform the foll owi ng tasks, which are detai led in this section. Cautio n Be sure to review the Safety Info rmati on on page 18 before sta rting t[...]

19 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Precauti ons for R ack-Mountable Pr oducts War ni n g Installing sy stem components in a rack without th e front and side stabilizers installed could cause the rack to tip over . Therefore, alway s install the stabilizers before i nstalling components in the rack. Wa[...]

20 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter War ni n g This unit may have more than one power cord. T o reduce the risk of electri cal shock, disconnect both cords before servicing the unit. War ni n g T o avoid potential electrical shock, operate this unit only when the cover is in place. War ni n g T o avo[...]

21 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Check the Installation S ite The SFS 7012 switch is designe d to be instal led in an exis ting server cabin et (not a telc o cabin et), w here it can be mounted in a standard equipment rack . Mounting brac kets are integrate d with the switch. Be sure of the follo wi[...]

22 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Installation Tasks The follo wing is an ov ervie w of the installatio n tasks detailed in this section: Step 1 If appl icab le, rem ove the doors of t he rac k. Step 2 Mark th e rack, a llo wing 7 U (12.25 i nches) of vert ical spac e to install the SFS 7012 s witc[...]

23 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Step 1 Inst all the caged nu ts into the 2 ba ck holes (c hassis leaf module si de) and the top and bottom hole s (chassis fan side) in the front of the rack. Note The 2 front holes should match up with the top and botto m holes of t he rail fron t flange . All hol e[...]

24 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Rack-Mount t he Switc h Cautio n Because of its size and weigh t, it is recommended that eithe r a lifting de vice or three (3) peo ple install the SFS 7012. T o install the sw itch int o the rack, p erform the f ollo wing st eps: Step 1 Clear th e area of an y unn[...]

25 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Figur e 7 Secur e Chassis t o Rac k Step 6 Using tw o scre ws, install the lo wer mounting brac ket to the rail a ssembly and ch assis as sho wn in Figure 8 . Figur e 8 Instal l the Lo wer Mount ing Br ack et and He yclip Step 7 Install the he yclip to the rail assem[...]

26 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Step 1 On the swit ch fan side, inser t the notche s on the top o f the f ascia into the two sl ots on the chassis f rame. Snap t he botto m of t h e f acepl ate in p lace. Removing a Module or Blank The handl es ar e sel f-lo cking. T o unl ock, p ush up on t he h[...]

27 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Figur e 2-9 SFS 70 12 Chassis — Sp ine Module Sl ot Number ing b. Leaf Mo dules— Leaf mo dules shoul d be populat ed beginning with slot 1, then slo t 2, then slots 3 through 12 r espec tively . Refer to Figu re 2-10 : Figur e 2-1 0 SFS 70 12 Chassis — L eaf Mo[...]

28 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Figur e 2-1 1 SFS 70 12 Chassis F ront V iew Figur e 2-12 SFS 70 12 Chas sis Bac k Vi ew Step 1 Connect a Cate gory 5 or 6 (Cat 5/6) Ethernet cable to one of the RJ-45 co nnectors on the SFS 7012. Connect the other end of the Cat 5/6 to the OOB LAN workstation. Ref[...]

29 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Note Whe n handling IB conne ctors, ma ke certain to remove the connec tors by pulling on the center o f the lanyard only as shown in Figur e 2-13 below . Pulling abrup tly on the lanyar d, or pullin g on only o ne side of the lanyard will prevent the lat ch/unl atch[...]

30 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Note If the spine module RS-232 port is conne cted to a terminal emula tion program, the user will be able to view the switch boot pr ocess. Be c ertain to use a null-mo dem/cr ossover se rial cable fo r the conso le po rt. The settings for the te rminal emulation [...]

31 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Step 2 Po wer up the SFS 70 12. Note If using the RS-2 32 port, skip to Step 6 . Steps 3 throug h 5 are for those user s accessing the SFS 7012 via T elnet or SSH. Step 3 If using T elnet or SSH, access the SFS 7012 with the follow ing command: open 192.168.100.9 Ste[...]

32 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Step 1 Ensure that the spine module is connecte d to a COM port on a serial ter minal de vice via the RS-2 32 port. Step 2 Get to a [boot] : p rompt by foll owing Step a or b. a. If the man aged sp ine is r unning, ent er the foll owing comm and at th e co nsole: r[...]

33 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Image Date: Jan 19 2006, 15:03:31 Checking L2 functionality... BCM1125 L2 caches initialized and invalidated CPU0 caches initialized Initialized SMBUS Channels SPD Checksum ok. MEM_SEL = 0x00000007 CPU_REV = 0x00000001_112421FF CPU speed = 400 MHz IO Bridge 0,1 speed[...]

34 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter md5 values match! 11088736 Starting at 0x80010000... sysI REGS BOOT Initializing HyperTransport bus HyperTransport initialization completed Found Intel Strata Flash 128 MBit (0x8918). Mounted raw file system on device /image1. (size=6291456 bytes) Mounted raw file [...]

35 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter The ch ass is st atu s LED is off wh en: • There are no functi onal po wer supp lies pres ent. • There are no mana geme nt card s in the sys tem • A C power has been re moved from the system. Subnet Manager Age nt (SMA) LED There is a single SMA LED associa ted[...]

36 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter • F ast Blink - IB data is flowing through th e port. • Off - the physi cal lin k is down (port is in t he Down state). Spine and Leaf Module Stat us LED The status LED i ndica tes one of the foll owing condi tions: • Steady Green - the module is operating no[...]

37 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Accessing On-line Help Online help can be accessed from any where within the Chassi s V iewer by clicki ng on the ? bu t t o n s a s sho wn in Figure 2-15 : Figur e 2-15 Chas sis Viewer Online Help But ton(s) The on-line help screens contain topi cal information with[...]

38 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Figur e 2-16 Sample Chassis Viewer On-line Help Scr een Shutdown Procedures In orde r to sh utdo wn the SFS 7012: Step 1 Po wer do wn the switch b y removing th e po wer cords from th e A C po wer inlets. Rebooting Components from Chassis Viewe r Step 1 From the Ch[...]

39 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Step 2 The syste m prompts fo r a user name . At the pr ompt enter : admin Step 3 The syste m prompts fo r a password. At the prompt enter: adminpass The system responds with: Welcome to the SFS 7012 CLI. Type 'list' for the list of commands. Step 4 T o re [...]

40 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Step 4 Push the handles in to fully close. Hot Swappin g the Fan Unit Step 1 Loosen t he captive panel sc rew . Step 2 Pull the panel scre w do wn to parti ally disenga ge the u nit. Step 3 Slo wly pull the unit. The unit will d isengage from the co nnector . Step [...]

C HAPTER 41 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 3 Operations and Administration This c hapter describe s how to ad minist er and configure the Cisco SFS 7012™ and i ts c ompon en ts, a nd it includ es the fo llo wing informatio n: • Logging , page 3-53 • Firmware Upda te, page 3-5 8 • SNMP , page 3 -59 ?[...]

42 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Home Page Figur e 3-1 Ch assis Vi ewer H o m e Page The Chassis V ie wer ’s home p age provides a high-lev el overvie w of the SFS 70 12 switch and individual leaf and spine modules. This area is the starting point to more detailed information f or the SFS 7012 c[...]

43 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Figur e 3-4 Suppor t Contact Scr een Displaying th e Lea f and Spine M odule Views Leaf Module View T o display the leaf m odule vie w for the SFS 7012: Step 1 Mouse over the leaf mo dule to disp lay . The edg es of the lea f module are high lighted green as shown in[...]

44 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Figur e 3-6 Leaf Modu le View Spine Module View T o display the spine modu le vie w for the SFS 7012: Step 1 Mouse over the spin e modu le to displ ay . The e dges of th e spine m odule ar e hig hlighte d gree n as shown in Figure 3- 7 below: Figur e 3-7 Spine M od[...]

45 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter • Infor mation a rea . • Menu Figur e 3-9 Leaf and S pine Comp onent Details Ar ea Leaf and Spine Details Header The leaf and spine Details Header allo ws the user to ex ecute the most common tasks for the SFS 7012 switch: • Display the Home page • V iew fiel[...]

46 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Step 1 Mouse o ver the oute r reg ion of the leaf mod ule vie w . The edge s of the ch assis ar e highlig hted gr een as sho wn in Figure 3-11 belo w: Figur e 3-1 1 Leaf Modu le Chassis Mouseo ver Left c lick the m ouse. Th e chassis vie w will be d isplayed. Step [...]

47 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Figur e 3-13 Chassis V iew er Component Deta ils Ar ea Chassis V iew Co mponen t Details Area The Component De tails Ar ea contains three areas. • Details He ader • Infor mation a rea . • Menu Chassis Details Header The Chassis Details Header allows the user to[...]

48 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Figur e 3-15 Reboot Scr een Step 2 Select the radio button of the spine (s) to be reboot ed, or select the Reboot Entir e Chassis ra dio b utton to r eboot the SFS 7 012 cha ssi s and all sp ine s. Step 3 Click Reboot . Rebooting Mult iple Managed Spines In a redun[...]

49 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Chassis V iew Co mponent Informatio n Area Figur e 3-16 Component In for mation Ar ea The Chassis V iew Compo nent Inf ormation Ar ea al lo ws the user to vie w important sy stem inform ation. The se fields are t ied t o live data from the se lect ed hard ware co mpo[...]

50 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Figur e 3-17 LEDs and Se nsors T ab Note For a de tailed explanati on of physic al LED s on the hardware compo nents , plea se refer to the secti on SFS 7012 Compone nt LED s, page 2-34 . System T ab The System tab displays the o verall system information of the SF[...]

51 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter The te xtual identif ication of the con tact pers on and th eir conta ct informati on for this sy stem, assigne d by the admi nistrat or . System Name The n ame for th e syste m, assig ned b y an admi nistrator . One con vention is to use the sys tem's fu lly qu[...]

52 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Displa ys the pa rt number of th e compone n t. Detail A button fo r each row that disp lays a dditiona l deta il about the compone nt. A ddition al de tails inclu de: Mo del, V ersi on, Ma nufactur er N ame, Pr oduct N ame , Manu facture r Id, Manu facture d Dat e[...]

53 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Configuration a nd Monitoring Feature s The fol lo wing section provid es detailed, t ask-oriented descriptions for conf iguring and monito ring the SFS 7012 sw itch and its featu re functiona lity . Chassi s View Menu Figur e 3- 19 Ch assi s View Me nu The Chassis V[...]

54 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Figur e 3-20 Logging Sub menu Set Level Figur e 3-21 Set Leve l Butt on The Set L ev e l b utton a llows th e user t o set lo g lev el confi guration param eters for al l softw are modules on the SFS 7012. T o set log lev els: Step 1 From th e me nu, sele ct Loggin[...]

55 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Figur e 3-23 Device T ab: Sof twar e Module Configur ator T o change any Log Le vel s ettings : Step 1 Click the On-O ff checkbox to the righ t of the setting. Step 2 Click the Submit button to save any change s. The following l ist de scribe s each of t he Log L eve[...]

56 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Debug message levels 1 through 5 : Debug message s are for suppl ier an d/or Cisc o enginee ring use and ar e not nece ssari ly in dicat ive of actions tha t an en d user m ay need to take. – DEBUG 1 – M essag es tha t descr ibe the states of c onnect ions a nd[...]

57 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Syslog Tab Figur e 3-25 Log S ystem Configur ator: Syslog Host T ab The Syslog tab allo ws the user to sav e log files to a syslog host. T o s etup the syslog host: Step 1 In the Host IP dialog box, enter the IP addre ss of the syslog host w here the log files a re t[...]

58 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Figur e 3-27 Reset Log Lev els Windo w Step 4 T o rese t th e log gin g levels, cl ick OK . Firmware Update Figur e 3-28 Fir mwar e Updat e Butt on The Firmware Update button all ows the user to selec t an alternate f irmware f ile for the SFS 7012. These alternate[...]

59 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter SNMP The SNM P submen u allo ws the us er to conf igure and fil ter SNM P trap inform ation. Figur e 3- 30 S NMP Sub men u Target Configur ation The T arget Configu ration button disp lays the SNMP T arget Con figuration W indow , allowing the user to view and edit e[...]

60 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Figur e 3-32 SNMP T ar g et Configu ratio n Windo w The t op sect ion of the w indow , SNMP T arget A ddresses, allows the user to de termine what t ype of SNMP trap s are sent, and where t hey are sen t. T he ro ws p rovid e an a rea fo r specif ying multiple trap[...]

61 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Note The combination of the T ransport Doma in and the T ransport Address deter mines the trap destina tion. • Port Specifies the TCP port which th e SNMP trap will be sent. • Ti m e o ut Specifies the time that the trap sen der waits on a respo nse before re-sen[...]

62 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter • Security Model The Secu rity Model t o be used when g enerating SN MP messages u sing this entr y . V alues for this field are 1, 2, or 3. • Security Name Securit y name identif ies the en tity for wh om SNMP messages will be generated. Note This is equi vale[...]

63 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Step 1 From th e me nu, sele ct SNMP Step 2 Click Filter Status . The SNMP Filter St atus sc reen is di splaye d. Figur e 3-34 Filt er Status Scr een Setting Community Strings The Set Community Stings screen allo ws the user to set two SNMP community names: • Read [...]

64 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Figur e 3-36 Set Community Str ings Window Th e fir s t fi el d , " Read Only Comm. Name ," is the c ommunity st ring that wh en spe cified in an SNMP client , allows read o nly ac cess to SNMP fields expor ted by t he SNM P server . The sec ond field, &q[...]

65 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Step 5 T o sav e settin gs, click on Apply . Foll owi ng are def initions for each ch assis trap: Chassis Group icsChassisT rapSystemSelfT estFailur e This trap indicates th at the chassis failed one or more of its self-test(s). icsChassisT rapSystemReboot This trap [...]

66 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter This trap indica tes that a po wer supply is not responding to HEA R TBEA T poll re quests, that are issued by the internal chassis management service. icsChassisT rapPowerSupplyInser ted This trap indica tes that a power supply was inserted into the chassis. icsCh[...]

67 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter SFS 7012 Port Statistics The Chassis V iew P ort Stat istics area provides I B port informatio n for all of the e x ternal and internal ports of the SFS 7012. Figur e 3-39 IB P ort Sta tistics T o view port statistical informat ion, do the follo wing: Step 1 From the[...]

68 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Note Spin e chips are refe renced b y the spine numbe r and the switch chi p identif ier . Each spine m odule contains two swit ch chips (Switch c hip A and B). Port Statistics Field Descriptions Po rt Name/P ort Number: Correspon ds to external leaf modu le num be[...]

69 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Recei ve 32 B it W ords: The num ber of 32 -bit d ata words received by the port, n ot incl uding flow control and VCRC da ta. Tr a n s m i t P a c k e t s : The numbe r of data pa ckets transm itted by the por t, not includ ing flow control packets. Recei ve P acket[...]

70 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Leaf and Spine Module IB Port Statistics T o access IB port stat istics for a specif ic leaf or spine m odule, per form the follo wing steps. Leaf Modules Step 1 Select a leaf module. The le af modu le vi ew is disp layed. 1. From the Leaf Port S tats menu, select [...]

71 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Figur e 3-44 Spine P ort Stati stics Windo w For inform ation on the each IB port st atistic f ield, refe r to the sect ion Port Statistics Field Descriptio ns, page 3 -68 Set Field Thresh olds The Set Field Thre shold s sc reen al lows the u ser to set , for a sp ec[...]

72 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Figur e 3-46 Set Er ror Report ing Thre sholds Scr een Step 3 T o change a threshold v alue f or an y field : a. Click in the Thr eshold fi e l d. b. Enter a new thre shold value. Note For those fields w ith a “ Pe rc en t of M a x ” t ime un it, t he use r may[...]

73 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Note Th e thresh olds for t he following fields are set base d upon the number of error message which ca n occur in one second. The value can be from 1 t o 65,535 . portSymbolErrThr esh The thre shold for t he numb er of times a 8B10B en coding vi olatio n, or a disp[...]

74 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Figur e 3-47 Switc h Time Service T o set the system time: Step 1 From th e me nu, cl ick Ti me S e rvic e . Step 2 Click Set System T ime . Th e System Time Inf orm ation scre en is displaye d: Figur e 3-48 Sys tem Time Inf or mation Scr een To u s e N T P : Step [...]

75 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Step 1 Make sure the Use Netwo rk T ime Pr otocol? checkbox i s unc hecked. Step 2 Set the cur rent date and time using the drop-do wns for Month , Day , a nd Ye a r as well as Hour , Minute , Seconds , and AM/PM . Step 3 T o s ave, click on Apply . Figur e 3-50 Time[...]

76 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Note Beginning in 2007, Dayligh t Saving T ime in the United Sta tes begins at 2 a.m. on the seco nd Sunday o f Marc h, and en ds at 2 a.m . on the fi rst Su nday in No vemb er . – 2006 = Oct. 29 (5th) Additiona lly , fo r those US regions that do not obse rve DS[...]

77 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Figur e 3-54 Set S witc h Def ault Gat ewa y IP Addr ess But ton Step 2 Click in the OOB IP Addr ess fie ld . Figur e 3-55 Set Def ault Gatew ay IP Windo w Step 3 T ype in the correct switch def ault gate way IP address. Step 4 Click A pply . Note A reboot is re quir[...]

78 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Spin e View Menu Figur e 3-56 Spine V iew Menu Note For i nforma tion on IB po rt sta tistic s re fer to the se ction SFS 7012 Port Statistics, page 3-67 . Logging The Lo gging subme nu allows the user to view , se t lev els, re set lev els, a nd purge the message [...]

79 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Step 1 From th e me nu, sele ct Logging. Step 2 Click Vi ew Lo g . The log m essag e win dow is displ ayed: Figur e 3-59 Sample Mess age L og T o save a log message for fur ther ana lysis, perform th e following steps: Step 1 From the Messa ges window , se lect Edit [...]

80 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Figur e 3-61 Purg e Log Confir mation Windo w Step 3 Click OK . Step 4 The messa ge log file is now pur ged. Select Bo ot Image The Select Boot Image button allows the user to cho ose an alternativ e bo ot image for the SFS 7012 . T o select a boot image: Figur e 3[...]

81 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Adding a New License Key Step 1 Click Lice nse K eys . The K ey A dministrati on button is displaye d: Figur e 3-64 Lic ens e Key Subm enu Step 2 Click K ey Administra tion . The Key Management window is displayed: Figur e 3-65 Key Mana gemen t Wi ndow Step 3 T o add[...]

82 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Figur e 3-68 License Ke y Delet e Pr ompt Step 4 Click OK to dele te.[...]

83 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 APPEND IX A Technical Specifications Ta b l e A -1 SFS 70 12 T ech nical Specifica tions Switch Phys ical Dime ns io ns • 7U high ( 24.5”) • 19" rac k mo unt ( 17.32 " wi de) • 25 3/4" deep (without cable s) W eight • 100 lb. (includi ng power suppli[...]

84 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Appe ndi x[...]

85 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 APPEND IX B Command Line Interface This a ppend ix incl udes th e fo llowing inf ormatio n: • Command s and Functiona l Groups , pag e B-86 • Accessi ng the CLI, page B-87 • Groups a nd Co mmands, page B -88 Overview This section detai ls the usage of the Command Line [...]

86 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Appe ndi x The CLI is also accessible through the RS232 serial port o f the SFS 7 012. Acc essing the CLI throug h the seri al po rt never requires a login and password a nd defau lts to admini strator privileges. Providin g access through the serial port means th at users[...]

87 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Append ix Captur e: Pro vides com mands for cap turin g switch-s pecif ic information fo r the purpo ses of analy sis and debugging. T o list commands w ithin a functi onal group, simply type in the funct ional group nam e. Fo r example , to list a ll of the fir mware c omma[...]

88 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Appe ndi x – Administrator access: admin T ype the ap propria te usern ame an d press Enter . Step 3 The syste m prompts fo r a password. The CLI has the following default passwords: – Operat or a ccess: oper pa ss – Administrator access: adminpass T ype the appro pr[...]

89 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Append ix exit Exit the CLI Deprecated smDisplayLids Use smShowLids smGetPriority Use smShowPriority smDumpGroups Use smShowGroups smDumpServices Use smShowServices smDumpSubscriptions Use smShowSubscriptions smDisplayMasterLMC Use smShowMasterLMC smDisplaySmMasterLid Use sm[...]

90 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Appe ndi x Chassis slotInfo Prints out chassis slot occupants hwMonitor Monitor fans, power supplies, and port state showIBNodeDesc Show the IB Node (SMA) Description (or the Default) setIBNodeDesc Set the IB Node (SMA) Description fruInfo Display field replaceable unit in[...]

91 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Append ix Network ifShow Displays the interface statistics for the OOB management port routeShow Displays the interface routes for the OOB management port ping Send Ping packets to a specified IP address showChassisIpAddr Displays the chassis IP address setChassisIpAddr Chan[...]

92 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Appe ndi x Firmware fwUpdateSlot Update units firmware fwUpdateChassis Update units firmware fwListFiles Lists the contents of the firmware RAM disk fwShowUpdateParams Display firmware default update parameters fwSetUpdateParams Configure firmware default update parameters[...]

93 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Append ix IbSwitchInfo ismPortStats Show statistics for all ports ismPortCounters Show Port Counters ismLinearFwdb Show/set Linear Forwarding Database for switch ismMultiFwdb Show Multicast Forwarding Database for switch ismAutoClearConf Configure the port statistics counter[...]

94 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Appe ndi x Capture capture A combination of all capture commands that follow captureFw Capture firmware information captureSm Capture subnet manager information captureIsm Capture IB switch information captureChassis Capture chassis information captureLog Capture log infor[...]

95 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 APPEND IX C Troubleshooting This appe ndix describe s how to troubleshoot the Cisco SFS 7 012™, an d it inclu des the following inform ation: • Hard war e Che cks, pa ge C- 95 • T r oublesh ooting Scenar ios, pa ge C-97 Hardware Checks Switch Powe r Supply Problem Fix [...]

96 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Appe ndi x Fan OOB Ethernet RJ45 Port SFS 7012 Leaf Module IB Ports Problem Fix Red LED is lit Call T ech Support Fan not ru nning Ensure fan is seated properly . If fan con tinues to be inoperable, ca ll T ech Support Problem Fix The SFS 7012 E thernet Port(s) hav e a RJ4[...]

97 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Append ix Troubleshooting Scenarios InfiniBand This section documents common problems seen with the SFS 7012 switch. Invalid IP Address entered for SWC via Console Port Symptoms Cannot access the Chassis V iewer brow ser window . The browser window times out and Chassis V ie[...]

98 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Appe ndi x[...]