English dropdown-ico

Cisco Systems SFS 7012 manual

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116

Go to page of

Similar user manuals

A good user manual

The rules should oblige the seller to give the purchaser an operating instrucion of Cisco Systems SFS 7012, along with an item. The lack of an instruction or false information given to customer shall constitute grounds to apply for a complaint because of nonconformity of goods with the contract. In accordance with the law, a customer can receive an instruction in non-paper form; lately graphic and electronic forms of the manuals, as well as instructional videos have been majorly used. A necessary precondition for this is the unmistakable, legible character of an instruction.

What is an instruction?

The term originates from the Latin word „instructio”, which means organizing. Therefore, in an instruction of Cisco Systems SFS 7012 one could find a process description. An instruction's purpose is to teach, to ease the start-up and an item's use or performance of certain activities. An instruction is a compilation of information about an item/a service, it is a clue.

Unfortunately, only a few customers devote their time to read an instruction of Cisco Systems SFS 7012. A good user manual introduces us to a number of additional functionalities of the purchased item, and also helps us to avoid the formation of most of the defects.

What should a perfect user manual contain?

First and foremost, an user manual of Cisco Systems SFS 7012 should contain:
- informations concerning technical data of Cisco Systems SFS 7012
- name of the manufacturer and a year of construction of the Cisco Systems SFS 7012 item
- rules of operation, control and maintenance of the Cisco Systems SFS 7012 item
- safety signs and mark certificates which confirm compatibility with appropriate standards

Why don't we read the manuals?

Usually it results from the lack of time and certainty about functionalities of purchased items. Unfortunately, networking and start-up of Cisco Systems SFS 7012 alone are not enough. An instruction contains a number of clues concerning respective functionalities, safety rules, maintenance methods (what means should be used), eventual defects of Cisco Systems SFS 7012, and methods of problem resolution. Eventually, when one still can't find the answer to his problems, he will be directed to the Cisco Systems service. Lately animated manuals and instructional videos are quite popular among customers. These kinds of user manuals are effective; they assure that a customer will familiarize himself with the whole material, and won't skip complicated, technical information of Cisco Systems SFS 7012.

Why one should read the manuals?

It is mostly in the manuals where we will find the details concerning construction and possibility of the Cisco Systems SFS 7012 item, and its use of respective accessory, as well as information concerning all the functions and facilities.

After a successful purchase of an item one should find a moment and get to know with every part of an instruction. Currently the manuals are carefully prearranged and translated, so they could be fully understood by its users. The manuals will serve as an informational aid.

Table of contents for the manual

  • Page 1

    Corporate He adquarters Cisc o Syst ems , Inc . 170 West Ta sman Drive San Jos e, CA 95 134-1706 USA http://www.ci sco.com Tel: 408 526-4000 800 553- NETS (638 7) Fax: 408 526-4100 Cisco SFS 70 1 2 Inf iniBand S erver S witc h Hardware Users Guide Text Pa rt Nu mber: OL-8787- 04[...]

  • Page 2

    THE SPECIFICATIONS AND INFORMATION REGARDING TH E PRODUCTS IN THIS MANUAL ARE SUBJE CT TO CHANGE WITHOUT NO TICE. ALL STATEMENT S, INFORMATI ON, AND RECOMMENDA TIONS IN T HIS MANUAL ARE BELIEVED TO BE ACCURATE BU T ARE PRESEN TED WITHOUT WARRANTY OF ANY KIND, EXPRE SS OR IMPLIED. USERS MUST TA KE FULL RESPONSIBILITY FOR THEIR AP PLICATION OF ANY PR[...]

  • Page 3

    Content s i Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 New and Changed Inf ormation vii Preface ix Audienc e ix Organi zation ix Conv enti ons x Relat ed D ocum ent atio n x Obtain ing Documentati on x Cisco. com x Produc t Documentat ion DVD xi Orderi ng Documenta tion xi Document ation F eedback xi Cisco Pr oduct Secu[...]

  • Page 4

    Cont ents ii Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Infin iBand Gene ral Servi ces Manager s and Agents 6 SNMP Supp ort 7 SNMP MIBs 7 CHAPTER 2 Insta lla tion 9 Statemen t 1019—Mai n Disconne ctin g Device 10 Statemen t 1045—Sho rt-ci rcuit Pr otect ion 11 Statemen t 10 74—Comply wi th Local a nd Nati onal E[...]

  • Page 5

    Content s iii Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Hot Swappi ng Component s 39 Hot Swappi ng Spin e and Leaf Modu les 39 Hot Swappi ng the Fan Uni t 40 Hot Swappi ng Power S upplies 40 CHAPTER 3 Operati ons and Administ ration 41 Chassi s Viewer 41 The C has sis View er Mana ges 41 Home Page 42 ? (Hel p) But ton [...]

  • Page 6

    Cont ents iv Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chassi s Traps 64 SFS 7012 Por t Stati stics 67 Port Sta tisti cs Field De scripti ons 68 Leaf an d Spi ne Mod ule IB Port St atis tics 70 Leaf Mo dules 70 Spine Modu les 70 Set Fiel d Thre sholds 71 Time Ser vice 73 Config urin g the Switch OOB IP Address 76 Con[...]

  • Page 7

    Cont ents v Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Captur e 92 Depreca ted 93 APPENDI X C Troubles hootin g 95 Hardwa re Chec ks 95 Switch 95 Pro blem 95 Fix 95 Powe r Sup ply 95 Pro blem 95 Fix 95 Pro blem 96 Fix 96 OOB Et her net RJ 45 Po rt 96 Pro blem 96 Fix 96 SFS 7012 Le af Modul e IB Ports 96 Pro blem 96 Fi[...]

  • Page 8

    Cont ents vi Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04[...]

  • Page 9

    vii Cisco SFS 7012 Infin iBand Serve r Switch Hardwa re Users Guide OL-8787-04 New and Changed Information The Cisco SFS 701 2 InfiniBand Se rver Switch Har dware Users Guide applies t o the SFS 7012 Release 3.1 or later . Ta b l e 1 lists the new and change d features av ailable with e ach suppor ted SFS 701 2 release. Ta b l e 1 Document ed Feat [...]

  • Page 10

    viii Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Red undan t Manage ment Added redundant man agement inf ormation. 3.3 Installing the Spine and Le af M odules, page 2- 26 Upda tin g Manageme nt Spin e IP Addresses in a Redund ant Manage ment Configuration, page 2- 31 Rebooting Multiple Manage d Spines, page 2- 38 Doubl[...]

  • Page 11

    ix Cisco SFS 7012 Infin iBand Serve r Switch Hardwa re Users Guide OL-8787-04 Preface This pr eface d escrib es th e audie nce, o rganizatio n, an d co n ventions o f th e Cisco SFS 70 12 InfiniBand Server Swit ch Har dware Users Guide . I t also provides in format ion on how to obtain relat ed documentation. Audience The inte nded audie nce for th[...]

  • Page 12

    x Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Conven tions This document use s the follo wing con ventions for notes, cautions, and safety warnings. Notes and Ca utions co ntain importa nt infor mation th at you shoul d be aware of. Note Means r eader tak e note . Not es co ntain help ful s ugges tion s or refer ence s[...]

  • Page 13

    xi Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Y ou can access inte rnational Cisco websites at th is URL: http://www .cisco.com/pub lic/countries_la nguages.shtml Product Docu mentation DVD The Product D ocu mentat ion DVD is a l ibrar y of tec hnica l produc t docu ment ation on a por table mediu m. The D VD enables yo[...]

  • Page 14

    xii Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 T o see security advisor ies, security notices, and securi ty respon ses as the y are upda ted in real time, you can sub scr ibe t o the P roduc t Secu ri ty Inc iden t Res ponse T eam Really Simple Syndication (PSIR T RSS) feed. I nformation about ho w to subscribe to th[...]

  • Page 15

    xiii Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Obtaining Tech nical Ass istance Cisco T echni cal Suppo rt provides 24- hour-a-day award-w inning tec hnica l assistan ce. Th e Cisco T echni cal Su pport & Docum entati on web site on Cisco .com f eature s extensive online sup port resourc es. In additio n, if you ha[...]

  • Page 16

    xiv Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Submitting a Se rvice Request Using the online T A C Service Request T oo l is the fa stest way to open S3 and S4 service r equest s. (S3 and S4 service re quests are those in which your net work is minimall y impaire d or for which you require product i nfor mation. ) Af[...]

  • Page 17

    xv Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 • The Cisco Pr oduct Quick Re fer ence Guide is a hand y , compa ct refere nce tool that include s brief product overviews, key feature s, sample par t numbers, and abb reviated technic al specifications for many Cisco prod ucts tha t are sold thr ough c hann el part ners.[...]

  • Page 18

    xvi Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04[...]

  • Page 19

    C HAPTER 1 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 1 Product Overview The Cisco SFS 7012™ is an i ndustry leading modular system used for crea ting large, single-system Grid/Cluster serv er fabr ics, or as a bu ilding block for lar ger fabrics. The SFS 7012 is designed to maxim ize perf ormanc e, str eamline ope ra[...]

  • Page 20

    2 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter SFS 7012 Product Spec ifications Mechanic al/Thermal/Pow er Specificatio ns • 7U - 1 9" ra ck mo unt envi ronm en t • Integrate d ther mal mana gement • Front-to-bac k airflo w • Hot plug, re dunda nt cool ing • Hot plug, re dundant power supplies •[...]

  • Page 21

    3 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter • A vaila ble power (all fiber): 879 W att s max • A vailab le air flo w: 200 cfm • Thermal stat us reporting to CME via IBML • Up to one hundre d fo rty-fou r (144 ) 4X IB exte rnal c opper ports • T wo ( 2) RJ-45 connec tors fo r 100BASE Et hernet con nect[...]

  • Page 22

    4 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter – Perform ma intena nce task s – Manage firmware up dates, i ncludin g upl oading new firmware and setti ng the active version.[...]

  • Page 23

    5 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Subnet Ma nager Every InfiniBand fabri c subnet re quires a sin gle active Subnet Manager (SM ) to initialize and maint ain the sub net. The fabri c ma y also have one or m ore standb y Subnet Mana gers. One of t he standby Subnet Manag ers can be con fi gured to be c[...]

  • Page 24

    6 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter An SMA also runs o n every InfiniBand-c apab le ser ver th at is equipp ed w ith an HCA . As shown i n Figure 1-3 the Subne t Mana ger interact s with t hese SM As to discover infor mati on ab out the nodes on the fa bric. Figur e 1 -3 InfiniBand M anage rs and A ge[...]

  • Page 25

    7 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter The PM and PMA exchange messa ges about performa nce stati stics and er ror inf ormatio n of InfiniBand devices on the fabric . SNMP Supp ort Built-in support f or Simple Network Man agement Prot o col (SNMP) allo ws users to integrate a SFS 7012 into their e xisting [...]

  • Page 26

    8 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter[...]

  • Page 27

    C HAPTER 9 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 2 Installation This chap ter des cribes ho w to install the Cisco SFS 7012™ and its components, and it includes the follo wing information: • Planning t he Install ation, pa ge 2-15 • Installation T asks, page 2-22 • Hot Swappin g Comp onents, pa ge 2-3 9 Not[...]

  • Page 28

    10 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter War ni n g IMPO RT ANT SAFETY INST RUCTIONS This warning symbol means dang er . Y ou are in a sit uation that could cause bodily injury. Before you work on any equipment, be awa re of the hazards involved with electrical circuitry and be familiar with standard prac[...]

  • Page 29

    11 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Statement 1045—Short-circuit Protection Avi s o A combinação ficha-tomada deverá ser sempre acessível, porque funciona como interruptor principal. ¡Advertenc ia! El conjunto de clavija y toma ha de encontrars e siempre accesible ya que hace las veces de dispos[...]

  • Page 30

    12 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Avi s o Este produto requer proteção contra curto-circuito s (sobreintensidade de corrente), que deve e star instalada nos edifícios. Instal e apenas de acordo com as normas de inst alação elétrica nacionais e locais. Advertenci a Este producto necesita estar[...]

  • Page 31

    13 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Statement 1074—Comply with Loca l and National Electrical Codes War ni n g Installation of the equipment must comply with local and national electrical codes. Statement 107 4 Waarschuwing Bij installati e van de apparatuur moet worde n voldaan aan de lokale en nati[...]

  • Page 32

    14 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Stat ement 1 075—Hazar dous Voltage or En ergy Pres ent on DC Power Term inals War ni n g Hazardous voltage or energy may be present on DC power terminals. Alway s replace cover when terminals are not in service. Be sure unins ulated condu ctors are not accessibl[...]

  • Page 33

    15 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Planning the Installation Environmental Requirements T o assure proper operation and a v oid unnecessary mainten ance, the installati on site must conform to certain e n v ironmental sp ecif ications. ¡Advertenc ia! Puede haber energía o voltaje peligrosos en los t[...]

  • Page 34

    16 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Rack Specificati ons and R ecommendations The SFS 7 012 switch is d esigned to be installed in an existing 1 9-inch equipm ent rack or server rack. The SFS 7012 switch i s designed for a four-pos t server cabin et. It i s not de signed for a two -post t elco cabine[...]

  • Page 35

    17 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Figur e 2-3 Bend Radius Measur ement Diagra m • Support c able using a cable mana ger mount ed above connector s to av oid unne cessary weight on the cable bundles. • Bund le ca bles usin g v elc ro s trap s to a voi d damagi ng cables . • Keep all ports an d c[...]

  • Page 36

    18 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Installation Tasks Checklist T o perform the a ctual switch in stallation, t he site implem entation e ngineer must perform the foll owi ng tasks, which are detai led in this section. Cautio n Be sure to review the Safety Info rmati on on page 18 before sta rting t[...]

  • Page 37

    19 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Precauti ons for R ack-Mountable Pr oducts War ni n g Installing sy stem components in a rack without th e front and side stabilizers installed could cause the rack to tip over . Therefore, alway s install the stabilizers before i nstalling components in the rack. Wa[...]

  • Page 38

    20 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter War ni n g This unit may have more than one power cord. T o reduce the risk of electri cal shock, disconnect both cords before servicing the unit. War ni n g T o avoid potential electrical shock, operate this unit only when the cover is in place. War ni n g T o avo[...]

  • Page 39

    21 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Check the Installation S ite The SFS 7012 switch is designe d to be instal led in an exis ting server cabin et (not a telc o cabin et), w here it can be mounted in a standard equipment rack . Mounting brac kets are integrate d with the switch. Be sure of the follo wi[...]

  • Page 40

    22 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Installation Tasks The follo wing is an ov ervie w of the installatio n tasks detailed in this section: Step 1 If appl icab le, rem ove the doors of t he rac k. Step 2 Mark th e rack, a llo wing 7 U (12.25 i nches) of vert ical spac e to install the SFS 7012 s witc[...]

  • Page 41

    23 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Step 1 Inst all the caged nu ts into the 2 ba ck holes (c hassis leaf module si de) and the top and bottom hole s (chassis fan side) in the front of the rack. Note The 2 front holes should match up with the top and botto m holes of t he rail fron t flange . All hol e[...]

  • Page 42

    24 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Rack-Mount t he Switc h Cautio n Because of its size and weigh t, it is recommended that eithe r a lifting de vice or three (3) peo ple install the SFS 7012. T o install the sw itch int o the rack, p erform the f ollo wing st eps: Step 1 Clear th e area of an y unn[...]

  • Page 43

    25 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Figur e 7 Secur e Chassis t o Rac k Step 6 Using tw o scre ws, install the lo wer mounting brac ket to the rail a ssembly and ch assis as sho wn in Figure 8 . Figur e 8 Instal l the Lo wer Mount ing Br ack et and He yclip Step 7 Install the he yclip to the rail assem[...]

  • Page 44

    26 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Step 1 On the swit ch fan side, inser t the notche s on the top o f the f ascia into the two sl ots on the chassis f rame. Snap t he botto m of t h e f acepl ate in p lace. Removing a Module or Blank The handl es ar e sel f-lo cking. T o unl ock, p ush up on t he h[...]

  • Page 45

    27 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Figur e 2-9 SFS 70 12 Chassis — Sp ine Module Sl ot Number ing b. Leaf Mo dules— Leaf mo dules shoul d be populat ed beginning with slot 1, then slo t 2, then slots 3 through 12 r espec tively . Refer to Figu re 2-10 : Figur e 2-1 0 SFS 70 12 Chassis — L eaf Mo[...]

  • Page 46

    28 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Figur e 2-1 1 SFS 70 12 Chassis F ront V iew Figur e 2-12 SFS 70 12 Chas sis Bac k Vi ew Step 1 Connect a Cate gory 5 or 6 (Cat 5/6) Ethernet cable to one of the RJ-45 co nnectors on the SFS 7012. Connect the other end of the Cat 5/6 to the OOB LAN workstation. Ref[...]

  • Page 47

    29 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Note Whe n handling IB conne ctors, ma ke certain to remove the connec tors by pulling on the center o f the lanyard only as shown in Figur e 2-13 below . Pulling abrup tly on the lanyar d, or pullin g on only o ne side of the lanyard will prevent the lat ch/unl atch[...]

  • Page 48

    30 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Note If the spine module RS-232 port is conne cted to a terminal emula tion program, the user will be able to view the switch boot pr ocess. Be c ertain to use a null-mo dem/cr ossover se rial cable fo r the conso le po rt. The settings for the te rminal emulation [...]

  • Page 49

    31 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Step 2 Po wer up the SFS 70 12. Note If using the RS-2 32 port, skip to Step 6 . Steps 3 throug h 5 are for those user s accessing the SFS 7012 via T elnet or SSH. Step 3 If using T elnet or SSH, access the SFS 7012 with the follow ing command: open 192.168.100.9 Ste[...]

  • Page 50

    32 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Step 1 Ensure that the spine module is connecte d to a COM port on a serial ter minal de vice via the RS-2 32 port. Step 2 Get to a [boot] : p rompt by foll owing Step a or b. a. If the man aged sp ine is r unning, ent er the foll owing comm and at th e co nsole: r[...]

  • Page 51

    33 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Image Date: Jan 19 2006, 15:03:31 Checking L2 functionality... BCM1125 L2 caches initialized and invalidated CPU0 caches initialized Initialized SMBUS Channels SPD Checksum ok. MEM_SEL = 0x00000007 CPU_REV = 0x00000001_112421FF CPU speed = 400 MHz IO Bridge 0,1 speed[...]

  • Page 52

    34 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter md5 values match! 11088736 Starting at 0x80010000... sysI REGS BOOT Initializing HyperTransport bus HyperTransport initialization completed Found Intel Strata Flash 128 MBit (0x8918). Mounted raw file system on device /image1. (size=6291456 bytes) Mounted raw file [...]

  • Page 53

    35 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter The ch ass is st atu s LED is off wh en: • There are no functi onal po wer supp lies pres ent. • There are no mana geme nt card s in the sys tem • A C power has been re moved from the system. Subnet Manager Age nt (SMA) LED There is a single SMA LED associa ted[...]

  • Page 54

    36 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter • F ast Blink - IB data is flowing through th e port. • Off - the physi cal lin k is down (port is in t he Down state). Spine and Leaf Module Stat us LED The status LED i ndica tes one of the foll owing condi tions: • Steady Green - the module is operating no[...]

  • Page 55

    37 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Accessing On-line Help Online help can be accessed from any where within the Chassi s V iewer by clicki ng on the ? bu t t o n s a s sho wn in Figure 2-15 : Figur e 2-15 Chas sis Viewer Online Help But ton(s) The on-line help screens contain topi cal information with[...]

  • Page 56

    38 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Figur e 2-16 Sample Chassis Viewer On-line Help Scr een Shutdown Procedures In orde r to sh utdo wn the SFS 7012: Step 1 Po wer do wn the switch b y removing th e po wer cords from th e A C po wer inlets. Rebooting Components from Chassis Viewe r Step 1 From the Ch[...]

  • Page 57

    39 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Step 2 The syste m prompts fo r a user name . At the pr ompt enter : admin Step 3 The syste m prompts fo r a password. At the prompt enter: adminpass The system responds with: Welcome to the SFS 7012 CLI. Type 'list' for the list of commands. Step 4 T o re [...]

  • Page 58

    40 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Step 4 Push the handles in to fully close. Hot Swappin g the Fan Unit Step 1 Loosen t he captive panel sc rew . Step 2 Pull the panel scre w do wn to parti ally disenga ge the u nit. Step 3 Slo wly pull the unit. The unit will d isengage from the co nnector . Step [...]

  • Page 59

    C HAPTER 41 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 3 Operations and Administration This c hapter describe s how to ad minist er and configure the Cisco SFS 7012™ and i ts c ompon en ts, a nd it includ es the fo llo wing informatio n: • Logging , page 3-53 • Firmware Upda te, page 3-5 8 • SNMP , page 3 -59 ?[...]

  • Page 60

    42 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Home Page Figur e 3-1 Ch assis Vi ewer H o m e Page The Chassis V ie wer ’s home p age provides a high-lev el overvie w of the SFS 70 12 switch and individual leaf and spine modules. This area is the starting point to more detailed information f or the SFS 7012 c[...]

  • Page 61

    43 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Figur e 3-4 Suppor t Contact Scr een Displaying th e Lea f and Spine M odule Views Leaf Module View T o display the leaf m odule vie w for the SFS 7012: Step 1 Mouse over the leaf mo dule to disp lay . The edg es of the lea f module are high lighted green as shown in[...]

  • Page 62

    44 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Figur e 3-6 Leaf Modu le View Spine Module View T o display the spine modu le vie w for the SFS 7012: Step 1 Mouse over the spin e modu le to displ ay . The e dges of th e spine m odule ar e hig hlighte d gree n as shown in Figure 3- 7 below: Figur e 3-7 Spine M od[...]

  • Page 63

    45 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter • Infor mation a rea . • Menu Figur e 3-9 Leaf and S pine Comp onent Details Ar ea Leaf and Spine Details Header The leaf and spine Details Header allo ws the user to ex ecute the most common tasks for the SFS 7012 switch: • Display the Home page • V iew fiel[...]

  • Page 64

    46 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Step 1 Mouse o ver the oute r reg ion of the leaf mod ule vie w . The edge s of the ch assis ar e highlig hted gr een as sho wn in Figure 3-11 belo w: Figur e 3-1 1 Leaf Modu le Chassis Mouseo ver Left c lick the m ouse. Th e chassis vie w will be d isplayed. Step [...]

  • Page 65

    47 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Figur e 3-13 Chassis V iew er Component Deta ils Ar ea Chassis V iew Co mponen t Details Area The Component De tails Ar ea contains three areas. • Details He ader • Infor mation a rea . • Menu Chassis Details Header The Chassis Details Header allows the user to[...]

  • Page 66

    48 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Figur e 3-15 Reboot Scr een Step 2 Select the radio button of the spine (s) to be reboot ed, or select the Reboot Entir e Chassis ra dio b utton to r eboot the SFS 7 012 cha ssi s and all sp ine s. Step 3 Click Reboot . Rebooting Mult iple Managed Spines In a redun[...]

  • Page 67

    49 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Chassis V iew Co mponent Informatio n Area Figur e 3-16 Component In for mation Ar ea The Chassis V iew Compo nent Inf ormation Ar ea al lo ws the user to vie w important sy stem inform ation. The se fields are t ied t o live data from the se lect ed hard ware co mpo[...]

  • Page 68

    50 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Figur e 3-17 LEDs and Se nsors T ab Note For a de tailed explanati on of physic al LED s on the hardware compo nents , plea se refer to the secti on SFS 7012 Compone nt LED s, page 2-34 . System T ab The System tab displays the o verall system information of the SF[...]

  • Page 69

    51 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter The te xtual identif ication of the con tact pers on and th eir conta ct informati on for this sy stem, assigne d by the admi nistrat or . System Name The n ame for th e syste m, assig ned b y an admi nistrator . One con vention is to use the sys tem's fu lly qu[...]

  • Page 70

    52 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Displa ys the pa rt number of th e compone n t. Detail A button fo r each row that disp lays a dditiona l deta il about the compone nt. A ddition al de tails inclu de: Mo del, V ersi on, Ma nufactur er N ame, Pr oduct N ame , Manu facture r Id, Manu facture d Dat e[...]

  • Page 71

    53 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Configuration a nd Monitoring Feature s The fol lo wing section provid es detailed, t ask-oriented descriptions for conf iguring and monito ring the SFS 7012 sw itch and its featu re functiona lity . Chassi s View Menu Figur e 3- 19 Ch assi s View Me nu The Chassis V[...]

  • Page 72

    54 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Figur e 3-20 Logging Sub menu Set Level Figur e 3-21 Set Leve l Butt on The Set L ev e l b utton a llows th e user t o set lo g lev el confi guration param eters for al l softw are modules on the SFS 7012. T o set log lev els: Step 1 From th e me nu, sele ct Loggin[...]

  • Page 73

    55 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Figur e 3-23 Device T ab: Sof twar e Module Configur ator T o change any Log Le vel s ettings : Step 1 Click the On-O ff checkbox to the righ t of the setting. Step 2 Click the Submit button to save any change s. The following l ist de scribe s each of t he Log L eve[...]

  • Page 74

    56 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Debug message levels 1 through 5 : Debug message s are for suppl ier an d/or Cisc o enginee ring use and ar e not nece ssari ly in dicat ive of actions tha t an en d user m ay need to take. – DEBUG 1 – M essag es tha t descr ibe the states of c onnect ions a nd[...]

  • Page 75

    57 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Syslog Tab Figur e 3-25 Log S ystem Configur ator: Syslog Host T ab The Syslog tab allo ws the user to sav e log files to a syslog host. T o s etup the syslog host: Step 1 In the Host IP dialog box, enter the IP addre ss of the syslog host w here the log files a re t[...]

  • Page 76

    58 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Figur e 3-27 Reset Log Lev els Windo w Step 4 T o rese t th e log gin g levels, cl ick OK . Firmware Update Figur e 3-28 Fir mwar e Updat e Butt on The Firmware Update button all ows the user to selec t an alternate f irmware f ile for the SFS 7012. These alternate[...]

  • Page 77

    59 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter SNMP The SNM P submen u allo ws the us er to conf igure and fil ter SNM P trap inform ation. Figur e 3- 30 S NMP Sub men u Target Configur ation The T arget Configu ration button disp lays the SNMP T arget Con figuration W indow , allowing the user to view and edit e[...]

  • Page 78

    60 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Figur e 3-32 SNMP T ar g et Configu ratio n Windo w The t op sect ion of the w indow , SNMP T arget A ddresses, allows the user to de termine what t ype of SNMP trap s are sent, and where t hey are sen t. T he ro ws p rovid e an a rea fo r specif ying multiple trap[...]

  • Page 79

    61 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Note The combination of the T ransport Doma in and the T ransport Address deter mines the trap destina tion. • Port Specifies the TCP port which th e SNMP trap will be sent. • Ti m e o ut Specifies the time that the trap sen der waits on a respo nse before re-sen[...]

  • Page 80

    62 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter • Security Model The Secu rity Model t o be used when g enerating SN MP messages u sing this entr y . V alues for this field are 1, 2, or 3. • Security Name Securit y name identif ies the en tity for wh om SNMP messages will be generated. Note This is equi vale[...]

  • Page 81

    63 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Step 1 From th e me nu, sele ct SNMP Step 2 Click Filter Status . The SNMP Filter St atus sc reen is di splaye d. Figur e 3-34 Filt er Status Scr een Setting Community Strings The Set Community Stings screen allo ws the user to set two SNMP community names: • Read [...]

  • Page 82

    64 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Figur e 3-36 Set Community Str ings Window Th e fir s t fi el d , " Read Only Comm. Name ," is the c ommunity st ring that wh en spe cified in an SNMP client , allows read o nly ac cess to SNMP fields expor ted by t he SNM P server . The sec ond field, &q[...]

  • Page 83

    65 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Step 5 T o sav e settin gs, click on Apply . Foll owi ng are def initions for each ch assis trap: Chassis Group icsChassisT rapSystemSelfT estFailur e This trap indicates th at the chassis failed one or more of its self-test(s). icsChassisT rapSystemReboot This trap [...]

  • Page 84

    66 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter This trap indica tes that a po wer supply is not responding to HEA R TBEA T poll re quests, that are issued by the internal chassis management service. icsChassisT rapPowerSupplyInser ted This trap indica tes that a power supply was inserted into the chassis. icsCh[...]

  • Page 85

    67 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter SFS 7012 Port Statistics The Chassis V iew P ort Stat istics area provides I B port informatio n for all of the e x ternal and internal ports of the SFS 7012. Figur e 3-39 IB P ort Sta tistics T o view port statistical informat ion, do the follo wing: Step 1 From the[...]

  • Page 86

    68 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Note Spin e chips are refe renced b y the spine numbe r and the switch chi p identif ier . Each spine m odule contains two swit ch chips (Switch c hip A and B). Port Statistics Field Descriptions Po rt Name/P ort Number: Correspon ds to external leaf modu le num be[...]

  • Page 87

    69 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Recei ve 32 B it W ords: The num ber of 32 -bit d ata words received by the port, n ot incl uding flow control and VCRC da ta. Tr a n s m i t P a c k e t s : The numbe r of data pa ckets transm itted by the por t, not includ ing flow control packets. Recei ve P acket[...]

  • Page 88

    70 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Leaf and Spine Module IB Port Statistics T o access IB port stat istics for a specif ic leaf or spine m odule, per form the follo wing steps. Leaf Modules Step 1 Select a leaf module. The le af modu le vi ew is disp layed. 1. From the Leaf Port S tats menu, select [...]

  • Page 89

    71 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Figur e 3-44 Spine P ort Stati stics Windo w For inform ation on the each IB port st atistic f ield, refe r to the sect ion Port Statistics Field Descriptio ns, page 3 -68 Set Field Thresh olds The Set Field Thre shold s sc reen al lows the u ser to set , for a sp ec[...]

  • Page 90

    72 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Figur e 3-46 Set Er ror Report ing Thre sholds Scr een Step 3 T o change a threshold v alue f or an y field : a. Click in the Thr eshold fi e l d. b. Enter a new thre shold value. Note For those fields w ith a “ Pe rc en t of M a x ” t ime un it, t he use r may[...]

  • Page 91

    73 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Note Th e thresh olds for t he following fields are set base d upon the number of error message which ca n occur in one second. The value can be from 1 t o 65,535 . portSymbolErrThr esh The thre shold for t he numb er of times a 8B10B en coding vi olatio n, or a disp[...]

  • Page 92

    74 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Figur e 3-47 Switc h Time Service T o set the system time: Step 1 From th e me nu, cl ick Ti me S e rvic e . Step 2 Click Set System T ime . Th e System Time Inf orm ation scre en is displaye d: Figur e 3-48 Sys tem Time Inf or mation Scr een To u s e N T P : Step [...]

  • Page 93

    75 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Step 1 Make sure the Use Netwo rk T ime Pr otocol? checkbox i s unc hecked. Step 2 Set the cur rent date and time using the drop-do wns for Month , Day , a nd Ye a r as well as Hour , Minute , Seconds , and AM/PM . Step 3 T o s ave, click on Apply . Figur e 3-50 Time[...]

  • Page 94

    76 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Note Beginning in 2007, Dayligh t Saving T ime in the United Sta tes begins at 2 a.m. on the seco nd Sunday o f Marc h, and en ds at 2 a.m . on the fi rst Su nday in No vemb er . – 2006 = Oct. 29 (5th) Additiona lly , fo r those US regions that do not obse rve DS[...]

  • Page 95

    77 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Figur e 3-54 Set S witc h Def ault Gat ewa y IP Addr ess But ton Step 2 Click in the OOB IP Addr ess fie ld . Figur e 3-55 Set Def ault Gatew ay IP Windo w Step 3 T ype in the correct switch def ault gate way IP address. Step 4 Click A pply . Note A reboot is re quir[...]

  • Page 96

    78 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Spin e View Menu Figur e 3-56 Spine V iew Menu Note For i nforma tion on IB po rt sta tistic s re fer to the se ction SFS 7012 Port Statistics, page 3-67 . Logging The Lo gging subme nu allows the user to view , se t lev els, re set lev els, a nd purge the message [...]

  • Page 97

    79 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Step 1 From th e me nu, sele ct Logging. Step 2 Click Vi ew Lo g . The log m essag e win dow is displ ayed: Figur e 3-59 Sample Mess age L og T o save a log message for fur ther ana lysis, perform th e following steps: Step 1 From the Messa ges window , se lect Edit [...]

  • Page 98

    80 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Figur e 3-61 Purg e Log Confir mation Windo w Step 3 Click OK . Step 4 The messa ge log file is now pur ged. Select Bo ot Image The Select Boot Image button allows the user to cho ose an alternativ e bo ot image for the SFS 7012 . T o select a boot image: Figur e 3[...]

  • Page 99

    81 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Chapter Adding a New License Key Step 1 Click Lice nse K eys . The K ey A dministrati on button is displaye d: Figur e 3-64 Lic ens e Key Subm enu Step 2 Click K ey Administra tion . The Key Management window is displayed: Figur e 3-65 Key Mana gemen t Wi ndow Step 3 T o add[...]

  • Page 100

    82 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Chapter Figur e 3-68 License Ke y Delet e Pr ompt Step 4 Click OK to dele te.[...]

  • Page 101

    83 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 APPEND IX A Technical Specifications Ta b l e A -1 SFS 70 12 T ech nical Specifica tions Switch Phys ical Dime ns io ns • 7U high ( 24.5”) • 19" rac k mo unt ( 17.32 " wi de) • 25 3/4" deep (without cable s) W eight • 100 lb. (includi ng power suppli[...]

  • Page 102

    84 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Appe ndi x[...]

  • Page 103

    85 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 APPEND IX B Command Line Interface This a ppend ix incl udes th e fo llowing inf ormatio n: • Command s and Functiona l Groups , pag e B-86 • Accessi ng the CLI, page B-87 • Groups a nd Co mmands, page B -88 Overview This section detai ls the usage of the Command Line [...]

  • Page 104

    86 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Appe ndi x The CLI is also accessible through the RS232 serial port o f the SFS 7 012. Acc essing the CLI throug h the seri al po rt never requires a login and password a nd defau lts to admini strator privileges. Providin g access through the serial port means th at users[...]

  • Page 105

    87 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Append ix Captur e: Pro vides com mands for cap turin g switch-s pecif ic information fo r the purpo ses of analy sis and debugging. T o list commands w ithin a functi onal group, simply type in the funct ional group nam e. Fo r example , to list a ll of the fir mware c omma[...]

  • Page 106

    88 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Appe ndi x – Administrator access: admin T ype the ap propria te usern ame an d press Enter . Step 3 The syste m prompts fo r a password. The CLI has the following default passwords: – Operat or a ccess: oper pa ss – Administrator access: adminpass T ype the appro pr[...]

  • Page 107

    89 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Append ix exit Exit the CLI Deprecated smDisplayLids Use smShowLids smGetPriority Use smShowPriority smDumpGroups Use smShowGroups smDumpServices Use smShowServices smDumpSubscriptions Use smShowSubscriptions smDisplayMasterLMC Use smShowMasterLMC smDisplaySmMasterLid Use sm[...]

  • Page 108

    90 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Appe ndi x Chassis slotInfo Prints out chassis slot occupants hwMonitor Monitor fans, power supplies, and port state showIBNodeDesc Show the IB Node (SMA) Description (or the Default) setIBNodeDesc Set the IB Node (SMA) Description fruInfo Display field replaceable unit in[...]

  • Page 109

    91 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Append ix Network ifShow Displays the interface statistics for the OOB management port routeShow Displays the interface routes for the OOB management port ping Send Ping packets to a specified IP address showChassisIpAddr Displays the chassis IP address setChassisIpAddr Chan[...]

  • Page 110

    92 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Appe ndi x Firmware fwUpdateSlot Update units firmware fwUpdateChassis Update units firmware fwListFiles Lists the contents of the firmware RAM disk fwShowUpdateParams Display firmware default update parameters fwSetUpdateParams Configure firmware default update parameters[...]

  • Page 111

    93 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Append ix IbSwitchInfo ismPortStats Show statistics for all ports ismPortCounters Show Port Counters ismLinearFwdb Show/set Linear Forwarding Database for switch ismMultiFwdb Show Multicast Forwarding Database for switch ismAutoClearConf Configure the port statistics counter[...]

  • Page 112

    94 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Appe ndi x Capture capture A combination of all capture commands that follow captureFw Capture firmware information captureSm Capture subnet manager information captureIsm Capture IB switch information captureChassis Capture chassis information captureLog Capture log infor[...]

  • Page 113

    95 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 APPEND IX C Troubleshooting This appe ndix describe s how to troubleshoot the Cisco SFS 7 012™, an d it inclu des the following inform ation: • Hard war e Che cks, pa ge C- 95 • T r oublesh ooting Scenar ios, pa ge C-97 Hardware Checks Switch Powe r Supply Problem Fix [...]

  • Page 114

    96 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Appe ndi x Fan OOB Ethernet RJ45 Port SFS 7012 Leaf Module IB Ports Problem Fix Red LED is lit Call T ech Support Fan not ru nning Ensure fan is seated properly . If fan con tinues to be inoperable, ca ll T ech Support Problem Fix The SFS 7012 E thernet Port(s) hav e a RJ4[...]

  • Page 115

    97 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04 Append ix Troubleshooting Scenarios InfiniBand This section documents common problems seen with the SFS 7012 switch. Invalid IP Address entered for SWC via Console Port Symptoms Cannot access the Chassis V iewer brow ser window . The browser window times out and Chassis V ie[...]

  • Page 116

    98 Cisco SFS 7012 Infi niBand Server Switch Hard ware Users Guide OL-8787-04 Appe ndi x[...]