Cisco Systems 7008 manual

Part Number: 10-0 0044-04-A0 T op spin 270/Cisco SFS 7008 Hardware Guide Release 2.3.0[...]

Copyright © 2 004 - 2005 T opspin Communications, In c. All rights reserved . The T opspin Switched Com puting System, T opspi n Host Channel Adapter, T opsp in Element Manager, and coll ateral software programs and documentation are subject to and ma de available only pursuant to the license agreement signed by you and T opspin , Communications, [...]

iii Regulatory Notices ........................................ vii FCC Statement .................................................................................................................. ........................ vii Safety Inform ation ....... ................................................................................................[...]

iv Connect Management Devices ..................................................................................................... ............. 26 Attach a Serial Console Cable to a PC or Terminal ..................................................................... 26 Connect an Ethernet Cable to the Ethernet Manageme nt Port ...................[...]

v Upgrading a Topspin 270/Cisco SFS 7008 with the CLI ............................................................. 53 Upgrading a Topspin 270/ Cisco SFS 7008 with Element Manager ............................................. 54 Upgrading an Individua l Controller Card ................................................................................[...]

vi Run Fan Tests .................................................................................................................. .......................... 96 Run a Self-Test on a Fan ....................................................................................................... ........ 96 Run Power Supply Tests ........................[...]

vii Regulatory Notices FCC S t atement This equipment has been tested and found to comply wit h the limits for a Class A digital device, pursuant to Part 15 of the FCC Rules. Th ese limits are designed to provide reasonabl e protection against harmful interference when the equi pment is operated in a commerci al environment. This equipment generate[...]

viii CAUTION: Grounding is supplied by the gro und-prong on the 3-prong power cable. Do not attach a separate ground cable. Do not use adapter plugs. Do not remov e the ground prong from the cable. Ensure the ground connection on the power supply is correct and functioning before applying power to the T opspin system. CAUTION: Always ground yoursel[...]

ix CAUTION: Never place your hand inside an empty card or module bay . Y ou should never have cause to place a hand anywhere inside the T opspin chassis. Unused card and module bays shou ld always have a T opspin cover over the bay to ensu re proper safety , ventilation, an d cooling. General Cautions CAUTION: No user is authorized to remove the T [...]

x[...]

11 1 Features Overview The T opspin 270/Cisco SFS 7008 Server Switch provides data cen ter managers with a high-performance, low- latency interconnect. • “System Architecture” on page 1 1 . • “About the T opspin 270/Ci sco SFS 7008 Chassis” on page 13 . • “Administrative Features” on page 20 . System Architecture Hot S t andby On [...]

12 Example The oper code field of the command out put id entifies the controller card as the active card (normal) or the hot standby card (standby). B y default, when you power o n a T opspin 270/Cisco SFS 7008, the card in slot 1 1 becomes active and th e card in slot 12 becomes the st andby . The master and standby controllers automatically synch[...]

13 Fabric For redundancy , InfiniBand Host Channel Adapters (HCAs) can be dual-connected to a redundant pair of T opspin 270/Cisco SFS 7008s. In an InfiniBand fabric that includes more than one T opspin 270/Cisco SFS 7008: if the su bnet manager on the T opspin 270/Cisco SFS 7008 th at is acting as the master fails, another subnet manager will take[...]

14 Figure 1-2: Back Chassis V iew[...]

15 Chassis Slot Numbering Slot numbers are p rinted on the chassis for easy identificatio n. Figure 1-3: Chassis Slot Numbering in Fr ont (Non-port Side ) Power Supply ID 1 Power Supply ID 2 Fan ID 2 Slot # 9 Slot # 10 Slot # 1 1 Slot # 12 Slot # 13 Slot # 14 Fan ID 1[...]

16 Figure 1-4: Chassis Slot Numbering in Back (Service Side) Dimensions • Height : 6U unit • Wid t h : 17.04” • Depth : 8” - 23.7” • We i g h t : maximum 106 pounds (full chassis configurat ion with 4x copper Li ne Interface Modules) Connections • 96 ports of 10 Gbps 4X Copper InfiniBand. • T wo 10/100 Et hernet RJ-45 Managemen t-[...]

17 • The power supplies are 1U, 48V , 1200W • The supplies provide regulated +48V DC to all other modules in the system. • Each power supply has self contained fans for cooli ng. Fan T rays Refer to “Installing a Fan Module” on page 41 for installation instru ctions. The fan trays are redundant, hot-swappable cooling units. • Only one f[...]

18 Understanding the Core Slot to Mgmt Interface Module Connection Each Core slot in the chassis (refer to “The Core Slot” on page 18 ) is connected to 1 port on the Management Interface mo dule. The controller (fabri c interface module inserted in the core slot) selects the Management Interface module to which it will connect. The pairing of M[...]

19 • At least one Fabric Controller module must be inst alled in the Core slot for the chassis to boot. • When a module is installed in a Co re slot, it acts as either the master or standby controller for the chassis, with all modules in the system being slaves to the master controller . • The subnet manager runs on the fabri c module install[...]

20 Administrative Features Real-T ime Clock The T opspin 270/Cisco SFS 7008 maintains correct time regardless of po wer conditions or connectivity . Latency The T opspin 270/Cisco SFS 7008 has port to port latency of less than 600ns. Non-V olatile Memory The memory supports up to: • three stored system images ( not including recovery imag e) • [...]

21 2 Inst alling the T op spin 270/Cisco SFS 7008 This chapter describes how to install and m anage the T opspin 270/Cisco SFS 7008 sy stem hardware. • “Prepare the Site” on page 21 • “Configure Basic Connectivity ” on page 29 • “Mount the T opspin 270/Cisco SFS 7008 Chassis in a Rack” on page 22 • “Connect Network Dev ices”[...]

22 • Prepare a management workstation, such as a PC running a term inal program, and a straight-through M/F DB-9 serial cable (inclu ded). Mount the T op spin 270/Cisco SFS 7008 Chassis in a Rack This section describes how to in stall the T opspin 270 /Cisco SFS 7 008 chassis in an equipment rack. The following procedure is the stand ard installa[...]

23 3. Install a shelf for the chassis, if you have not already don e so. V erify that the shelf can support the weight of the chassis, which can be up to 106 pounds with all possible components installed. Figure 2-1: Install Appropriat e Rack in Shelf 4. Determine the direction that the sw itch will be in stalled and justified in the rack . The dir[...]

24 • If you have determined that the switch will be just ified toward the back of the rack, then use a #2 phillips screwdriver to unscrew the r ack ears from the front of the switch. Figure 2-2: Unscrew Extra Rack Ears from the Chassis 6. Separate the rack ears from the chassi s when all screws have been loosened. 7. Use 2 - 3 people to lift the [...]

25 8. Push the chassis into the rack until the ra ck ear s are flush with rai ls. Figure 2-4: Rack Ears Flush with Rails 9. Use screws that fit your rack to attach both rack ears to the rack rails. Figure 2-5: Use Appropriate Screws to Attach Rack Ears to Rails[...]

26 Inst all Optional HA Component s If you have purchased a High-A vailabilit y (HA) package, install the following compo nents: • Redundant Power Supply . Refer to “Power Supply Modules” on page 35 . • Redundant Fan T ray . Refer to “Fan Tray Modules” on page 39 . • Redundant Management Interface Module. Refer to “Management Interf[...]

27 •B a u d : 9600 bps • Data Bits: 8 • Parity: None • Stop Bits: 1 • Flow control: None Connect an Ethernet Cable to the Ethernet Management Port 3. Connect an Ethernet cable to the Ethernet port of the left Management Interface module (slot number 15). See Figure 2-7 . a. If you have two Management Interface modules, you may als o want [...]

28 Power on the Chassis Use only the power cable provided with your InfiniBand system. 4. Remove the power cords from the shipping package. One power cord UL rated 12 Amps/125 V AC or greater is provided by default. If you have a high-availability uni t, you will have a second power cord. 5. Inspect the power cord and determin e if it provides the [...]

29 Configure Basic Connectivity 1. Configure an IP address for the Ethernet Management port. It is necessary to co nfigure connectivity to the ou t-of-box Ethernet managem ent port in order to use T elnet, the W eb GUI, or the Java GUI. The system is not pre-configured wh en it ships from th e factory . IP addresses can be assigned sta tically (whi[...]

30 Assigning an Address Dynamically a. When the system has completed booting, press < Enter > several times to display the CLI prompt. b. Enter the user name and password. The default u ser name is super , and the default password is super . c. Enter the enable command. d. Enter the configure command. e. Enter the interface mgmt-ethernet comm[...]

31 Connecting InfiniBand Devices Attaching the IB Cable to the IB Port T o connect using InfiniBand to other workstation s or switches, standard 4X InfiniBand cables are required. InfiniBand cables can be used to connect an y two InfiniBan d devices, whether switch or host. 1. Plug InfiniBand cables into the InfiniBand swit ch ports. T o plug in an[...]

32 • Command Line Interface (CLI) - a text-based interface accessible through a direct serial connection, T elnet over IP , or SSH over IP . • Chassis Manager (GUI) - A web-based graphic user interface. • Element Manager (GUI) - An optio nally available graphic interface installed on a workstation, and accessible over IP . Refer to the Infini[...]

33 • Mozilla version 1.4 2. T ype the Management IP address of your Server Switch in the address field of your browser and press Enter . (Y ou confi gured the IP address in Step f . ) Figure 2-10: W eb Browse r Window A log-in window opens. Figure 2-11 displays the log-in window . Figure 2-1 1: Chassis Manager Log-In Windo w 3. Enter your Server [...]

34 (Optional) Inst all th e Element Manager GUI For more information regarding th e Element Manager tasks, refer to the InfiniBand User Guide . 1. Check that you have sufficient system resources. Y ou will need: • 32 MB free RAM • 50 MB disk space + 50MB additional temporary space during installation • 300 Mhz processor • 800x600 screen res[...]

35 3 Managing Individual Component s This chapter describes how to inst all the Field Replaceable Units (FRU s) in the T opspin 270/Cisco SFS 7008 system. About the Field Replaceable Unit s The following Field Replaceable Units (FRUs) are a part of the T opspin 270/Cisco SFS 7008 chassis: • “Power Supply Modules” on page 35 • “Fan T ray M[...]

36 About a Failed Power Supply If you believe a power supply module has failed, contact technical support. Do not remove a failed power supply unless you have a new power supply to install im mediately , or a blanking panel to place over the op en bay as overheating may occur . In most cases, vital information can be recovered fr om the failed modu[...]

37 7. Pull the power cord from the chassis. Figure 3-1: Diagram of Power Supply to the Associate d Power Cord 8. Use a #1 phillips screwdriver to unscrew the fasteners that hold the power supply module in place. Figure 3-2: Loosening Captive Screws Power Cord (back) Power Supply (front)[...]

38 9. Use the handle to pull the power supply mo dule from the bay . Figure 3-3: Pulling the Power Supp ly Module from the Bay 10. Install the blanking panel in pl ace of the power supply module. The device should never be run without either a blanking panel or module in any bay , as overheating may occur . or Install a new Pow er Supply module. Re[...]

39 7. Insert the new power supply unit into the open slot until it is fully seated. Y ou may need to push the unit with your thumbs to get it completely into the bay . Figure 3-4: Inserting Power Supply Module 8. Secure the captive screws wi th a #1 phillips screwd river . 9. Check the LEDs on the power supply to verify the status of the module. Re[...]

40 4. Use a #1 phillips screw driver to unscrew the captive screws. Figure 3-5: Loosening Captive Screws 5. Carefully begin to pull the fan tray 1” out of the bay . Do not pull the fan tray com pletely from the bay . CAUTION: The fan tray does not hav e guards over the blades. Y ou must wait until the fan blades have stopped moving before complet[...]

41 or Install a new fan modul e. Refer to “Installing a Fan Module” on page 41 if you are installing a ne w fan module. Inst alling a Fan Module 1. Remove the new fan module from the package. 2. Ground yourself approp riately . 3. Remove the bezel cover from the front of th e switch, if you have not already done so. 4. Refer to “Removing a Fa[...]

42 9. Check the LEDs on the fan module to verify the status. Refer to “Fan LEDs” on page 71 . Fabric Controllers About the Fabric Controllers Refer to “Fabric Controller Modul es” on page 18 for more specific info rm ation about t his module. About a Failed Fabric Controller If you believe a fabric co ntroller modul e has failed, contact te[...]

43 5. Use a #1 phillips screwdriv er to unscrew the captive screws from both en ds of the Fabric Controller card. Figure 3-9: Loosen Ca ptive Screws Before Removing 6. Pull the levers on both sides of the card toward you. The card will be released. Figure 3-10: Opening Fabric C ard Levers 7. Use the levers to pull the card toward you and remove it [...]

44 Inst alling a Fabric Controller T o install a Fabric Controller , perform the following steps: NOTE: If the card that you want to install features Anafa 2 chips, verify that your Server Switch runs T opspinOS v2.3.0 or later . 1. Remove the new Fabric Controller module from the packag ing. 2. Ground yourself approp riately . 3. Remove the bezel [...]

45 The version of the firmware is verified during the upgrade process. If a module does not need to be upgraded, the modu le will be skipped and move on t o the next module. The image can be upgraded with the follow ing methods • “Upgrade the Image with the CLI” on p age 45 • “Upgrade the Image with the Chassis Manager” on page 45 • ?[...]

46 3. Remove the InfiniBand cables from the ports. a. T o remove a cable with a pinch connector , pinc h both sides of the back of the connector and pull the connector aw ay from the port . Figure 3-12: Removing a Pinch-T ype Connector b. T o remove a cable with a pull connector, grasp the connector with one hand and push it toward the port, then p[...]

47 4. Use a #1 phillips screwdriver to unscrew the captive screws on bot h sides of the LIM card. Figure 3-14: Loose n the Captive Screws 5. Release the LIM module by pulli ng both levers towa rd you, then toward the outside of the chassis. Figure 3-15: Relea sing the LIM Module Levers 6. Use the levers to pull the module from the bay . Figure 3-16[...]

48 7. Install a blanking panel in pl ace of the LIM module, or refer to “Installing a LIM Module” on page 48 for instruction s on replacing the LIM module. Inst alling a LIM Module 1. Remove the new LIM module from the package. 2. Refer to “Removing a LIM Card” on page 45 , if a LIM module is still in place. 3. Ground yourself approp riatel[...]

49 9. Connect the InfiniBand cables to the ports. a. T o plug in an InfiniBand cab le, push the connector into th e interface until you hear/feel a click.Check the InfiniBand port LEDs to de termine the status of the port. Refer to “InfiniBand Port LEDs” on page 77 . Management Interface Modules About Management Interface Modules Refer to “Ma[...]

50 7. If the Master Management Interface module wa s removed, the standby module becomes active. The “Master” led becomes green. 8. Install a blanking panel in th e empty bay , or refer to “Installing a Management Interface Module” on page 50 to replace the Management Interface module. Inst alling a Management Interface Module 1. Remove the[...]

51 3. Use a #1 phillips screwdriver to loosen and remov e the screws from the left and right side of the Chassis ID module. Figure 3-20: Loose n the Captive Screws 4. Pull the Chassi s ID mod ule from the bay . Figure 3-21: Remove the Chassis ID Module 5. Do not allow the bay to remain empty , as o verheating may o ccur . The T opspin 270/Cisco SFS[...]

52 Inst alling a Replacement Chassis ID Module 1. Remove the new Chassis ID module from the package. 2. Ground yourself approp riately . 3. Remove the old Chassis ID module, if you have not already done so. Refer to “Removing a Chassis ID Module” on page 50 if a Chassis ID module is still in place. 4. Align the chassis ID module with the sl ot [...]

53 4 Administrative T asks The following sections ap pear in this chapter: • “Upgrade all Cards in a Chassis” on page 53 • “Upgrading an Individual Controller Card” on page 56 • “Upgrading Individual Node Cards” on page 59 • “Upgrading a New Fabric Controller Modul e” on page 63 Upgrade all Cards in a Chassis These procedure[...]

54 Upgrading a T op spin 270/Cisco SFS 7008 with Element Manager The following procedure describes the upgrade procedure using the Element Manag er GUI. This procedure also assumes you are upgrading all fabric controllers in the chassis. 1. Launch Element Manager for the server switch. 2. Delete any old .img files to make room for the new image. a.[...]

55 Note : all cards in the chassis must have an oper -status of “ up ” for the upgrade to be effective on all components. a. Select Maintenance > File Manageme nt b. Click the new .img file and click the Install butto n. c. Click Ye s when prompted. d. Repeat for all Server Switches you wish to upgrade. Figure 4-2: W atching the File Copy Pr[...]

56 6. Select Maintenance > Reboot to reboot the controller cards and activate the image. Click Ye s at the prompt. 7. V iew the new image on the cards: a. Select Vi e w > Device Front V iew . b. Right-cl ick one of the cards and select Properties . c. Click the Inventory tab and view the version name in the Current Image Source field. Figure [...]

57 Upgrading a Controller Card with the CLI For the commands needed to upgrade a single Controller card using the CLI, refer to the CLI Refer ence Guide . 1. Check the version of your Controller card with the show card-inventory command. In the example below , only t he Controller card i n slot 12 need s to be upgraded. Example SFS-270# show card-i[...]

58 2. Show the standby Controller card. Example 3. Check to see if you alread y have a .img file that can be installed. (Delete the .img file, if it not the one you need to install. Use the delete [ slot-number : ] imag e: file-name command.) Example 4. Copy the image to the switch, if you do not have the correct .img file. copy ftp: //< r emote[...]

59 5. Activate the image. After download ing the image file to the chassis controller , it must be installed to become active. The install command installs the specified image file into the system. a. In the privileged-execute mode, enter install image: image-file-name .img Example 6. Specify the new boot image to be used. a. Find the name of your [...]

60 Upgrading a Node Card with Element Manager The following procedure describes the upgrade procedure for indiv idual node cards using the Element Manager GUI. This procedure assumes you are upgra ding only one or more node cards, and not the Controller cards. 1. Launch Element Manager for the server switch. 2. Delete any old .img files to make roo[...]

61 Note : all node cards in the must have an oper -statu s of “ up ” for the upgrade to be ef fective. a. Select Maintenance > File Manageme nt b. Click the new .img file and click the Install butto n. c. Click Ye s when prompted. Figure 4-6: W atching the File Copy Progress d. Click Ok when the Image Install Comp leted Successfully message [...]

62 6. Activate the image on the node card(s) by enabli ng and disabling each node car d. Do not reboot the chassis as this will not result in the image being applied to the node card(s). a. Right-click a node card and select Pr operties . b. Click the down radio button and select the Apply but ton. Figure 4-8: Disable and Enable the Node Card(s) c.[...]

63 Upgrading Node Card(s) with the Chassis Manager For the procedure needed to upgrade node cards using the Chassis Manager GUI, refer to the Chassis Manager User Guide . Upgrading a New Fabric Controller Module When you add a new fabric controller module to a pro duction T opspin 270/Cisco SFS 7008, you mu st upgrade the new module so that it runs[...]

64 NOTE: If the appropriate image file already resides on your active fabric controller mo dule, skip this step and proceed to ste p 5 . Example 5. Enter the install command with the image that you want to install. NOTE: Before you install an image, verify that yo u have brought up all of the cards on the chassis that you want to run the new image.[...]

65 Upgrade a New Fabric Controller Module with Element Manager T o upgrade the card, perform the following steps: 1. Launch Element Manager and navigate to your T op spin 270/Cisco SFS 7008. 2. V erify that the images that run on the fabric controller modu les do not match. If they match , you do not need to upgrade the new module. a. Right-click t[...]

66[...]

67 5 Monitoring the T op spin 270/Cisco SFS 7008 System This chapter describes how to install and m anage the T opspin 270/Cisco SFS 7008 sy stem hardware. • “Interpret ing the Front P anel LEDs” on p age 67 • “Interpreting the Back Panel LED s” on page 73 • “Monitoring the System with Chassis M anager” on page 78 • “Monitorin[...]

68 Figure 5-1: Front Pan el LEDs System-Wide S t atus LED Locating the System-Wide S tatus LED The system-wide status LED is located on the front of the chassis, and is visible whether the bezel cover is on or off. This LED indicates the over all health of all mo dules in the system. If you are facing the front of the chassis, the system -wide stat[...]

69 Power Supply LEDs Locating the Power Supply LEDs The Power Supply LEDs are located in the outside of each Power Supp ly module, if you are facing the front of the chassis with the bezel cover removed. Figure 5-2: Power Supply LEDs Y ellow blink ing System identify . This state is initiated by the user . This LED can be initiated manually by usin[...]

70 In addition, a Power Sup ply Identify LED is locat ed on the outside of th e chassis, next to the corresponding power supply . This LED allows the us er to initiate a comman d that causes the Identify LED to blink, which assists in locating a particular Field Repl aceable Unit. Figure 5-3: Power Supply Identify LED Replicas of the Power Supply L[...]

71 Fan LEDs Location The Fan LEDs are located at the top of each Fan tray module. Refer to “Front Panel LEDs” on page 68 . In addition, replicas of the Fa n T ray LED s are positioned on the back of the chassis. Refer to “Management Interface Module LEDs” on page 73 . Interpreting the Fan LEDs T able 5-3: In terpreting the Power Supply Iden[...]

72 Fabric Controller LEDs Each Fabric Module has two sets of LED indicators. • The two LEDs (green or yellow) are the module status indicators ( Ta b l e 5 - 5 ). • The single LED (green only) indicates whether of n ot the module is th e active system master ( Ta b l e 5 - 6 ). Location Refer to Figure 5-1 to view the front panel of the chassis[...]

73 Interpreting the Back Panel LEDs The back of the T opspin 270/Cisco SFS 7008 cha ssis has the following types of LED indicators: • “Management Interface Module LEDs” on page 73 • “Chassis ID LEDs” on page 76 • “LIM Status LEDs ” on page 77 • “InfiniBan d Port LEDs” on page 77 Figure 5-5: Back Panel LEDs Management Interfa[...]

74 Location The Management Interface modules are located at the top of back the chassis. Refer to Figure 5-5 to view the chassis diagram. Figure 5-6: Managem ent Interface Module LEDs Interpreting the Manag ement Interface LEDs System S tatus LEDs Management Interf ace S tatus LEDs T able 5-7: In terpreting the Man agement Interf ac e Module System[...]

75 Fan T ray Module S tatus LEDs Power Supply Module S tatus LEDs Green off No power to the Manageme nt Interface module, LED failure, or yellow LED is ON. Y ellow solid on Failure of the Mana gement Interface module. Operator attention required. The “ ! ” label indicates a failure. Y ellow blinking Identify a Management Interface module. Assis[...]

76 Master Management Connection S t atus LED The Master Management Connection Status LED is a single LED that indicates wh ether that particular Management Interface module is connected to the syste m's active master controller . Refer to Figure 5-5 to view the location of this LED. Ethernet Management Po rt RJ-45 connector LEDs Refer to Figur[...]

77 LIM S t atus LEDs Location The LIM Status LED is located at the far left of each LIM card (if you are facing the back of the chassis). Refer to Figure 5-5 for a complete diagram of th e back panel of the chassis. Figure 5-8: LIM S tatus In dicator LE Ds Interpreting the LIM S tatus LEDs InfiniBand Port LEDs The InfiniBand LED represents the logi[...]

78 Location The InfiniBand port LEDs are located to the right of each InfiniBand port (i f you are facing the LIM card) in the back of the chassis. Figure 5-9: InfiniBand Port LEDs Interpreting the InfiniBand Port LEDs Monitoring the System with Chassis Manager For information regarding launching the Chassis Manager GU I, refer to the Chassis Manag[...]

79 3. The Device Rear V iew and the Device Front V iew appear . Figure 5-10: Chassis Manager T opspin 270/Cisco SFS 7008 Device Rear V iew[...]

80 Figure 5-1 1: Chassis Manager T opspin 2 70/Cisco SFS 7008 De vice Front V iew 4. V iew the information at the top of the window to quickly check the status color and the num ber of modules installed . • The numbers associated with the Card field indicate the slot numbers where modules are installed. • The numbers associated with the Power S[...]

81 • In the case of the fabric controller cards, th e card that is currently on standby (not the master) will be grey . The master fabric contro ller will be green. • A red LED indicates that an error has been detected. Monitor the Cards 1. Launch the Chassis Manager by entering the IP address of the InfiniB and switch into your web browser . 2[...]

82 normal bootFailed tooHot booting checkingBootImage wrongBootImage rebooting standby recoveryImage 9. Click the radio button next to the card that you want to monitor . 10. Click the Properties button to view details about the card, or to reset the card. Reset a card to return it to the default state. The cards cannot be shut down because they ar[...]

83 7. V iew the Admin S tatus and the Oper S tatus of the ports. The Admin Status refers to the state that the admin has chosen the port to be. The Oper S t atus refers to the actua l state of the port. For example, an admin may have selected a state of “U p” for a po rt, but the Oper Status would display “down” if a cable had not b een con[...]

84 The Power Supplies view appears. Figure 5-15: Chassis Ma nager Power Supplies Window Monitor the Fans 1. Launch the Chassis Manager by entering the IP address of the InfiniB and switch into your web browser . 2. Log into the chassis. 3. The Device Rear V iew and the Device Front V iew appear . 4. V iew the Fan status at the top of the window to [...]

85 Monitor the T emperature 1. Launch the Chassis Manager by entering the IP address of the InfiniB and switch into your web browser . 2. Press the Enter key . 3. The Device Rear V iew and the Device Front V iew appear . 4. Click open the Chassis file in the left-navigation tree. The individual components app ear beneath the Chassis menu. Click Sen[...]

86 Monitoring the System with Element Manager For information regarding installi ng the optionally licensed Element Manager GUI, refer to the InfiniBand User Guide . 1. Launch the Element Manager . 2. Select Health > St a t u s . The Health Status window opens. Figure 5-18: Element Manager Summary T ab Interpreting the Summary T ab 3. Use the Su[...]

87 Interpreting the Power Supplies T ab Use the Health > St a t u s > Power Supplies tab to view the operating st atus of the power supplies. Figure 5-19: Element M anager Power Supplies T ab Interpreting the Fans T ab Use the Health > St a t u s > Fans tab to view the operating status of the fans. Figure 5-20: Element Manager Fans T ab[...]

88 Figure 5-21: Element M anager Sensors T ab 6. Note the OperS tatus field. A status of “up” indicates th at the sensor is functioning properly . 7. Note the T emperature field. Each slot has an individua l temperature sensor . The Alarm and Shutdown temperatures vary by slot type. Monitor the System With the CLI For a complete list of CLI com[...]

89 Note the Speed field. The integer in this field represents a percentage. The percentage changes based on the ambient temperature of the unit, and will increase as the temperature rises . Example Monitor the Sensors •s h o w s e n s o r Example Note the T emperature field. The temperature is displaye d in Cels ius. The system’ s maximum exter[...]

90[...]

91 6 Hardware Diagnostic T est s This chapter describes how to run diagnostic tests on th e T opspin 270/Cisco SFS 7008 system hardware. • “About Diagnostic T ests” on page 91 • “Displaying Hardware Errors” on page 101 About Diagnostic T est s Hardware diagnostic tests can be performed through the CLI or the Element Manager GUI. Refer t[...]

92 • Power Supply page 98 • Rack-Locator Run Card T est s References to “Cards” refers to fabric controllers , management I/O modules, no de cards and the chassis ID module. Fans and power supplies are not included in the Card test s; they can be tested through the standard chassis test ( page 95 ), or as indiv idual components. The followi[...]

93 Example of comp leted test SFS-270(config-diag-card-11)# exit SFS-270(config)# exit SFS-270# show diagnostic card 11 ================================= =============================================== Diagno stic Tests For Cards ================================= =============================================== test : self- test slot-id : 11 iterati[...]

94 3. Use the more file-system : file-name comm and to display the log file and view the detailed results of the diag test . Example of l og resu lts 4. Enter reload to reboot the switch after the test is complete. If you do not reboot the switch after running the self-test, the switch will remain in an unknown state. Run Chassis T est s The follow[...]

95 • Standard page 95 • Extended • Extended Memory Run a Chassis S t andard T est The chassis standard diag test runs a diag nostic test on all cards in the chassis. 1. Enter the diag chassis test standard and start commands to initiate the test. Example 2. Enter the show diag chassis command to show the status of the diag test. Example SFS-2[...]

96 3. Enter the show diag post command to show any errors on individual components. Example Run Fan T est s The following tests are available to locate and diagnose fan m odules: •L E D •S e l f - T e s t page 96 Run a Self-T est on a Fan 1. Identify the numb er of the fan you want to diagnose, if you do not already know the nu mber . a. Enter [...]

97 2. Enter the diag fan < id > command. Example 3. Use the show diag fan command to show the progress of the test. Example SFS-270# config SFS-270(config)# diag fan 1 SFS-270(config-diag-fan-1)# test self-test SFS-270(config-diag-fan-1)# start SFS-270(config-diag-fan-1)# exit SFS-270(config)# exit SFS-270# show diag fan =====================[...]

98 4. Use the show diag fru-error command to display any errors th at appear in the result-string . Example 5. Reboot the chassis when the self-test is complete. Example Run Power Supply T est s The following tests are available to locate and diagnose fan m odules: •L E D page 98 •S e l f - T e s t page 99 Run a LED T est on the Power Supply Us[...]

99 Run a Self-T est on a Power Supply 1. Show the ID of the power supply that you wan t to diagnose, if you do not already know the number . a. Enter the show power -supply command. Example 2. Enter the diag power-supply < id > command and specify the type of test (self-test is chosen by default). Example 3. S tart the test. Example 4. Use th[...]

100 5. Use the show diag fru-error command to display any errors th at appear in the result-string . Example 6. Reboot the chassis when the self-test is complete. Example Run a Rack Locator T est The rack locator test causes the LEDs on the tested cha ssis to blink for the duration of the test. T o run a rack locator test, perform the following ste[...]

101 3. V iew the results of the test. Example Displaying Hardware Errors T o display POST results, no n-fatal errors that can are recovered, inform ational logging (such as firmware updates), and hardware errors: 1. Use the more syslog:hwif_log command to locate the: /topspin/log/hwif_lo g Example of output without errors SFS-270> show diag rack[...]

102 Y ou can also view POST error codes with the show diagnostic post command. This comm and displays the results of each POST that executed at power -on. Example T o view FRU errors on your T opspin 270/Cisco SFS 7008, enter the show diagnostic fru-error command. Example The following types o f hardware errors are logged for th e T opspin 270/Cisc[...]

105 7 S pecifications and Compliance Certifications This chapter details the T opspin 270/Cisco SFS 7008 specifications and compliance certificat ions. Chassis and Management Interface T able 7-1: Ch assis and Management General S pecifications Operating T emperature Ranges 0 to 40C Operating T emperature 0 to 42C Non-Operating T emperature -40 to [...]

106 Electrical S pecifications EMC/Immunity Safety Acoustics Non-Operating V ibration, random 2.09Grms, 3-axis, bottom/top, left/ right, front/back Max. Operating Inclination 15 degrees T able 7-2: Electrical S pecifications Category Specification AC Input Auto-ranging 90-264V AC, 47-63Hz. Maximum Power consumption <600 W atts T able 7-3: EMC/Im[...]

107 Product Markings • UL, FCC S tatement, VCCI, CE, ICES[...]

108[...]

Index A active controller card 11 admin status 83 C card operational state 81 reset 82 card reset 82 chassis ID about 19 LEDs 76 chassis manager launching 33 LEDs 80 controller card identify active 11 upgrade 59 controllerFabric12x 81 core slot about 18 D diag card 92 diag chassis test standard 95 diag power-supply 99 F fabric controller LEDs gener[...]

R rack-locator 92 reload 94 reset card 82 reset controller card 59 S safety information vii setup 32 show card 11 show diag chassis 95 show diag fru-error 98, 100 show diag post 96 show power-supply 99 slot numbers 15 speed port 83 starting Chassis Manager 33 switch configuration 32 switch fabric end-nodes about the fabric controller module 18 swit[...]