Cisco Systems SFS 7008 manual

Part N u m ber: OL-7725-01 Cisco SFS 7008 InfiniBand Server Switch Hardware Guide ( Topspin 270 Hardware Guide) Release 2.2.0 Update 1 Product ID: 140265[...]

Copyright © 2 004 - 2005 T opspin Communi cations, Inc. All rights reserved. The T opspin Switched Computing Syst em, T opspin Host Channel Adapter, T opspin Element Manager, and collateral software programs and documentation are subject to and ma de available o nly pursuant to the license agreement signed by you and T opspin, Communication s, Inc[...]

iii Regulatory Notices ........................................ vii FCC Statement .................................................................................................................. ........................ vii Safety Inform ation ....... ................................................................................................[...]

iv Connect Management Devices ..................................................................................................... ............. 26 Attach a Serial Console Cable to a PC or Terminal ..................................................................... 26 Connect an Ethernet Cable to the Ethernet Manageme nt Port ...................[...]

v Upgrading a Topspin 270 with Element Manager ........................................................................ 54 Upgrading an Individua l Controller Card ........................................................................................ ..........56 Upgrading a Controller Card with the CLI ...........................................[...]

vi 7: Specifications and Compliance Certifications 103 Chassis and Management Interface ............................................................................................ 10 3 Electrical Spec ifications ...................................................................................................... ....... 104 EMC/Immunity .........[...]

vii Regulatory Notices FCC S t atement This equipment has been tested and found to comply wit h the limits for a Class A digital device, pursuant to Part 15 of the FCC Rules. Th ese limits are designed to provide reasonabl e protection against harmful interference when the equi pment is operated in a commerci al environment. This equipment generate[...]

viii CAUTION: Grounding is supplied by the gro und-prong on the 3-prong power cable. Do not attach a separate ground cable. Do not use adapter plugs. Do not remov e the ground prong from the cable. Ensure the ground connection on the power supply is correct and functioning before applying power to the T op spin system. CAUTION: Always ground yourse[...]

ix CAUTION: Never place your hand inside an empty card or module bay . Y ou should never have cause to place a hand anywhere inside the T opspin chassis. Unused card and module bays should always have a T opspi n cover over the bay to ensure proper safet y , ventilation, and cooling. General Cautions CAUTION: No user is authorized to remove the T o[...]

x[...]

11 1 Features Overview The T op spin 270 Switched Computing System provide s data center managers with a high-performan ce, low-latency interconnect. • “System Architecture” on page 1 1 . • “About the T opspin 270 Chassis” on page 13 . • “Administrative Features” on page 20 . System Architecture Hot S t andby On the T opspin 270, [...]

12 Example The oper code field of the command out put id entifies the controller card as the active card (normal) or the hot standb y card (standby). By d efault, when you power on a T opspin 270, the card in slot 1 1 becomes active and the card in slot 12 becomes the standby . The master and standby controllers automatically synchronize state and [...]

13 Fabric For redundancy , InfiniBand Host Channel Adapters (HCAs) can be dual-connected to a redund ant pair of T o pspin 270s. In an InfiniBand fabric that includes more th an one T opsp in 270: if the subnet manager on the T opspin 270 that is acting as the master fails, another su bnet man ager will take over within seconds. All necessary state[...]

14 Figure 1-2: Back Chassis V iew[...]

15 Chassis Slot Numbering Slot numbers are p rinted on the chassis for easy identificatio n. Figure 1-3: Chassis Slot Numbering in Fr ont (Non-port Side ) Power Supply ID 1 Power Supply ID 2 Fan ID 2 Slot # 9 Slot # 10 Slot # 1 1 Slot # 12 Slot # 13 Slot # 14 Fan ID 1[...]

16 Figure 1-4: Chassis Slot Numbering in Back (Service Side) Dimensions • Height : 6U unit • Wid t h : 17.04” • Depth : 8” - 23.7” • We i g h t : maximum 106 pounds (full chassis configurat ion with 4x copper Li ne Interface Modules) Connections • 96 ports of 10 Gbps 4X Copper InfiniBand. • T wo 10/100 Ethern et RJ-45 Management-E[...]

17 • The power supplies are 1U, 48V , 1200W • The supplies provide regulated +48V DC to all other modules in the system. • Each power supply has self contained fans for cooli ng. Fan T rays Refer to “Installing a Fan Module” on page 41 for installation instru ctions. The fan trays are redundant, hot-swappable cooling units. • Only one f[...]

18 Understanding the Core Slot to Mgmt Interface Module Connection Each Core slot in the chassis (refer to “The Core Slot” on page 18 ) is connected to 1 port on the Management Interface mo dule. The controller (fabri c interface module inserted in the core slot) selects the Management Interface module to which it will connect. The pairing of M[...]

19 • At least one Fabric Controller module must be inst alled in the Core slot for the chassis to boot. • When a module is installed in a Co re slot, it acts as either the master or standby controller for the chassis, with all modules in the system being slaves to the master controller . • The subnet manager runs on the fabri c module install[...]

20 Administrative Features Real-T ime Clock The T opspi n 270 maintains correct time regardless of power conditions or con nectivity . Latency The T opspi n 270 has port to port latency of less than 600ns. Non-V olatile Memory The memory supports up to: • three stored system images ( not including recovery imag e) • one week of log files at nor[...]

21 2 Inst alling the T op spin 270 System This chapter describes how to install and m anage the T op spin 270 system hardware. • “Prepare the Site” on page 21 • “Configure Basic Connectivity ” on page 28 • “Mount the T opspin 270 Chassis in a Rack” on page 22 • “Connect Network Dev ices” on page 30 • “Manage the System?[...]

22 Mount the T op spin 270 Chassis in a Rack This section describes how to install the T opspin 270 chassis in an equipment rack. The followi ng procedure is the standard installa tion, using your own rack shelf. T op spin also has an optional shelf that is appropriat e for pre-racking and shippi ng a unit in the rack. If you have purchased this sh[...]

23 4. Determine the direction that the sw itch will be inst alled and justified in the rack . The direction that the switch will be justified will determine which set of rack ears that need to be rem oved. 5. Use a #2 phillips screwdriver to remove one set of rack ears: • If you have determined that th e switch will be ju stified toward the front[...]

24 7. Use 2 - 3 people to lift the switch into the rack. Figure 2-3: Chassis Set onto Shelf 8. Push the chassis into the rack until the ra ck ear s are flush with rails. Figure 2-4: Rack Ears Flush with Rails[...]

25 9. Use screws that fit your rack to attach both rack ears to the rack rails. Figure 2-5: Use Appropriate Screws to Attach Rack Ears to Rails Inst all Optional HA Component s If you have purchased a High-A vailability (HA) package, install the follo wing components: • Redundant Power Supply . Refer to “Power Supply Modules” on page 35 . •[...]

26 Connect Management Devices T o connect the management ports, use either a serial cable and/or an Ethernet cable. Figure 2-6: Serial and Ether net Management Ports Att ach a Serial Console Cable to a PC or Te r m i n a l 1. Attach the RJ-45 consol e cables from the cable kit that is provided. See Figure 2-7 . a. Connect the cables to the InfiniBa[...]

27 Connect an Ethernet Cable to the Ethernet Management Port 3. Connect an Ethernet cable to the Ethernet port of the left Management Interface module (slot number 15). See Figure 2-7 . a. If you have two Management Interface modules, you may als o want to connect an Ethernet cable to the standby module (slot 16) t o maintain Ethernet connectivity [...]

28 5. Inspect the power cord and determin e if i t provides the proper plug and is appropriately certified for use with your electri cal system. Discard the cord if it is in appropriate for your national electrical system and obtain the proper cord, as required by your national electrical codes or ordinances. Grounding is supplied by the ground-pro[...]

29 Assigning an Address S t atically Refer to the static example below: a. When the system has completed booting, press < Enter > several times to display the CLI prompt. b. Enter the user name and password. The default u ser name is super , and t he default password is super . c. Enter the enable command. d. Enter the configure command. e. E[...]

30 b. Enter the user name and password. The default u ser name is super , and t he default password is super . c. Enter the enable command. d. Enter the configure command. e. Enter the interface mgmt-ethernet command. f. Enter the option dhcp command. The chosen method will be persisten t across module reboots. g. Enable the manageme nt port by en [...]

31 Connecting InfiniBand Devices Attaching the IB Cable to the IB Port T o conn ect using InfiniBand to other workstations or switches, standard 4X InfiniBand cabl es are required. InfiniBand cables can be used to connect an y two InfiniBan d devices, whether switch or host. 1. Plug InfiniBand cables into the InfiniBand swit ch ports. T o plug in a[...]

32 • Chassis Manager (GUI) - A web-based graphic user interface. • Element Manager (GUI) - An optio nally available graphic interface installed on a workstation, and accessible over IP . Refer to the InfiniBand User Guide , the CLI Reference Guide or the Chassis Manager User Guide for more information about managin g the InfiniBand systems. (Op[...]

33 2. T yp e the Management IP address of your Server Switch in the address field of your browser and press Enter . (Y ou configured the IP address in Ste p f. ) Figure 2-10: W eb Browser W indow A log-in window opens. Figure 2-11 displays the log-in window . Figure 2-1 1: Chassis Manager Log-In Window 3. Enter your Server Switch user name and pa s[...]

34 (Optional) Inst all th e Element Manager GUI For more information regarding th e Element Manager tasks, refer to the InfiniBand User Guide . 1. Check that you have sufficient system resources. Y o u will need: • 32 MB free RAM • 50 MB disk space + 50MB additional temporary space during installation • 300 Mhz processor • 800x600 screen re[...]

35 3 Managing Individual Component s This chapter describes how to install the Field Re placeable Units (FRUs) in the T opspin 270 system. About the Field Replaceable Unit s The following Field Replaceable Units (FRUs) are a part of the T opspin 270 chassis: • “Power Supply Modules” on page 35 • “Fan T r ay Modules” on page 39 • “Fa[...]

36 In most cases, vital information can be recovered fr om the failed module. If you have the appropriate support agreement, you may want to return the unit for diagnosis. Refer to “V ital Product Data Storage” on page 20 . Locating the Power Supply Module Both power supply units are l ocated on the front of th e chassis. When facing the front [...]

37 7. Pull the power cord from the chassis. Figure 3-1: Diagram of Power Supply to the Associate d Power Cord 8. Use a #1 phillips screwdriver to unscrew the fasteners that hold the power supply module in place. Figure 3-2: Loosening Captive Screws Power Cord (back) Power Supply (front)[...]

38 9. Use the handle to pull the power supply mo dule from the bay . Figure 3-3: Pulling the Power Supp ly Module from the Bay 10. Install the blanking panel in pl ace of the power supply module. The device should never be run without either a blanking panel or module in any bay , as overheating may occur . or Install a new Pow er Supply module. R [...]

39 7. Insert the new power supply unit into the open slot until it is fully seated. Y ou may need to push the unit with your thumbs to get it completely into the bay . Figure 3-4: Inserting Power Supply Module 8. Secure the captive screws wi th a #1 phillips screwd river . 9. Check the LEDs on the power supply to verify the status of the module. Re[...]

40 4. Use a #1 phillips screw driver to unscrew the captive screws. Figure 3-5: Loosening Captive Screws 5. Carefully begin to pull the fan tray 1” out of the bay . Do not pull the fan tray completely from the bay . CAUTION: The fan tray does not hav e guards over the blades. Y ou must wait until the fan b lades have stopped moving before complet[...]

41 or Install a new fan modul e. Refer to “Installing a Fan Module” on page 41 if you are installing a n ew fan module. Inst alling a Fan Module 1. Remove the new fan module from the package. 2. Ground yourself approp riately . 3. Remove the bezel cover from the front of th e switch, if you have not already done so. 4. Refer to “Removing a Fa[...]

42 9. Check the LEDs on the fan module to verify the status. Refer to “Fan LEDs” on page 69 . Fabric Controllers About the Fabric Controllers Refer to “Fabric Controller Modul es” on page 18 for more specifi c inform ation about t his module. About a Failed Fabric Controller If you believe a fabric co ntroller modul e has failed, contact te[...]

43 5. Use a #1 phillips screwdriv er to unscrew the captive screws from bo th ends of the Fabric Controller card. Figure 3-9: Loosen Ca ptive Screws Before Removing 6. Pull the levers on both sides of the card toward you. The card will be released. Figure 3-10: Opening Fabric C ard Levers 7. Use the levers to pull the card toward you and remove it [...]

44 Inst alling a Fabric Controller 1. Remove the new Fabric Controller module from the packag ing. 2. Ground yourself approp riately . 3. Remove the bezel cover , if you have not already done so. 4. Refer to “Removing a Fabric Controller” on page 42 , if a Fabric Controller module is still in stalled. 5. Remove the blanking panel, if no fabr ic[...]

45 Upgrade the Image with the CLI T o upgrade the image of the Controller card with the Command Line Interface, refer to “Upgrading a Controller Card with the CLI” on page 57 and the following document: • CLI Refer ence Guide Upgrade the Image with the Chassis Manager T o upgrade the system image with the Chassis Ma nager web GUI, refer to th[...]

46 3. Remove the InfiniBand cables from the ports. a. T o remove a cable with a pinch connector , pinc h both sides of the back of the connector and pull the connector aw ay from the port . Figure 3-12: Removing a Pinch-T ype Connector b. T o remo ve a cable with a pull connector, grasp the connector with one hand and push it toward the port, then [...]

47 4. Use a #1 phillips screwdriver to unscrew the captive screws on bot h sides of the LIM card. Figure 3-14: Loose n the Captive Screws 5. Release the LIM module by pulli ng both levers towa rd you, then to ward the outside of the chassi s. Figure 3-15: Relea sing the LIM Module Levers 6. Use the levers to pull the module from the bay . Figure 3-[...]

48 7. Install a blanking panel in pl ace of the LIM module, or refer to “Installing a LIM Module” on page 48 for instruction s on replacing the LIM module. Inst alling a LIM Module 1. Remove the new LIM module from the package. 2. Refer to “Removing a LIM Card” on page 45 , if a LIM module is still in place. 3. Ground yourself approp riatel[...]

49 9. Connect the InfiniBand cables to the ports. a. T o plug in an InfiniBand cab le, push the connector into th e interface until you hear/feel a click.Check the InfiniBand port LEDs to de termine the status of the port. Refer to “InfiniBand Port LEDs” on page 75 . Management Interface Modules About Management Interface Modules Refer to “Ma[...]

50 7. If the Master Management Interface module wa s removed, the standby module becomes active. The “Master” led becomes green. 8. Install a blanking panel in th e empty bay , or refer to “Installing a Management Interface Module” on page 50 to replace the Management Interface module. Inst alling a Management Interface Module 1. Remove the[...]

51 3. Use a #1 phillips screwdriver to loosen and remov e the screws from the left and right side of the Chassis ID module. Figure 3-20: Loose n the Captive Screws 4. Pull the Chassi s ID mod ule from the bay . Figure 3-21: Remove the Chassis ID Module 5. Do not allow the bay to rema in empty , as overheating may occur . The T opspin 270 should nev[...]

52 Inst alling a Replacement Chassis ID Module 1. Remove the new Chassis ID module from the package. 2. Ground yourself approp riately . 3. Remove the old Chassis ID module, if you have not already don e so. Refer to “Removing a Chassis ID Module” on page 50 if a Chassis ID module is still in pl ace. 4. Align the chassis ID module with the sl o[...]

53 4 Administrative T asks This chapter describes administrative tasks that may be performed on the T opspin 270 system. • “Upgrade all Cards in a Chassis” on page 53 • “Upgrading an Individual Controller Card” on page 56 • “Upgrading Individual Node Cards” on page 59 Upgrade all Cards in a Chassis These procedures assumes you are[...]

54 Upgrading a T op spin 270 with Element Manager The following procedure describes the upgrade procedure using the Element Manag er GUI. This procedure also assumes you are upgrading all fabric controllers in the chassis. 1. Launch Element Manager for the server switch. 2. Delete any old .img files to make room for the new image. a. Select Mainten[...]

55 Note : all cards in the chassis must have an oper -status of “ up ” for the upgrade to be ef fective on all components. a. Select Maintenance > File Manageme nt b. Click the new .img file and click the Install butto n. c. Click Ye s when prompted. d. Repeat for all Server Switches you wish to upgrade. Figure 4-2: W atching the File Copy P[...]

56 6. Select Maintenance > Reboot to reboot the controller cards and activate the image. Click Ye s at the prompt. 7. V iew the new image on the cards: a. Select Vi e w > Device Front V iew . b. Right-cl ick one of the cards and select Properties . c. Click the Inventory tab and view the version name in the Current Image Source field. Figure [...]

57 Upgrading a Controller Card with the CLI For the commands needed to upgrade a single Controller card using the CLI, refer to the CLI Refer ence Guide . 1. Check the version of your Controller card with the show card-inventory command. In the example below , only the Controller card in slot 12 needs to b e upgraded. Example Topspin-270# show card[...]

58 2. Show the standby Controller card. Example 3. Check to see if you alread y have a .img file that can be installed. (Delete the .img file, if it not the one you need to install. Use the delete [ slot-number : ] imag e: file-name command.) Example 4. Copy the image to the switch, if you do not have the correct .img file. copy ftp: //< r e mot[...]

59 5. Activate the image. After download ing the image file to the chassis controller , it must be installed to become active. The install command installs the specified image file into the system. a. In the privileged-execute mode, enter install image: image-file-name .img Example 6. Specify the new boot image to be used. a. Find the name of your [...]

60 Upgrading a Node Card with Element Manager The following procedure describes the upgrade procedure for indiv idual node cards using the Element Manager GUI. This procedure assumes you are upgra ding only one or more node cards, and not the Controller cards. 1. Launch Element Manager for the server switch. 2. Delete any old .img files to make roo[...]

61 Note : all node cards in the must have an oper - status of “ up ” for the upgrade to be ef fective. a. Select Maintenance > File Manageme nt b. Click the new .img file and click the Install butto n. c. Click Ye s when prompted. Figure 4-6: W atching the File Copy Progress d. Click Ok when the Image Install Comp leted Successfully message [...]

62 6. Activate the image on the node card(s) by enabli ng and disabling each node car d. Do not reboot the chassis as this will not result in the image being applied to the node card(s). a. Right-click a node card and select Pr operties . b. Click the down radio button and select the Apply but ton. Figure 4-8: Disable and Enable the Node Card(s) c.[...]

63 Upgrading Node Card(s) with the Chassis Manager For the procedure needed to upgrade node cards using the Chassis Manager GUI, refer to the Chassis Manager User Guide .[...]

64[...]

65 5 Monitoring the T op spin 270 System This chapter describes how to install and m anage the T op spin 270 system hardware. • “Interpret ing the Front Panel L EDs” on page 65 • “Interpreting the Back Panel LED s” on page 71 • “Monitoring the System with Chassis M anager” on page 76 • “Monitoring the System wit h Element Mana[...]

66 Figure 5-1: Front Pan el LEDs System-Wide S t atus LED Locating the System-Wide S tatus LED The system-wide status LED is located on the front of the chassis, and is visible whether the bezel cover is on or off. This LED indicates the over all health of all mo dules in the system. If you are facing the front of the chassis, the system -wide stat[...]

67 Power Supply LEDs Locating the Power Supply LEDs The Power Supply LEDs are located in the outside of each Power Supp ly module, if you are facing the front of the chassis with the bezel cover removed. Figure 5-2: Power Supply LEDs Y ellow blinking System identify . This state is initiated by the user . This LED can be initiated manually by using[...]

68 In addition, a Power Sup ply Identify LED is locat ed on the outside of th e chassis, next to the corresponding power supply . This LED allow s the us er to initiate a comman d that causes the Identify LED to blink, which assists in locating a particular Field Repl aceable Unit. Figure 5-3: Power Supply Identify LED Replicas of the Power Supply [...]

69 Fan LEDs Location The Fan LEDs are located at the top of each Fan tray module. Refer to “Front Pan el LEDs” on page 66 . In addition, replicas of the Fa n T ray LEDs are positio ned on the back of the chassis. Refer to “Management Interface Module LEDs” on page 71 . Interpreting the Fan LEDs T able 5-3: Interpretin g the Power Supply Ide[...]

70 Fabric Controller LEDs Each Fabric Module has two sets of LED indicators. • The two LEDs (green or yellow) are the module status indicators ( Ta b l e 5 - 5 ). • The single LED (green only) indicates whether of n ot the module is th e active system master ( Ta b l e 5 - 6 ). Location Refer to Figure 5-1 to view the front panel of the chassis[...]

71 Interpreting the Back Panel LEDs The back of the T o pspin 270 chassis has the following types of LED indicato rs: • “Management Interface Module LEDs” on page 71 • “Chassis ID LEDs” on page 74 • “LIM Status LEDs ” on page 75 • “InfiniBan d Port LEDs” on page 75 Figure 5-5: Back Panel LEDs Management Interface Module LEDs[...]

72 Location The Management Interface modules are located at the top of back the chassis. Refer to Figure 5-5 to view the chassis diagram. Figure 5-6: Managem ent Interface Module LEDs Interpreting the Manag ement Interface LEDs System S tatu s LEDs Management Interf ace S tatus LEDs T able 5-7: Interpretin g the Management Interf ac e Module System[...]

73 Fan T ray Mo dule S tatus LEDs Power Supply Module S tatus LEDs Green off No power to the Manageme nt Interface module, LED failure, or yellow LED is ON. Y ellow solid on Failure of the Mana gement Interface module. Operator attention required. The “ ! ” label indicates a failure. Y ellow blinking Identify a Management Interface module. Assi[...]

74 Master Management Connection S tatus LED The Master Management Connection Status LED is a single LED that indicates wh ether that particular Management Interface module is connected to the syste m 's active master controller . Refer to Figure 5-5 to view the location of this LED. Ethernet Management Po rt RJ-45 connector LEDs Refer to Figur[...]

75 LIM S t atus LEDs Location The LIM Status LED is located at the far left of each LIM card (if you are facing the back of the chassis). Refer to Figure 5-5 for a complete diagram of th e back panel of the chassis. Figure 5-8: LIM S tatus Indicat or LEDs Interpreting the LIM S tatus LEDs InfiniBand Port LEDs The InfiniBand LED represents the logi [...]

76 Location The InfiniBand port LEDs are located to the right of each InfiniBand port (i f you are facing the LIM card) in the back of the chassis. Figure 5-9: InfiniBand Port LEDs Interpreting the InfiniBand Port LEDs Monitoring the System with Chassis Manager For information regarding launching the Chassis Manager GU I, refer to the T opspin 270 [...]

77 3. The Device Rear V iew and the Device Front V iew appear . Figure 5-10: Chassis Ma nager 270 Device Rear View[...]

78 Figure 5-1 1: Chassis Manager 270 Device Front View 4. V iew the information at the top of the window to quickly check the status color and the number of modules installed . • The numbers associated with the Card field indicate the slot numbers where modules are installed. • The numbers associated with the Power Supplies and Fans fields indi[...]

79 • In the case of the fabric controller cards, th e card that is currently on standby (not the master) will be grey . The master fabric controller will be green. • A red LED indicates that an error has been detected. Monitor the Cards 1. Launch the Chassis Manager by entering the IP address of the InfiniB and switch into your web browser . 2.[...]

80 normal bootFailed tooHot booting checkingBootImage wrongBootImage rebooting standby recoveryImage 9. Click the radio button next to the card that you want to monitor . 10. Click the Properties button to view details about the card, or to reset the card. Reset a card to return it to the default state. The cards cannot be shut down because they ar[...]

81 7. V iew the Admin S tatus and the Oper S tatus of the ports. The Admin Status refers to the state that the admin has chosen the port to be. The Oper S t atus refers to the actua l state of the port. For example, an admin may have selected a state of “U p” for a po rt, but the Oper Status would display “down” if a cable had not b een con[...]

82 The Power Supplies view appears. Figure 5-15: Chassis Ma nager Power Supplies Window Monitor the Fans 1. Launch the Chassis Manager by entering the IP address of the InfiniB and switch into your web browser . 2. Log into the chassis. 3. The Device Rear V iew and the Device Front V iew appear . 4. V iew the Fan status at the top of the wind ow to[...]

83 Monitor the T emperature 1. Launch the Chassis Manager by entering the IP address of the InfiniB and switch into your web browser . 2. Press the Enter key . 3. The Device Rear V iew and the Device Front V iew appear . 4. Click open the Chassis file in the left-navigation tree. The individual components app ear beneath the Chassis menu. Click Sen[...]

84 Monitoring the System with Element Manager For information regarding installi ng the optionally licensed Element Manager GUI, refer to the InfiniBand User Guide . 1. Launch the Element Manager . 2. Select Health > St a t u s . The Health S tatus window opens. Figure 5-18: Element Manager Summary T ab Interpreting the Summary T ab 3. Use the S[...]

85 Interpreting the Power Supplies T ab Use the Health > St a t u s > Power Supplies tab to view the operating st atus of the power supplies. Figure 5-19: Element M anager Power Supplies T ab Interpreting the Fans T ab Use the Health > St a t u s > Fans tab to view the operating status of the fans. Figure 5-20: Element Manager Fans T ab[...]

86 Figure 5-21: Element M anager Sensors T ab 6. Note the OperS tatus field. A status of “up” indicates th at t he sensor is functioning prop erly . 7. Note the T emperature field. Each slot has an individua l temperature sensor . The Alarm and Shutdown temperatures vary by slot type. Monitor the System With the CLI For a complete list of CLI c[...]

87 Note the Speed field. The integer in this field represents a percentage. The percentage changes based on the ambient temperature of the unit, and will increase as the temperature rises . Example Monitor the Sensors •s h o w s e n s o r Example Note the T emperature field. The temperature is displaye d in Celsius. The system’ s maximum extern[...]

88[...]

89 6 Hardware Diagnostic T est s This chapter describes how to run diagnostic tests on th e T opspin 270 system hardware. • “About Diagnostic T ests” on page 89 • “Displaying Hardware Errors” on page 99 About Diagnostic T est s Hardware diagnostic tests can be performed through the CLI or the Element Manager GUI. Refer to the Element Ma[...]

90 Run Card T est s References to “Cards” refers to fabric controllers , management I/O modules, no de cards and the chassis ID module. Fans and power supplies are not included in the Card test s; they can be tested through the standard chassis test ( page 93 ), or as indiv idual components. The following tests are available to locate a nd diag[...]

91 Example of comp leted test Topspin-270(config-diag-card-11)# exit Topspin-270(config)# exit Topspin-270# show diagnostic card 11 ================================= =============================================== Diagno stic Tests For Cards ================================= =============================================== test : self- test slot-id [...]

92 3. Use the more file-system : file-n ame command to displ ay the log file and view the detailed results of the diag test . Example of l og resu lts 4. Enter reload to reboot the switch after the test is complete. If you do not reboot the switch after running the self-test, the switch will remain in an unknown state. Run Chassis T est s The follo[...]

93 • Standard page 93 • Extended • Extended Memory Run a Chassis S t andard T est The chassis standard diag test runs a diag nostic test on all cards in the chassis. 1. Enter the diag chassis test standard and start commands to initiate the test. Example 2. Enter the show diag chassis command to show the status of the diag test. Example Topsp[...]

94 3. Enter the show diag post command to show any errors on indivi dual components. Example Run Fan T est s The following tests are available to locate and diagnose fan m odules: •L E D •S e l f - T e s t page 94 Run a Self-T est on a Fan 1. Identify the numb er of the fan you want to diagnose, if you do not already know the nu mber . a. Enter[...]

95 2. Enter the diag fan < id > command. Example 3. Use the show diag fan command to show the progress of the test. Example Topspin-270# config Topspin-270(config)# diag fan 1 Topspin-270(config-diag-fan-1)# t est self-test Topspin-270(config-diag-fan-1)# s tart Topspin-270(config-diag-fan-1)# e xit Topspin-270(config)# exit Topspin-270# show[...]

96 4. Use the show diag fru-error command to display any errors th at appear in the result-string . Example 5. Reboot the chassis when the self-test is complete. Example Run Power Supply T est s The following tests are available to locate and diagnose fan m odules: •L E D page 96 •S e l f - T e s t page 97 Run a LED T est on the Power Supply Us[...]

97 Run a Self-T est on a Power Supply 1. Show the ID of the power supply that you wan t to diagnose, if you do not already know the number . a. Enter the show power -supply comma nd. Example 2. Enter the diag power-supply < id > command and specify the type of test (self-test is chosen by default). Example 3. S tart the test. Example 4. Use t[...]

98 5. Use the show diag fru-error command to display any errors th at appear in the result-string . Example 6. Reboot the chassis when the self-test is complete. Example Topspin-270# show diag fru-error ================================= =============================== Fru-Error ================================= =============================== fru-s[...]

99 Displaying Hardware Errors T o di splay POST results, non-fatal errors th at can are recovered, inform ational logging (such as firmware updates), and hardware errors: 1. Use the more syslog:hwif_log command to locate the: /topspin/log/hwif_lo g Example of output without errors Y o u can also view POST error codes with the show diagnostic post c[...]

100 T o view FRU errors on y our T opspin 270, enter the show diagnostic fru-error command. Example Error T ypes The following types o f hardware errors are logged for the T opspin 270 baseboard: The following types o f hardware errors are logged for the T opspin 270 power supply: Topspin-270# show diagnostic fru-error =============================[...]

101 2 Power Supply Fan Fail Error 3 Power Supply I2C Communication Error T able 6-2: T opspin 270 Power Supply Errors Error Number Description[...]

102[...]

103 7 S pecifications and Compliance Certifications This chapter details the T opspin 270 sp ecifications and compliance certifications. Chassis and Management Interface T able 7-1: Chassis and Management General S pecifications Operating T emperature Ranges 0 to 40C Operating T emperature 0 to 42C Non-Operating T emperature -40 to 70C Operating T [...]

104 Electrical S pecifications EMC/Immunity Safety Acoustics Non-Operating V ibration, random 2.09Grms, 3-axis, bottom /top, left/right, front/back Max. Operating Inclination 15 degrees T able 7-2: Electrical S pecific ations Category Specification AC Input Auto-ranging 90-264V AC , 47-63Hz. Maximum Power consumption <600 W atts T able 7-3: EMC/[...]

105 Product Markings • UL, FCC S tatement, VCCI, CE, ICES[...]

106[...]

Index A active controller card 11 admin status 81 C card operational state 79 reset 80 card reset 80 chassis ID about 19 LEDs 74 chassis manager launching 32 LEDs 78 controller card identify active 11 upgrade 59 controllerFabric12x 79 core slot about 18 D diag card 90 diag chassis test standard 93 diag power-supply 97 F fabric controller LEDs gener[...]

R rack-locator 89 reload 92 reset card 80 reset controller card 59 S safety information vii setup 32 show card 11 show diag chassis 93 show diag fru-error 96, 98 show diag post 94 show power-supply 97 slot numbers 15 speed port 81 starting Chassis Manager 32 switch configuration 32 switch fabric end-nodes about the fabric controller module 18 switc[...]