IBM RS/6000 SP manual

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114

Go to page of

A good user manual

The rules should oblige the seller to give the purchaser an operating instrucion of IBM RS/6000 SP, along with an item. The lack of an instruction or false information given to customer shall constitute grounds to apply for a complaint because of nonconformity of goods with the contract. In accordance with the law, a customer can receive an instruction in non-paper form; lately graphic and electronic forms of the manuals, as well as instructional videos have been majorly used. A necessary precondition for this is the unmistakable, legible character of an instruction.

What is an instruction?

The term originates from the Latin word „instructio”, which means organizing. Therefore, in an instruction of IBM RS/6000 SP one could find a process description. An instruction's purpose is to teach, to ease the start-up and an item's use or performance of certain activities. An instruction is a compilation of information about an item/a service, it is a clue.

Unfortunately, only a few customers devote their time to read an instruction of IBM RS/6000 SP. A good user manual introduces us to a number of additional functionalities of the purchased item, and also helps us to avoid the formation of most of the defects.

What should a perfect user manual contain?

First and foremost, an user manual of IBM RS/6000 SP should contain:
- informations concerning technical data of IBM RS/6000 SP
- name of the manufacturer and a year of construction of the IBM RS/6000 SP item
- rules of operation, control and maintenance of the IBM RS/6000 SP item
- safety signs and mark certificates which confirm compatibility with appropriate standards

Why don't we read the manuals?

Usually it results from the lack of time and certainty about functionalities of purchased items. Unfortunately, networking and start-up of IBM RS/6000 SP alone are not enough. An instruction contains a number of clues concerning respective functionalities, safety rules, maintenance methods (what means should be used), eventual defects of IBM RS/6000 SP, and methods of problem resolution. Eventually, when one still can't find the answer to his problems, he will be directed to the IBM service. Lately animated manuals and instructional videos are quite popular among customers. These kinds of user manuals are effective; they assure that a customer will familiarize himself with the whole material, and won't skip complicated, technical information of IBM RS/6000 SP.

Why one should read the manuals?

It is mostly in the manuals where we will find the details concerning construction and possibility of the IBM RS/6000 SP item, and its use of respective accessory, as well as information concerning all the functions and facilities.

After a successful purchase of an item one should find a moment and get to know with every part of an instruction. Currently the manuals are carefully prearranged and translated, so they could be fully understood by its users. The manuals will serve as an informational aid.

Table of contents for the manual

  • Page 1

    RS / 6 000 SP S P Sw i t ch Ser v i c e Gu i de GA22-7443-04 IBM[...]

  • Page 2

    [...]

  • Page 3

    RS / 6 000 SP S P Sw i t ch Ser v i c e Gu i de GA22-7443-04 IBM[...]

  • Page 4

    Note! Before using this information and the product it supports, read the information in “Safety and environmental notices” on page ix and “Notices” on page A-1. Fifth Edition (April 2002) This book replaces GA22-7443-03. IBM welcomes your comments. A form for readers’ comments may be provided at the back of this publication or you may ad[...]

  • Page 5

    Contents Figures .................................... v T ables .................................... v i i Safety and environmental notices .......................... i x Safety notices .................................. i x Danger notices ................................. i x Caution notices ................................ x i Laser safety inform[...]

  • Page 6

    Selecting the switch clock source ......................... 3 - 6 Determining the correct switch clock source ..................... 3 - 6 Removing and restoring switch resources ....................... 3 - 7 Removing a switch assembly from the active configuration ................ 3 - 7 Restoring a switch assembly to the active configuration ......[...]

  • Page 7

    Figures 1-1. SP Switch high-level diagram ......................... 1 - 2 1-2. SP Switch wrap plugs ........................... 1 - 4 1-3. SP Switch inner chassis and front chassis cables ................. 1 - 8 2-1. Front view of frame locations ......................... 2 - 3 2-2. Front view of multi-switch frame locations .................... 2 [...]

  • Page 8

    vi RS/6000 SP: SP Switch Service Guide[...]

  • Page 9

    T ables 1-1. Switch problem diagnostics ......................... 1 - 4 1-2. Environmental messages for switches ..................... 1 - 5 1-3. Switch connector resistance values ...................... 1 - 6 1-4. Fan failure diagnostics ........................... 1 - 8 1-5. Inner chassis cable continuity ........................ 1-16 1-6. Front [...]

  • Page 10

    viii RS/6000 SP: SP Switch Service Guide[...]

  • Page 11

    Safety and environmental notices For general information concerning safety , refer to Electrical Safety for IBM Customer Engineers , S229-8124. For a copy of the publication, contact your IBM account representative or the IBM branch office serving your locality . Safety notices The following is a list of all safety notices (in English only) pertain[...]

  • Page 12

    DANGER Before you connect the power cable of this product to ac power , verify that the power receptacle is correctly grounded and has the correct voltage. ( SPSFD004 ) DANGER During an electrical storm, do not connect or disconnect any cable that has a conductive outer surface or a conductive connector . ( SPSFD005 ) DANGER Switch off power and un[...]

  • Page 13

    DANGER The remaining steps of the procedure contain measurements that are taken with power on. Remember that hazardous voltages are present. ( SPSFD013 ) DANGER The frame main circuit breaker and the controller must not be switched on again now . Before disconnecting the power cables from the power receptacles, ensure that the customer’s branch d[...]

  • Page 14

    CAUTION: The covers are to be closed at all times except for service by trained service personnel. ( SPSFC003 ) CAUTION: When the unit is being serviced, the covers should not be left off or opened while the machine is running unattended. ( SPSFC004 ) CAUTION: Due to weight of each thin node (under 18 Kg [40 lbs]), use care when removing and replac[...]

  • Page 15

    CAUTION: v When moving frames into position, team members should work together . Using one person on each corner of the frame can prevent strain. v In raised floor installations, mechanically safe moldings should be installed around floor cutouts. Extreme caution should be used when moving frames during installation or removal because of the proxim[...]

  • Page 16

    This product might contain nickel-cadmium or lithium batteries in communication adapters. The batteries must be recycled or disposed of properly . Recycling facilities might not be available in your area. In the United States, IBM has established a collection process for reuse, recycling, or proper disposal of used sealed lead-acid, nickel-cadmium [...]

  • Page 17

    About this book This book is part of the RS/6000 ® SP ™ hardware service library and applies to the RS/6000 SP Switch. Use this book to assist you in performing the following tasks: v Identify field replaceable unit (FRU) locations v Isolate RS/6000 SP failures using Maintenance Analysis Procedures (MAPs) v Perform diagnostic service procedures [...]

  • Page 18

    How to send your comments Y our feedback is important in helping to provide the most accurate and highest quality information. If you have any comments about this book or any other RS/6000 SP documentation: v Send your comments by e-mail to mhvrcfs@us.ibm.com . Be sure to include the name of the book, the order number of the book, and, if applicabl[...]

  • Page 19

    Summary of changes GA22-7443-04 This edition contains replaces GA22-7443-03 and any update versions made to that level and makes them obsolete. This edition contains minor changes and fixes to softcopy cross-book links. GA22-7443-03 This edition contains replaces GA22-7443-02 and any update versions made to that level and makes them obsolete. This [...]

  • Page 20

    xviii RS/6000 SP: SP Switch Service Guide[...]

  • Page 21

    Chapter 1. Maintenance Analysis Procedures (MAPs) This chapter provides information for identifying problems and guides you to the most likely failed Field Replaceable Unit (FRU). The MAPs then refer you to the FRU Removal/Replacement procedures for the corrective action. v “SP Switch description and problem determination (MAP 0590)” v “SP Sw[...]

  • Page 22

    FRUs include: Fans, circuit breaker/LED card, switch supervisor card, switch power card(s), inner chassis cable, front chassis cable, complete assembly . SPS-8 There are only 8 ports. All clocks are distributed through data cables. FRUs include: Fans, circuit breaker/LED card, switch supervisor card, switch power card(s), inner chassis cable, front[...]

  • Page 23

    There are two LEDs on the front of each SP Switch. For quick reference, their definitions are as follows: Environment (Y ellow) Off No environmental problems detected by switch supervisor card. On W arning of environmental condition out of nominal range. Preventative Maintenance should be scheduled for this switch. Flashing Serious environmental co[...]

  • Page 24

    T able 1-1. Switch problem diagnostics Priority Message or condition Action 1 (1 of 3) Environmental problems v Errpt: “Failure...” v Log: “Shutdown: V oltage...” v Log: “Shutdown: Fan...” v Log: “Shutdown: T emperature...” v Errpt: “W arning...” v Log: “W arning:...” v Environment (Y ellow) LED- on or flashing Go to “SP S[...]

  • Page 25

    SP Switch environment (MAP 0600) Purpose of this MAP This MAP provides diagnostic information for switch problems that are related to the operating environment. Note: Refer to “Service position procedures” on page 3-9 for placing a switch into the service position or for removing the switch from the service position. Step 0600-001 Y ou have arr[...]

  • Page 26

    Step 0600-004 Perspectives indicated a shutdown condition and T able 1-2 on page 1-5 directed you to this step. 1. One or more of the following conditions exist: v V oltage out of range: +5 V “shutdownP5” v V oltage out of range: +12 V “shutdownP12” v V oltage out of range: −5 V “shutdownN5” 2. Have the customer remove the SP Switch f[...]

  • Page 27

    3. Is the measured resistance now within the acceptable range? v If yes, go to “Step 0600-017” on page 1-10 to verify fix. v If no, go to “Step 0600-008”. Step 0600-008 Y ou replaced the inner chassis cable and the front chassis cable but the measured resistance is still outside of the acceptable range. 1. This indicates that there is still[...]

  • Page 28

    T able 1-4. Fan failure diagnostics Priority Component Action 1 (1 of 5) Fan 1, 2, 3, 4 or 5 a. Check specified fans for blockages or loose cable connections. b. Fix any obvious problems and continue at “Step 0600-012”. c. If you do not find any problems, continue at Priority 2. 2 (2 of 5) Fan 1, 2, 3, 4 or 5 a. Replace fans as described in Cha[...]

  • Page 29

    6. Check the Environmental (yellow) LED for an ON or FLASHING condition. 7. Is the Environmental (yellow) LED ON or FLASHING? v If the Environmental LED is on or flashing: a. Put the SP Switch’s circuit breaker into the Off (‘0’) position. b. Return to “Step 0600-01 1” on page 1-7 and continue service with the next highest priority . v If[...]

  • Page 30

    2. Remove blockage. 3. If required, put the switch into service position (refer to “Service position procedures” on page 3-9). 4. With all cables replugged and Environmental (yellow) LED OFF , power on the SP Switch. 5. Go to “Step 0600-017” to verify fix. Step 0600-017 Y ou have repaired or replaced a component. 1. If necessary , reinstall[...]

  • Page 31

    2. Remove the switch supervisor card (refer to “Removing the switch supervisor card” on page 4-4). 3. Using a digital multimeter , measure resistance at the planar connection for the supervisor card, between pins 12A and 12B. v The resistance should be in a range of 4 to 20 ohms. 4. Is the measured resistance in the acceptable range? v If yes: [...]

  • Page 32

    Step 0600-025 Y ou have a PS1Fail problem 1. Replace power supply card PS1. 2. Reinstall the SPS front panel assembly , being careful to align the guide pins on the P1 to the inner chassis cup guide. 3. Replug the power cable (J1) and supervisor cable (J2) to the rear of the assembly . 4. Put the circuit breaker in the On (‘1’) position. 5. Doe[...]

  • Page 33

    Step 0600-029 Y ou have a PSFuseGood problem that did not go away when you removed power supply PS1. 1. Put the circuit breaker in the Off (‘0’) position. 2. Remove power cable (J1) and supervisor cable (J2) from the rear of the SP Switch. 3. Remove the front panel assembly . 4. Replug power supply PS1 and remove power supply PS2. 5. Reinstall [...]

  • Page 34

    Step 0610-001 A message in Perspectives indicated that you have a power problem and T able 1-1 on page 1-4 or T able 1-2 on page 1-5 directed you to this MAP . 1. From a Perspectives window on the control workstation or by looking at the SP Switch, check the Power (green) LED for this SP Switch. 2. The definition of the Power (green) LED is as foll[...]

  • Page 35

    Step 0610-005 When you put the circuit breaker into the On (‘1’) position, the circuit breaker tripped into the Off (‘0’) position. 1. Have the customer remove the SP Switch from the active configuration and power off the SP Switch. 2. Put the switch into service position (refer to “Service position procedures” on page 3-9). 3. Go to ?[...]

  • Page 36

    v If yes: a. Have the customer remove the SP Switch from the active configuration and power off the SP Switch. b. Go to “Step 0610-010”. v If no: a. Fix any cable connection problems. b. Return to “Step 0610-006” on page 1-15. Step 0610-010 Y ou have an SP type switch that is either tripping the circuit breaker to the Off position or the ci[...]

  • Page 37

    a. Replace the front chassis cable. b. Return to “Step 0610-004” on page 1-14 to verify the replacement cable. v If no: a. Replace the circuit breaker . b. Return to “Step 0610-004” on page 1-14 to verify the replacement breaker . Step 0610-013 Y ou have continuity on all cables. 1. If this is the first time through this step, replace the s[...]

  • Page 38

    splstdata -n | pg 5. From the system file server , log into “primary” processor node as root using the telnet command: telnet PrimaryNodename 6. Check errpt -a -N Worm | pg for any switch related problems. If any errors are listed, use the error information, with this MAP , to help isolate the problem. 7. Check the functional state of the switc[...]

  • Page 39

    T able 1-7. SP Switch error conditions Error # Message/condition Description and action 2 (SPS) Initialized Description: Initialization detected a wrapped port where a processor node or dependent node was expected (this may result from isolation procedures), or else a disconnected cable. Action: 1. If this is an unexpected condition , check cabling[...]

  • Page 40

    T able 1-7. SP Switch error conditions (continued) Error # Message/condition Description and action −3 (SPS) Device status: Device has been removed from network because of a bad signature Link status: Not operational Description: Possible hardware problem. Action: Go to “Step 0620-004” on page 1-21. −4 (SPS) Device status: Device has been r[...]

  • Page 41

    T able 1-7. SP Switch error conditions (continued) Error # Message/condition Description and action −8 (SPS) Device status: Device has been removed from network because of a miswire Link status: Link has been removed from network, probable miswire Description: Initialization of this link detected a different switch node number than the one expect[...]

  • Page 42

    Refer to notes at beginning of “SP Switch function (MAP 0620)” on page 1-17 for more information on cable connections and logical-to-physical frame translations. c. Be aware that for logical frames consisting of two physical frames, all out.top even-numbered nodes represent nodes physically located in the expansion frame (F/C 1010) but at the n[...]

  • Page 43

    1. Make sure a wrap plug is properly installed on the connector . Refer to Figure 1-2 on page 1-4 for views of the switch wrap plugs. 2. Have customer check (and update if necessary) the switch configuration file appropriately before continuing: v For code level 1.02 and higher , use the Etopology command. 3. Did you just correct a problem with a w[...]

  • Page 44

    v If yes: a. An SRN was obtained from diagnostics. b. Use the following SRN table (T able 1-9) to continue service. c. After using T able 1-9, go to “Step 0620-012” on page 1-26. v If no: a. The diagnostics did not detect a problem, therefore the problem is in SP Switch. b. Go to “Step 0620-041” on page 1-35. T able 1-9. Service Request Num[...]

  • Page 45

    T able 1-9. Service Request Number (SRN) table for SP Switch adapters (continued) Service Request Number SRN source Failing component(s) Description 763-200 through 763-299 (except 763-282) D ext clock SPS MX adapter wrap plug Problem detected with the external clock (SP switch). 763-282 D switch cable Adapter is good but switch cable is not attach[...]

  • Page 46

    T able 1-9. Service Request Number (SRN) table for SP Switch adapters (continued) Service Request Number SRN source Failing component(s) Description 764-2A0 through 764-2A9 D SP System Attachment Adapter Problem detected with the internal clock. 764-3xx (See note) D SP System Attachment Adapter system or I/O planar Problem detected with POS registe[...]

  • Page 47

    T able 1-10. Switch problem priority listing Priority Failing component Action 1 (1 of 7) Software a. Have customer verify that the software is configured and operating correctly for this processor node/system. b. If no problem is found, continue with next highest priority item in the list for this SRN. c. Otherwise, power of f this processor node [...]

  • Page 48

    Step 0620-013 An SRN listed in T able 1-9 on page 1-24 indicated that you have a switch clock problem and Priority 2 in T able 1-10 on page 1-27 directed you to this step. 1. Check the switch clock selections on the “problem” switches . 2. Do the clock settings on the “problem” SP Switches appear to be okay? v If yes, go to “Step 0620-014[...]

  • Page 49

    Step 0620-019 Since the diagnostics did not return an SRN, no problem was detected. 1. Have you just reseated, repaired, or replaced a component? v If yes, go to “Step 0620-043” on page 1-36 to verify fix. v If no: a. Problem is in the SP Switch. b. Go to “Step 0620-041” on page 1-35 to service or replace switch assembly . Step 0620-020 The[...]

  • Page 50

    Note: When unplugging the two ends of the suspect cable, check /var/adm/SPlogs/css/out.top to verify only two (2) ports were lost. If four (4) ports were lost, then two cables were swapped across that switch to switch connection. Connect the cables correctly and check /var/adm/SPlogs/css/out.top for any other errors. 2. If this is a switch-to-switc[...]

  • Page 51

    v If yes, go to “Step 0620-027”. v If no: a. The problem switch is providing the master clock for the system. b. Have customer use the Eclock command to select a different master clock for the system. c. Go to “Step 0620-043” on page 1-36 to verify fix. Step 0620-027 The clock selection is set to one of the External clocks. 1. Select a diff[...]

  • Page 52

    v S00-BH-J9 5. Disconnect the switch data cable at the tailgate of the frame containing the processor node. 6. Connect the end of the processor node data cable to the jack. 7. Run advanced diagnostics on “css0” on the “test” processor node and its associated switch port. v Do not perform the cable wrap test. v Refer to ″ Running diagnosti[...]

  • Page 53

    Step 0620-033 All ground straps connecting the frames make adequate contact at both ends. 1. Disconnect clock source data cable at S00-BH-J3, J5, J7, or J9, then reconnect to SP Switch. (This is done to eliminate clocking noise from cable.) 2. Find a processor node in the “problem” frame which is usable for service. This will be used as the “[...]

  • Page 54

    5. Set the switch clock selections on the “problem” switches (refer to “Selecting appropriate switch clocks” on page 3-6). 6. Run advanced diagnostics on “css0” on the “test” processor node and its associated switch port. v Do not perform cable wrap test. v Refer to ″ Running diagnostics in a processor node ″ in RS/6000 SP: Syst[...]

  • Page 55

    5. Look for an SRN indicating a clock problem, such as “External clock” being listed as one of the failing components. 6. Do the “css0” diagnostics fail with indication of a clock problem? v If yes: a. Problem is the clock selection in this SP Switch. b. Return to “Step 0620-035” on page 1-33. v If no, go to “Step 0620-039”. Step 06[...]

  • Page 56

    2. Put the SP Switch’s circuit breaker into the On (‘1’) position. 3. Go to “Step 0620-043” to verify fix. Step 0620-043 Y ou have replaced switch components and need to verify that the problem has been fixed. 1. Make sure any processor node(s) that was put in SERVICE mode is returned to NORMAL mode. Make sure all processor node(s) are IP[...]

  • Page 57

    Chapter 2. Locations Naming standard for RS/6000 SP components ..................... 2 - 1 Format structure ............................... 2 - 1 Example of format structure .......................... 2 - 1 Frame (WWW) ............................... 2 - 1 Major assembly (XXX) ............................ 2 - 2 Sub-assembly (YY) ...................[...]

  • Page 58

    – 01 - 99 for frames 1-99 (specific to that frame) Notes: 1. E01 designates RS/6000 SP physical frame 1 2. L00 designates any/all RS/6000 SP logical frames 3. S00 designates any/all RS/6000 SP multi-switch frames 4. For locations inside a frame, the Frame (WWW) and/or Major Assembly (XXX) strings may be omitted, making the format YY -ZZZ Major as[...]

  • Page 59

    Front and rear views of RS/6000 SP frame Figure 2-1 shows a front view of the RS/6000 SP frame locations. “Frame (FRA)” on page 2-6 describes the assembly designations for the RS/6000 SP frame. Figure notes: 1. Wide processor nodes take up an entire shelf position (two thin processor node slots). They are identified by the odd numbered position[...]

  • Page 60

    Figure 2-2 shows a front view of the RS/6000 SP multi-switch frame. Figure 2-3 on page 2-5 shows a front view of the Model 3AX (49-inch) frame. Main Power Switch with LED Left Skirt Right Skirt Switch Asm S2 Switch Asm S4 Switch Asm S6 Switch Asm S8 Switch Asm S10 Switch Asm S12 Switch Asm S14 Switch Asm S16 SP Switch Frame Locations - Front V iew [...]

  • Page 61

    Figure notes: 1. Wide processor nodes take up an entire shelf position (two thin processor node slots). They are identified by the odd numbered position. 2. In a F/C 2030/1 frame, switch assemblies take up an entire shelf partition. (They are identified by the even-numbered position.) 3. Processor node slots are numbered up to N8. 4. The single-pha[...]

  • Page 62

    Note: See notes under Figure 2-1 on page 2-3 for processor node/switch assembly numbering. Frame locations Figure 2-1 on page 2-3 shows a front view of the RS/6000 SP frame locations, with numbered processor nodes, and the three phase SEPBU. Frame (FRA) This list shows the designations specifically for the RS/6000 SP frame: G1: Right-hand rear grou[...]

  • Page 63

    G6: Front door ground G7: Rear door ground G8: Ground SW: Power-on switch LD: LED card FC: Front cover RC: Rear cover Example: E01-FRA-G1 Chapter 2. Locations 2-7[...]

  • Page 64

    Switch assembly locations Fan 5 P6 P4 P5 Fan 4 Fan 3 Fan 2 Fan 1 CB & LED Card J1 J2 Switch Planar Power Supply 2 Supervisor Card Power Supply 1 Supervisor Bus Card A i r B a f f l e Figure 2-5. SPS/SPS-8 assembly 2-8 RS/6000 SP: SP Switch Service Guide[...]

  • Page 65

    Connector details Figure 2-6 shows RS/6000 SP component connector details. Cable routing Figure 2-7 on page 2-10 and Figure 2-8 on page 2-10 show back views of the RS/6000 SP frame, showing the horizontal and vertical paths of cable routing from connector-to-connector , with the depth amplified on the drawing. Figure 2-6. RS/6000 SP connector detai[...]

  • Page 66

    Note: When attaching exterior and interior cables to a POWER3 SMP High Node allow for enough cable for a 2-foot service loop for node movement into service position. Note: For a multi-switch frame (F/C 2030/1), refer to Figure 2-7. Figure 2-7. Frame cabling routing path in rear of RS/6000 SP frame — 1.93 m frame Figure 2-8. Frame cabling routing [...]

  • Page 67

    T able 2-1 shows external cable routing in a RS/6000 SP frame populated with 16 processor nodes. (Refer to “Cable routing” on page 2-9 to see the routing paths.) T able 2-1. External cable routing Slot Number (Node) Cable Budget millimeters (inches) Frame Entrance (New Style) Frame Entrance (Old Style) V ertical Routing (Old Style) Horizontal R[...]

  • Page 68

    Figure 2-9. Frame cable routing paths in rear of RS/6000 SP multi-switch frame (F/C 2030/1) — 1.93 m frame Figure 2-10. Frame cable routing paths in rear of RS/6000 SP multi-switch frame (F/C 2030/1) — 2.01 m frame 2-12 RS/6000 SP: SP Switch Service Guide[...]

  • Page 69

    Switch data cables SPS data cables T able 2-2 describes the attachment locations and routing for the internal SPS Switch data cables: T able 2-2. SPS Switch data cable chart Cable Part Number Plug from Location Plug to Location 46H9710 E00-S00-BH-J7 E00-N01-BH-P A 46H971 1 E00-S00-BH-J8 E00-N02-BH-P A 46H9712 E00-S00-BH-J26 E00-N03-BH-P A 46H9713 E[...]

  • Page 70

    2-14 RS/6000 SP: SP Switch Service Guide[...]

  • Page 71

    Chapter 3. Service procedures Personal ESD requirements ............................ 3 - 1 T ools and files overview .............................. 3 - 1 Using the css.snap script ............................. 3 - 3 Switch supervisor self-test ............................. 3 - 4 V erification tests using Perspectives ......................... 3 - 4[...]

  • Page 72

    T able 3-1. Service procedure tools Utility (see note) Runs on Description fault_service_Worm_RTG All nodes Monitors the switch for faults. It restarts the switch if a fault is detected. fs_monitor All nodes Monitors the adapter for interrupts that have not been serviced. This is required because of a hardware oversight in MSMU, in which there is a[...]

  • Page 73

    T able 3-3. T uning output files (continued) File (see note) Location Description daemon.stderr Primary A record of which nodes were not initialized. out.top Primary Reports errors from the last tuning procedure. It begins as a copy of the topology file and errors are indicated to the right of each entry . out.top.old Primary A copy of out.top from[...]

  • Page 74

    The files ending in .out are produced by running the appropriate command to dump internal (in memory) trace information or dump data to a file. The completed output file will be found in /var/adm/SPlogs/css/css.snap.[date-time]tar .Z . css.snap avoids flooding /var by following these rules: v If less than 10% of /var is free, css.snap exits. v If t[...]

  • Page 75

    2. In the Node pane, click the icon of the node you want to verify 3. Click the ″ Notebook ″ icon on the tool bar v When the Notebook window opens, make certain that the ″ Node Status ″ tab is selected 4. The ″ Node failure: ″ attribute displays the status of the node supervisor v ″ No ″ displayed in a green box indicates that the n[...]

  • Page 76

    v ″ Ye s ″ displayed in a red box indicates that the switch supervisor has failed and it is not responding to the frame supervisor . Note: Clicking ″ Help ″ in the Notebook window’s lower right corner displays attribute descriptions. Selecting appropriate switch clocks The following procedure describes how to select a clock source for a s[...]

  • Page 77

    1 Input 1 (BH-J3 for SPS) 2 Input 2 (BH-J4 for SPS) 3 Input 3 (BH-J5 for SPS) T able 3-4. Setting switch clock sources Model Number of Logical Frames Master Clock Choice 123 30x 1-4 L01-S00 = i L02-S00 = 1 L03-S00 = 1 L04-S00 = 1 L01-S00 = 1 L02-S00 = i L03-S00 = 2 L04-S00 = 2 L01-S00 = 2 L02-S00 = 2 L03-S00 = i L04-S00 = 3 30x 5 L01-S00 = i L02-S0[...]

  • Page 78

    6. The customer can re-initialize the switch using the Estart command. The frame and processor nodes which were removed in this procedure will appear in the out.top file with error messages; however , the remainder of the switch resources are now available for customer use. 7. If switch re-initialization was successful, the customer can start runni[...]

  • Page 79

    Efence of primary and primary backup nodes By design, Efence of primary and primary backup nodes is not allowed. If you attempt to fence either of these nodes, you will get the following responses: Efence: 0028-147 Node number designates the Primary Node. Efence: 0028-166 Node number designates the Primary Backup Node. Y ou should assign a new prim[...]

  • Page 80

    d. Choose “Normal Mode” e. Choose “Display Current Bootlist” This will display the current bootlist. 2. Power down the node, service it, and hook it back into the frame. 3. On the control workstation, run spbootins to set the node to boot in maintenance mode. For example, if it is node 12 of frame 2, enter: spbootins -r maintenance 2 12 1 4[...]

  • Page 81

    The following 3 adapters require functional microcode to be installed: Adapter Package ESCON ® Control Unit Adapters Feature 2756 ESCON BLKMUX S/370 ™ Control Unit Feature 2755 BLKMUX FDDI Adapters Features 2723, 2724, 2725, 2726 FDDI These adapters might need updating to the latest level in their FLASH EPROM: Adapter Package SSA Adapters Featur[...]

  • Page 82

    T o complete the microcode update, it is usually necessary to remove and then replace the device from the configuration. The most reliable method to do this is to reboot the node. Some adapters can actually require a power off cycle to complete the microcode update. Others can be updated simply by running cfgmgr . Note: During microcode download fo[...]

  • Page 83

    Chapter 4. FRU removals and replacements Handling static-sensitive devices .......................... 4 - 1 Procedures for switch assemblies .......................... 4 - 2 Removing the switch assembly .......................... 4 - 2 Replacing the switch assembly .......................... 4 - 2 Removing the switch fans ..........................[...]

  • Page 84

    Procedures for switch assemblies CAUTION: The unit weight exceeds 18 Kg (40 lbs) and requires two service personnel to lift. (SPSFC002) Attention: Components in the frame are susceptible to damage from static discharge. Always use an ESD wristband when working inside frame covers. (See “Personal ESD requirements” on page 3-1 for more details.) [...]

  • Page 85

    Removing the switch fans Note: Refer to “Handling static-sensitive devices” on page 4-1 before removing or installing ESD sensitive devices. Perform these procedures to remove a fan from an SP Switch assembly: 1. Perform “Placing a switch assembly into service position” on page 3-9 to place the switch assembly into the service position. 2. [...]

  • Page 86

    Perform these procedures to remove the fan control cable from an SP Switch assembly: 1. Perform “Placing a switch assembly into service position” on page 3-9 to place the switch assembly into the service position. 2. Unplug connectors P7, P8 and P9. Remove cable by unhooking retaining material along raceway , and unplugging the Fan connectors P[...]

  • Page 87

    Replacing the switch supervisor card Perform these procedures to replace the supervisor card in an SP Switch assembly: 1. Insert supervisor card. 2. Rotate card thumb locks inward to seat card. 3. Plug connector P5. 4. Perform “Replacing a switch assembly from service position” on page 3-9 to remove the switch assembly from the service position[...]

  • Page 88

    Replacing the switch inner chassis cable Perform these procedures to replace the supervisor power cable from an SP Switch assembly: 1. Plug connectors P3, P4, P5 and P6. Route cable along the raceway , hooking retaining material where needed. Attach P1 connector to the rear of the switch assembly with screws retained in the removal procedure. 2. Pe[...]

  • Page 89

    4. Remove power supply card. Replacing the switch power cards Perform these procedures to replace the switch power cards) in an SP Switch assembly: 1. Insert power supply card. 2. Rotate card thumb locks inward to seat card. 3. Plug connector P4 (PS1) or P6 (PS2). 4. Perform “Replacing a switch assembly from service position” on page 3-9 to rem[...]

  • Page 90

    4-8 RS/6000 SP: SP Switch Service Guide[...]

  • Page 91

    Chapter 5. Parts catalog SPS, SPS-8 Switch assembly (feature) (view 1) ..................... 5 - 2 SPS, SPS-8 Switch assembly (feature) (view 2) ..................... 5 - 4 SPS, SPS-8 Switch assembly (feature) (view 3) ..................... 5 - 6 Switch cables (feature) .............................. 5 - 8 Multi-switch frame (F/C 2030/1) ..........[...]

  • Page 92

    SPS, SPS-8 Switch assembly (feature) (view 1) 5-2 RS/6000 SP: SP Switch Service Guide[...]

  • Page 93

    T able 5-1. SPS, SPS-8 Switch assembly (feature) (view 1) Assembly index Part number Units Description SPS Switch assembly (reference only) SPS-8 Switch assembly (reference only) 1 26H7255 1 Front chassis assembly 2 77G0961 1 Card, power 3 46H9305 1 Card, switch supervisor 4 26H7212 2 Screw , hex Hd M4 x 6 5 26H7395 1 Fan assembly 6 84X4841 2 Nut, [...]

  • Page 94

    SPS, SPS-8 Switch assembly (feature) (view 2) 5-4 RS/6000 SP: SP Switch Service Guide[...]

  • Page 95

    T able 5-2. SPS, SPS-8 Switch assembly (feature) (view 2) Assembly index Part number Units Description SPS Switch assembly (reference only) SPS-8 Switch assembly (reference only) 1 1 1P0655 1 Inner chassis assembly SPS (includes all assembly in shaded area) 1 1 1P0656 1 Inner chassis assembly SPS-8 (includes all assembly in shaded area) 2 1624766 1[...]

  • Page 96

    SPS, SPS-8 Switch assembly (feature) (view 3) 8 7 6 5 4 3 2 1 Air flow 5-6 RS/6000 SP: SP Switch Service Guide[...]

  • Page 97

    T able 5-3. SPS, SPS-8 Switch assembly (feature) (view 3) Assembly index Part number Units Description SPS switch assembly (reference only) SPS-8 switch assembly (reference only) 1 26H7391 1 Cable, front chassis 2 32G1547 1 Screw , hex M4 x 5 3 46H9778 2 Cup guide (2.01 m, order kit) 3 77G1079 2 Pin guide (2.01 m, order kit) 3 46H9778 2 Cup guide ([...]

  • Page 98

    Switch cables (feature) T able 5-4. Switch cables (feature) Assembly index Part number Units Description SP Switch data cables (SPS) 1 1J6091 AR Cable, Switch data node 01 - (1345 mm) 1 1J6092 AR Cable, Switch data node 02 - ( 1040 mm) 1 1J6093 AR Cable, Switch data node 03 - ( 1320 mm) 1 1J6094 AR Cable, Switch data node 04 - (1400 mm) 1 1J6095 AR[...]

  • Page 99

    Chapter 5. Parts catalog 5-9[...]

  • Page 100

    Multi-switch frame (F/C 2030/1) 5-10 RS/6000 SP: SP Switch Service Guide[...]

  • Page 101

    T able 5-5. Multi-switch frame (F/C 2030/1) Assembly index Part number Units Description 1 SPS Switch Assembly 2 54G3281 16 Screw , Phil Pan Hd M5 x 12 3 93G1065 AR Shelf Assembly 4 0375867 8 Nut, Clip 5 84X4761 8 Screw , Hex Fl Hd Supradrive 6 17H5026 8 Screw , Sl Hex Fl Hd M5 x 6 7 54G2877 4 Panel, Switch Blank 8 54G2947 4 Panel, Blank 7-inch 9 1[...]

  • Page 102

    5-12 RS/6000 SP: SP Switch Service Guide[...]

  • Page 103

    Notices This information was developed for products and services offered in the U.S.A. IBM may not offer the products, services, or features discussed in this document in other countries. Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or [...]

  • Page 104

    Electronic emissions notices Federal Communications Commission (FCC) statement This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial e[...]

  • Page 105

    For installations in Japan: The following is a summary of the VCCI Japanese statement in the box above. This is a Class A product based on the standard of the V oluntary Control Council for Interference by Information T echnology Equipment (VCCI). If this equipment is used in a domestic environment, radio disturbance may arise. When such trouble oc[...]

  • Page 106

    A-4 RS/6000 SP: SP Switch Service Guide[...]

  • Page 107

    Index Numerics 0375867 5-1 1 04H9469 5-1 1 08J5557 5-1 1 1 1J3975 5-8 1 1J3976 5-8 1 1J3977 5-8 1 1J3978 5-8 1 1J3979 5-8 1 1J3980 5-8 1 1J3981 5-8 1 1J3982 5-8 1 1J5189 5-1 1 1 1J5191 5-1 1 1 1J5193 5-1 1 1 1J5195 5-1 1 1 1J6091 5-8 1 1J6092 5-8 1 1J6093 5-8 1 1J6094 5-8 1 1J6095 5-8 1 1J6096 5-8 1 1J6097 5-8 1 1J6098 5-8 1 1J6099 5-8 1 1J6100 5-8[...]

  • Page 108

    frame locations 2-3, 2-5, 2-6 frame naming standard 2-1 frame supervisor verification 3-5 front chassis cable, SPS 1-8 front view of 49-inch frame locations 2-4 front view of frame locations 2-3 front view of multi-switch frame locations 2-4 H handling static-sensitive devices 4-1 I installing adapter microcode packages 3-10 installing firmware upd[...]

  • Page 109

    SPS assembly , placing into service position 3-9 SPS assembly , removing 4-2 SPS assembly , replacing 4-2 SPS assembly , replacing from service position 3-9 SPS fan control cable, removing 4-3 SPS fan control cable, replacing 4-4 SPS fans, removing 4-3 SPS fans, replacing 4-3 SPS front chassis cable 1-8 SPS partitioning 3-8 SPS power card, removing[...]

  • Page 110

    X-4 RS/6000 SP: SP Switch Service Guide[...]

  • Page 111

    Reader’s comments – W e’d like to hear from you RS/6000 SP SP Switch Service Guide Publication No. GA22-7443-04 Overall, how satisfied are you with the information in this book? V ery Satisfied Satisfied Neutral Dissatisfied V ery Dissatisfied Overall satisfaction hhhhh How satisfied are you that the information in this book is: V ery Satisfi[...]

  • Page 112

    Readers’ Comments — We’d Like to Hear from Y ou GA22-7443-04 GA22-7443-04 IBM Cut or Fold Along Line Cut or Fold Along Line Fold and T ape Please do not staple Fold and T ape Fold and T ape Please do not staple Fold and T ape PLACE POST AGE ST AMP HERE IBM Corporation Department 55JA, Mail Station P384 2455 South Road Poughkeepsie NY 12601-54[...]

  • Page 113

    [...]

  • Page 114

    IBM GA22-7443-04[...]