Sun Microsystems 820-4733-10 manual

Submit comments about this document at: http://www.sun.com/hwdocs/feedback Sun ™ Datacenter Switch 3456 Ser vice Manual P ar t No . 820-4733-10 August 2008, Re vision A Sun Microsystems, Inc. www .sun.com[...]

Please Recycle Copyright 2008 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, U.S.A. All rights reserved. Sun Microsystems, Inc. has intellectual pr operty rights relating to technology embodied in the product that is described in this document. In particular , and without limitation, these intellectual property rights m[...]

iii Contents Preface vii 1. Sun Datacenter Switch 3456 Overview 1–1 1.1 Switch Chassis 1–1 1.2 Power Supplies 1–2 1.3 Fan Units 1–3 1.4 Chassis Management Controllers 1–4 1.5 Fabric Cards 1–5 1.6 Line Cards 1–6 2. Chassis Service Procedures 2–1 2.1 Filler Panels 2–1 ▼ Removing the Filler Panel 1 ▼ Installing the Filler Panel 3[...]

iv Sun Datacenter Switch 3456 Service Manual • August 2008 ▼ Inserting Pins 15 2.3 Cable Management Hardwar e 2–16 ▼ Removing Cable Plates 16 ▼ Installing Cable Plates 16 ▼ Removing Cable T r ees 17 ▼ Installing Cable T r ees 18 ▼ Removing Cable T rays 20 ▼ Installing Cable T rays 20 2.4 InfiniBand Cables 2–21 2.4.1 Cable Cautio[...]

Contents v 5.1 T r oubleshooting CMCs 5–2 5.2 Powering Off CMCs 5–2 5.3 Removing CMCs 5–3 ▼ Removing a CMC 3 5.4 Installing CMCs 5–4 ▼ Installing a CMC 4 5.5 Powering On CMCs 5–6 6. Fabric Card Service Procedures 6–1 6.1 Fabric Card Considerations 6–1 6.2 T r oubleshooting Fabric Cards 6–2 6.3 Inspecting Fabric Cards 6–3 ▼ I[...]

vi Sun Datacenter Switch 3456 Service Manual • August 2008 7.4 Powering Off Line Car ds 7–6 7.5 Removing Line Cards 7–7 ▼ Removing a Line Card 7 7.6 Installing Line Cards 7–12 ▼ Installing a Line Card 12 7.7 Powering On Line Cards 7–15 Index Index–1[...]

vii Pr eface This service manual provides service pr ocedures for the Sun Datacenter Switch 3456. This document is written for service personnel and users who have advanced knowledge and experience managing an InfiniBand network. Using UNIX Commands This document might not contain information about basic UNIX ® commands and procedur es such as shu[...]

viii Sun Datacenter Switch 3456 Service Manual • August 2008 Shell Pr ompts T ypographic Conventions Related Documentation The documents listed as online are available at: Shell Prompt C shell machine-name % C shell superuser machine-name # Bourne shell and Korn shell $ Bourne shell and Korn shell superuser # T ypeface * * The settings on your br[...]

Preface ix http://docs.sun.com/app/docs/prod/switch.3456 Documentation, Support, and T raining Sun W elcomes Y our Comments Sun is interested in impr oving its documentation and welcomes your comments and suggestions. Y ou can submit your comments by going to: http://www.sun.com/hwdocs/feedback Please include the title and part number of your docum[...]

x Sun Datacenter Switch 3456 Service Manual • August 2008 Sun Datacenter Switch 3456 Service Manual , part number 820-4733-10.[...]

1-1 CHAPTER 1 Sun Datacenter Switch 3456 Overview This chapter provides a visual overview of the Sun Datacenter Switch 3456. T opics include: ■ Section 1.1 “Switch Chassis” on page 1-1 ■ Section 1.2 “Power Supplies” on page 1-2 ■ Section 1.3 “Fan Units” on page 1-3 ■ Section 1.4 “Chassis Management Controllers” on page 1-4 ?[...]

1-2 Sun Datacenter Switch 3456 Service Manual • August 2008 FIGURE 1-1 Parts of the Switch Chassis 1.2 Power Supplies FIGURE 1-2 describes the various parts of the power supplies. Figure Legend 1 F abr ic cards (18) 6 Line cards (24) 2 P ower supplies (16) 7 Cable tra ys (24) 3 Cable plates (left) 8 Cable tree (left) 4 Cable plates (right) 9 Chas[...]

Chapter 1 Sun Datacenter Switch 3456 Overview 1-3 FIGURE 1-2 Parts of the Power Supplies 1.3 Fan Units FIGURE 1-3 describes the various parts of the fan units. Figure Legend 1 P ower Distribution Board connector 2 P ower cord connector 3 Status LEDs 4 Fa n 5 Release lev er 1 5 4 3 2[...]

1-4 Sun Datacenter Switch 3456 Service Manual • August 2008 FIGURE 1-3 Parts of the Fan Units 1.4 Chassis Management Contr ollers FIGURE 1-4 describes the various parts of the chassis management controllers (CMCs). Figure Legend 1 F abr ic card connector 2 Thumbscrews 3 Status LED 1 3 2[...]

Chapter 1 Sun Datacenter Switch 3456 Overview 1-5 FIGURE 1-4 Parts of the CMCs T ABLE 1-1 lists the IPMB addresses for the CMCs. 1.5 Fabric Car ds FIGURE 1-5 describes the various parts of the fabric cards. Figure Legend 1 Release lev ers 2 Network management por ts 3 Serial management por ts 4 Status LEDs T ABLE 1-1 IPMB Addr esses for the CMCs Co[...]

1-6 Sun Datacenter Switch 3456 Service Manual • August 2008 FIGURE 1-5 Parts of the Fabric Cards T ABLE 1-2 lists the IPMB addresses for the fabric car ds. 1.6 Line Car ds FIGURE 1-6 describes the various parts of the line cards. Figure Legend 1 iTRAC connectors 2 Retainers 3 F ans 4 Status LEDs T ABLE 1-2 IPMB Addr esses for Fabric Cards Fabric [...]

Chapter 1 Sun Datacenter Switch 3456 Overview 1-7 FIGURE 1-6 Parts of the Line Cards T ABLE 1-3 lists the IPMB addresses for the line car ds. Figure Legend 1 Status LEDs 2 Link LEDs 3 iTRAC connectors 4 iP ASS connectors 5 Retainers T ABLE 1-3 IPMB Addresses for Line Cards Line card Address Line car d Address Line car d Address Line card Address LC[...]

1-8 Sun Datacenter Switch 3456 Service Manual • August 2008[...]

2-1 CHAPTER 2 Chassis Service Pr ocedures This chapter describes procedures performed on the Sun Datacenter Switch 3456 chassis. T opic include: ■ Section 2.1 “Filler Panels” on page 2-1 ■ Section 2.2 “Midplane Connector Pins” on page 2-6 ■ Section 2.3 “Cable Management Hardwar e” on page 2-16 2.1 Filler Panels ▼ Removing the Fi[...]

2-2 Sun Datacenter Switch 3456 Service Manual • August 2008 FIGURE 2-1 T urning Filler Panel Lock Levers 2. T urn the levers counter-clockwise to the unlock position. See FIGURE 2-1 . 3. Lift the f iller panel away from the chassis by the handles. See FIGURE 2-2 .[...]

Chapter 2 Chassis Service Procedures 2-3 FIGURE 2-2 Removing the Filler Panel 4. Repeat from Step 1 for all remaining f iller panels. ▼ Installing the Filler Panel After you remove fabric car ds and line cards, you must install filler panels into the vacant slots to maintain proper airflow and thermal management. 1. Grasp the handles at each end [...]

2-4 Sun Datacenter Switch 3456 Service Manual • August 2008 FIGURE 2-3 T urning Filler Panel Lock Levers Counter-Clockwise 3. Slide the f iller panel into the chassis until it stops. See FIGURE 2-4 . FIGURE 2-4 Installing the Filler Panel[...]

Chapter 2 Chassis Service Procedures 2-5 4. T urn the levers clockwise to the lock position. See FIGURE 2-5 . FIGURE 2-5 T urning Filler Panel Lock Levers Clockwise 5. Repeat from Step 1 for any remaining vacant slots. 2.2 Midplane Connector Pins Caution – All midplane connector pin operations require the Sun Datacenter Switch 3456 to be fully po[...]

2-6 Sun Datacenter Switch 3456 Service Manual • August 2008 T o repair or replace a pin, you need the following tools: ■ Molex pin replacement tool ■ Replacement pins (extracted from a spare iTRAC connector) ■ Head-mounted magnifier ■ Flashlight Note – Another person to assist you can make the task much easier . ▼ Inspecting the Pins [...]

Chapter 2 Chassis Service Procedures 2-7 FIGURE 2-6 Fabric Card Connector Nomenclatur e The connector number is located above each connector and is unique. For example, the upper-left connector number is FC-R23-F0. The lower-right connector number is FC-R0-F17. The connector number is decoded as follows: ■ FC – Fabric card ■ R a – Row a , w[...]

2-8 Sun Datacenter Switch 3456 Service Manual • August 2008 5. Using the magnifying glass and the f lashlight positioned above you, look at the individual pins of the connector . Look at the pins straight on. See FIGURE 2-7 . FIGURE 2-7 Inspecting the Pins (Fabric Card) 6. Look for any light ref lection inconsistencies. A bent pin ref lects light[...]

Chapter 2 Chassis Service Procedures 2-9 ▼ Inspecting the Pins on the Fr ont Side of the Midplane Note – This procedur e assumes that a line card has been r emoved from the chassis. The primary tool used to check the midplane pins is the pin gauge block. This tool effortlessly slides over the straight pins of an iTRAC connector that is in good [...]

2-10 Sun Datacenter Switch 3456 Service Manual • August 2008 FIGURE 2-8 Line Card Connector Nomenclatur e The connector number is located above each connector and is unique. For example, the lower-left connector number is LC-C17-L0. The upper-right connector number is LC-C0-L23. The connector number is decoded as follows: ■ LC – Line card ■[...]

Chapter 2 Chassis Service Procedures 2-11 5. Using the magnifying glass and the f lashlight positioned to the side of you, look at the individual pins of the connector . Look at the pins as straight on. See FIGURE 2-9 . FIGURE 2-9 Inspecting the Pins (Line Card) 6. Look for any light ref lection inconsistencies. A bent pin ref lects light different[...]

2-12 Sun Datacenter Switch 3456 Service Manual • August 2008 ▼ Removing Pins Before you can attempt to straighten a bent pin, you must remove the pins surrounding the bent pin. See FIGURE 2-10 . 1. Locate the bent pin. See FIGURE 2-10 . FIGURE 2-10 Locating the Bent Pin and Surrounding Pins 2. Use the Molex tool to remove the pin (if any) above[...]

Chapter 2 Chassis Service Procedures 2-13 6. Repeat Step 2 to remove the pins to the left and right sides of the bent pin (if any). 7. Set these pins aside. The bent pin is now exposed. 8. Flip the Molex tool over and use the tube in attempt to straighten the pin. If the pin cannot be straightened satisfactorily , or might break if straightened, re[...]

2-14 Sun Datacenter Switch 3456 Service Manual • August 2008 FIGURE 2-11 Using Pliers to Pull a Pin 4. In one motion, use both hands to pull the pin out of the connector . 5. Dispose of the pin. ▼ Inserting Pins When inserting pins, work from the top down. Repeat Step 1 thr ough Step 5 for each pin that needs to be inserted. 1. Ready the Molex [...]

Chapter 2 Chassis Service Procedures 2-15 4. Slowly press the ejector in until it stops. The pin is inserted. 5. Carefully deactivate the lock and withdraw the Molex tool from the connector . 2.3 Cable Management Har dware ▼ Removing Cable Plates 1. Remove the cables from the cable plates. See “Removing Cables From the Sun Datacenter Switch 345[...]

2-16 Sun Datacenter Switch 3456 Service Manual • August 2008 FIGURE 2-12 Cable Plate Locations Note – The support rib for the plate is on the underside and visible from the front of the switch chassis. From the back of the switch, the plates appear smooth. b. T ighten the screws securely . c. Repeat from Step a for the next higher cable plate a[...]

Chapter 2 Chassis Service Procedures 2-17 2. Start on the front right corner of the Sun Datacenter Switch 3456 chassis. a. Remove all screws from the front of the cable tree. b. Remove all but the upper two screws from the right side of the cable tree. c. While a helper lifts the weight of the cable tree, remove the two remaining screws from the ri[...]

2-18 Sun Datacenter Switch 3456 Service Manual • August 2008 FIGURE 2-13 Cable T ree Placement 2. Set the cable trees upright at their respective corners of the switch chassis. 3. Starting on the front right corner of the chassis, lift the cable tree into position. Have a helper assist in aligning the cable tree mounting scr ew holes with those i[...]

Chapter 2 Chassis Service Procedures 2-19 ▼ Removing Cable T rays 1. Remove the cables from the line card where the cable tray is to be removed. See “Removing Cables From the Sun Datacenter Switch 3456” on page 2-22 . 2. Lift on the front of the cable tray and begin to pull out. Note – Once the tray is free of the guides at the back end, it[...]

2-20 Sun Datacenter Switch 3456 Service Manual • August 2008 FIGURE 2-14 Installing Cable T rays Note – Install cable trays only as they are needed. If all cable trays ar e installed before the switch is cabled, their pr esence make cabling extremely diff icult. 2.4 Inf iniBand Cables 2.4.1 Cable Cautions Caution – Do not allow any IB cable t[...]

Chapter 2 Chassis Service Procedures 2-21 Caution – Do not allow any IB cable to experience extreme tension. Do not pull on an IB cable or allow it to drag. Unroll an IB cable for its length. Pulling on an IB cable can break the cables internally . Caution – Do not twist an IB cable more than 1 revolution for its entir e length. T wisting an IB[...]

2-22 Sun Datacenter Switch 3456 Service Manual • August 2008 a. Unthread the cable out of the side branch of the cable tree, and off of the cable plate. b. Gently lower the cable to the f loor . ■ If you are disconnecting cables for a line card r eplacement: c. Gently lower the cable so that is it hanging from the side branch. Caution – Do no[...]

Chapter 2 Chassis Service Procedures 2-23 FIGURE 2-15 Threading the Cable Thr ough the Cable T ree Caution – Do not force a bend radius of less than 5 inches (127 mm). Any bend tighter than this damages the inner fibers of the cable, r endering it useless. 4. Plug the f irst cable into the connector at 23A. See FIGURE 2-16 .[...]

2-24 Sun Datacenter Switch 3456 Service Manual • August 2008 FIGURE 2-16 Plugging in an IB Cable a. V isually inspect the cable connector to see whether the shell is not bent and is parallel to the inner boards. If the shell is bent or damaged, get a differ ent cable. b. Ensure that the retraction strap is forward. c. Orient the cable connector t[...]

Chapter 2 Chassis Service Procedures 2-25 ■ If the connector stops or binds with about 2 mm still to go, back out and repeat fr om Step c . e. Continue to push the connector in until the hooks catch onto the top of the connector on the line card. 5. Repeat from Step 2 for the second cable connecting to connector 23B. 6. Repeat from Step 2 moving [...]

2-26 Sun Datacenter Switch 3456 Service Manual • August 2008[...]

3-1 CHAPTER 3 Power Supply Service Pr ocedures This chapter describes procedures for servicing the switch power supplies. T opics include: ■ Section 3.1 “T roubleshooting Power Supplies” on page 3-2 ■ Section 3.2 “Powering Off Power Supplies” on page 3-2 ■ Section 3.3 “Removing Power Supplies” on page 3-3 ■ Section 3.4 “Instal[...]

3-2 Sun Datacenter Switch 3456 Service Manual • August 2008 3.1 T r oubleshooting Power Supplies The status LEDs on the power supplies can help you determine the problem with the power supplies. See T ABLE 3-1 . Additionally , the showpresent and psustatus commands can provide some information. 3.2 Powering Of f Power Supplies Power supplies can [...]

Chapter 3 P ower Supply Service Procedures 3-3 3.3 Removing Power Supplies ▼ Removing a Power Supply 1. Determine which power supply is to be removed. 2. Use the disablepsu command to bring the power supply to a standby state. 3. At the power supply , remove the power cord. See FIGURE 3-2 . FIGURE 3-1 Removing the Power Cord The power supply is c[...]

3-4 Sun Datacenter Switch 3456 Service Manual • August 2008 FIGURE 3-2 Releasing the Power Supply 5. Pull the handle of the power supply to remove it from the chassis. See FIGURE 3-3 . FIGURE 3-3 Removing the Power Supply 6. Set the power supply aside.[...]

Chapter 3 P ower Supply Service Procedures 3-5 3.4 Installing Power Supplies ▼ Installing a Power Supply 1. Unwrap the replacement power supply from its antistatic packaging. 2. Swing open the release lever . 3. Orient the power supply with the handle on the left and the receptacle on the right. 4. Slide the power supply into the open slot, pushi[...]

3-6 Sun Datacenter Switch 3456 Service Manual • August 2008 FIGURE 3-5 Securing the Power Supply 6. Reconnect the power cord. See FIGURE 3-2 .[...]

Chapter 3 P ower Supply Service Procedures 3-7 FIGURE 3-6 Attaching the Power Cord The Connected LED lights to indicate the power supply is connected to facility power . 7. Use the enablepsu command to bring the power supply to a fully powered state. 8. V erify the power supply’ s operation with the showpresent and psustatus commands. 3.5 Powerin[...]

3-8 Sun Datacenter Switch 3456 Service Manual • August 2008 Use the enablepsu command to bring the power supply from a standby state to full power . For example, to bring power supply 0 (PSU0) to full power: # enablepsu 0 Using psu i2c addr 0x5d Turning on 12V ... PSU 0, 12 V on #[...]

4-1 CHAPTER 4 Fan Service Pr ocedures This chapter describes procedur es for servicing the fans on the fabric cards. T opics include: ■ Section 4.1 “T roubleshooting Fans” on page 4-1 ■ Section 4.2 “Removing Fans” on page 4-1 ■ Section 4.3 “Installing Fans” on page 4-2 Commands described in this chapter are executed at the managem[...]

4-2 Sun Datacenter Switch 3456 Service Manual • August 2008 1. Determine which fan is to be removed. If a fan has failed, its LED flashes. 2. Loosen the two captive thumbscrews on either side of the fan. See FIGURE 4-1 . FIGURE 4-1 Removing the Fan 3. Pull the fan straight out. See FIGURE 4-1 . 4. Set the fan aside. 4.3 Installing Fans Note – F[...]

Chapter 4 F an Ser vice Procedures 4-3 ▼ Installing a Fan 1. Unwrap the replacement fan from its antistatic packaging. 2. Orient the fan over the opening in the fabric card with the LED at the bottom. 3. Slide the fan into the fabric card until the fan stops. See FIGURE 4-2 . FIGURE 4-2 Installing the Fan The fan might immediately power on. 4. T [...]

4-4 Sun Datacenter Switch 3456 Service Manual • August 2008[...]

5-1 CHAPTER 5 Chassis Management Contr oller Service Pr ocedures This chapter describes procedur es for servicing the CMCs. T opics include: ■ Section 5.1 “T roubleshooting CMCs” on page 5-2 ■ Section 5.2 “Powering Off CMCs” on page 5-2 ■ Section 5.3 “Removing CMCs” on page 5-3 ■ Section 5.4 “Installing CMCs” on page 5-4 ■[...]

5-2 Sun Datacenter Switch 3456 Service Manual • August 2008 5.1 T r oubleshooting CMCs The chassis management controllers (CMCs) have several status LEDs that can provide some tr oubleshooting assistance. See T ABLE 5-1 . Additionally , the following commands can help troubleshooting CMCs: ■ i2ctest ■ clia shmstatus ■ clia sensordata ■ cl[...]

Chapter 5 Chassis Management Controller Service Procedures 5-3 For example, to deactivate CMC0 (10h): Instead of deactivating a CMC, you can use the clia switchover command. The clia switchover command transfers control of the Sun Datacenter Switch 3456 from one CMC to the other . For example: Note – Y ou can use the clia switchover command on ei[...]

5-4 Sun Datacenter Switch 3456 Service Manual • August 2008 FIGURE 5-1 Removing the CMC 5. Slowly pull the CMC from the chassis. See FIGURE 5-1 . 6. Set the CMC aside. 5.4 Installing CMCs ▼ Installing a CMC 1. Remove the replacement CMC from its antistatic packaging. 2. Squeeze the latches on the release levers and swing the levers outward. 3. [...]

Chapter 5 Chassis Management Controller Service Procedures 5-5 4. Carefully slide the CMC into the chassis until the release levers move. See FIGURE 5-2 . FIGURE 5-2 Installing and Securing the CMC 5. Swing the release levers inward to secure the CMC into the chassis. See FIGURE 5-2 . 6. Reconnect the cables you removed previously to the front pane[...]

5-6 Sun Datacenter Switch 3456 Service Manual • August 2008 5.5 Powering On CMCs When a CMC is plugged into a powered chassis, the CMC is powered on by the presence of standby voltage. Although the CMC is on, it might be inactive. A CMC can be made active, using the clia switchover command. For example: # clia switchover This Shelf Manager is now[...]

6-1 CHAPTER 6 Fabric Car d Service Procedur es This chapter describes procedures for servicing the fabric car ds. T opics include: ■ Section 6.1 “Fabric Card Considerations” on page 6-1 ■ Section 6.2 “T roubleshooting Fabric Cards” on page 6-2 ■ Section 6.3 “Inspecting Fabric Cards” on page 6-3 ■ Section 6.4 “Powering Off Fabr[...]

6-2 Sun Datacenter Switch 3456 Service Manual • August 2008 6.2 T r oubleshooting Fabric Cards The status LEDs on the fabric cards can help you determine the problem with the fabric cards. See T ABLE 6-1 . Additionally , the following commands can provide basic status information: ■ showpresent ■ checkpwrfault ■ checkvoltages ■ checkswitc[...]

Chapter 6 F abr ic Card Service Procedures 6-3 6.3 Inspecting Fabric Car ds Caution – Inspect the replacement fabric car d before r emoving the defective fabric card fr om the chassis. This way , you can make a quick exchange and not compromise the thermal management of the switch. ▼ Inspecting the Fabric Car d iTRAC Connectors The iTRAC connec[...]

6-4 Sun Datacenter Switch 3456 Service Manual • August 2008 FIGURE 6-1 Inspecting Fabric Card Connectors Note – Do not look at the individual holes, rather look at all of the connector ’s holes as a group. A damaged or contaminated hole will be apparent. 4. Look for any closed over or contaminated holes. A closed-over or contaminated hole app[...]

Chapter 6 F abr ic Card Service Procedures 6-5 6. Move your head slightly right to the next connector , and inspect its pins, repeating Step 4 and Step 5 . 7. Continue in this manner for each connector until you reach the right side of the fabric card. ▼ Inspecting the Fans The fans of the fabric card ar e FRU components. The fans secure in posit[...]

6-6 Sun Datacenter Switch 3456 Service Manual • August 2008 FIGURE 6-2 Retainer Design 6.4 Powering Of f Fabric Cards Powering off a fabric car d is a two-stage process. First you must take the fabric card to a standby state, then you can power off the fabric card completely . The deactivate command powers down the fabric card to a standby state.[...]

Chapter 6 F abr ic Card Service Procedures 6-7 The disableboard command completely powers down (disable) a fabric card so that it can be removed fr om the chassis. For example, to disable fabric card 14: 6.5 Removing Fabric Car ds This procedur e describes how to remove one fabric card as part of a r eplacement operation. ▼ Removing a Fabric Car [...]

6-8 Sun Datacenter Switch 3456 Service Manual • August 2008 7. Rotate both retainer levers to the unlock position. 8. Grasp the handles at both ends of the fabric card and slowly pull it from the chassis. Stop when the fabric card is halfway out. 9. Improve your grip to support the weight of the fabric card. 10. Continue to pull the fabric card o[...]

Chapter 6 F abr ic Card Service Procedures 6-9 2. Unwrap the fabric card from its antistatic packaging. 3. Inspect the connectors, fans, and retainers. See: ■ “Inspecting the Fabric Card iTRAC Connectors” on page 6-3 ■ “Inspecting the Fans” on page 6-5 ■ “Inspecting the Retainers” on page 6-5 4. Place a fabric card on a work surfa[...]

6-10 Sun Datacenter Switch 3456 Service Manual • August 2008 14. Slowly rotate each retainer drive screw clockwise, until resistance is felt, then stop. 15. Simultaneously rotate the retainer drive screws clockwise, stopping at each half turn, to maintain synchronization. During this time, the retainer levers might have moved fr om the locked pos[...]

Chapter 6 F abr ic Card Service Procedures 6-11 ■ checkvoltages ■ checkswitches ■ showtemps More complex and verbose commands are available for verif ication. See the Sun Datacenter Switch 3456 Administration Guide and Sun Datacenter Switch 3456 Reference Manual for further information.[...]

6-12 Sun Datacenter Switch 3456 Service Manual • August 2008[...]

7-1 CHAPTER 7 Line Car d Service Procedur es This chapter describes procedur es for servicing the line cards. T opics include: ■ Section 7.1 “Line Card Considerations” on page 7-1 ■ Section 7.2 “T roubleshooting Line Car ds” on page 7-2 ■ Section 7.3 “Inspecting Line Cards” on page 7-3 ■ Section 7.4 “Powering Off Line Cards”[...]

7-2 Sun Datacenter Switch 3456 Service Manual • August 2008 Y ou must inspect the front and back line car d connectors, and retainers befor e installing the line card into the switch chassis. 7.2 T r oubleshooting Line Cards The status LEDs on the line cards can help you determine the pr oblems with the line cards. See T ABLE 7-1 . Additionally ,[...]

Chapter 7 Line Card Service Procedures 7-3 7.3 Inspecting Line Car ds Caution – Inspect the replacement line card befor e removing the defective line card from the chassis. This way , you can make a quick exchange and not compromise the thermal management of the switch. ▼ Inspecting the Line Car d iTRAC Connectors The large iTRAC connectors on [...]

7-4 Sun Datacenter Switch 3456 Service Manual • August 2008 FIGURE 7-1 Inspecting Line Card Connectors Note – Do not look at the individual holes, rather look at all of the connector ’s holes as a group. A damaged or contaminated hole will be apparent. 4. Look for any closed over or contaminated holes. A closed-over or contaminated hole appea[...]

Chapter 7 Line Card Service Procedures 7-5 6. Move your head slightly right to the next connector , and inspect its pins, repeating Step 4 and Step 5 . 7. Continue in this manner for each connector until you reach the right side of the line card. ▼ Inspecting the Line Car d iP ASS Connectors The small iP ASS connectors on the line card ar e for t[...]

7-6 Sun Datacenter Switch 3456 Service Manual • August 2008 FIGURE 7-2 Retainer Design 7.4 Powering Of f Line Cards Powering off a line car d is a two-stage process. First you must take the line card to a standby state, then you can power off the line car d completely . The deactivate command powers down the line card to a standby state. For exam[...]

Chapter 7 Line Card Service Procedures 7-7 7.5 Removing Line Car ds This procedur e describes how to remove one line car d as part of a replacement operation. ▼ Removing a Line Car d Caution – Before beginning this procedur e, have a line card filler panel or replacement line car d prepar ed and standing by for immediate installation. A quick e[...]

7-8 Sun Datacenter Switch 3456 Service Manual • August 2008 FIGURE 7-3 Unlocking Retainer Levers 9. Grasp the handles at both ends of the line card and slowly pull it from the chassis. Stop when the line card is halfway out. See FIGURE 7-4 . FIGURE 7-4 Pulling Line Card Out[...]

Chapter 7 Line Card Service Procedures 7-9 10. Improve your grip to support the weight of the line card. 1 1. Continue to pull the line card out. 12. Lift the line card out and away from the chassis. 13. Set the line card onto a f lat horizontal work surface. 14. Immediately install replacement line card or f iller panel into the vacant slot. Conti[...]

7-10 Sun Datacenter Switch 3456 Service Manual • August 2008 FIGURE 7-6 Installing the Filler Panel d. T urn the levers clockwise to the lock position. See FIGURE 7-7 . FIGURE 7-7 T urning Filler Panel Lock Levers Clockwise 15. Retract and secure the antitilt bar .[...]

Chapter 7 Line Card Service Procedures 7-11 7.6 Installing Line Car ds This procedur e describes how to install one line card as part of a replacement operation. If you are installing more than one line car d, repeat the procedure for each line card. Alternatively , refer to the Sun Datacenter Switch 3456 Installation Guide . ▼ Installing a Line [...]

7-12 Sun Datacenter Switch 3456 Service Manual • August 2008 FIGURE 7-8 T urning Filler Panel Lock Levers b. T urn the levers counter-clockwise to the unlocked position. See FIGURE 7-8 . c. Lift the f iller panel away from the chassis by the handles. See FIGURE 7-9 .[...]

Chapter 7 Line Card Service Procedures 7-13 FIGURE 7-9 Removing the Filler Panel d. Set the f iller panel aside. 8. Lift the line card from the work surface and orient it horizontally , with the link LEDs across the bottom. 9. Insert the line card into the chassis at the vacant slot. Ensure that the line car d is square to the chassis and not skewe[...]

7-14 Sun Datacenter Switch 3456 Service Manual • August 2008 15. Simultaneously rotate the retainer drive screws clockwise, stopping at each half turn, to maintain synchronization. During this time, the retainer levers might have moved fr om the locked position. Move the levers back to the locked position and continue. 16. Continue synchronized r[...]

Chapter 7 Line Card Service Procedures 7-15 ■ checkvoltages ■ checkswitches ■ showtemps More complex and verbose commands are available for verif ication. See the Sun Datacenter Switch 3456 Administration Guide and Sun Datacenter Switch 3456 Reference Manual for further information.[...]

7-16 Sun Datacenter Switch 3456 Service Manual • August 2008[...]

Index-1 Index A activate command , 6-10, 7-15 attaching cables, 2-23 C cable plates installing, 2-16 removing, 2-16 trays installing, 2-20 removing, 2-20 trees installing, 2-18 removing, 2-17 cables attaching, 2-23 cautions, 2-21 removing, 2-22 cautions, 2-21 chassis parts front, 1-1 CMCs connectors, 1-4 installing, 5-4 IPMB addresses, 1-5 LEDs loc[...]

Index-2 Sun Datacenter Switch 3456 Service Manual • August 2008 F fabric cards connectors, 1-5 inspecting, 6-3 fans, 6-5 iTRAC connectors, 6-3 retainers, 6-5 inspection tools, 6-3 installing, 6-8 IPMB addresses, 1-6 LEDs location, 1-5 status, 6-2 midplane connector nomenclature, 2-8 parts, 1-5 powering off, 6-6 on, 6-10 removing, 6-7 troubleshoot[...]

Index-3 midplane connector nomenclature, 2-1 1 parts, 1-6 powering off, 7-6 on, 7-15 removing, 7-7 troubleshooting, 7-2 M midplane connector nomenclature fabric cards, 2-8 line cards, 2-1 1 P parts chassis front, 1-1 CMCs, 1-4 fabric cards, 1-5 fans, 1-3 line cards, 1-6 power supplies, 1-2 pins gauge block, 2-7 inserting, 2-15 inspecting front, 2-1[...]

Index-4 Sun Datacenter Switch 3456 Service Manual • August 2008[...]