Fujitsu T5440 manual

SP ARC Enter pr ise T5440 Ser v er Ser vice Manual P art No. 875-43 92-12 June 2011 , Revision A Manual Code C120-E512-0 3EN,[...]

Please Recycle Copyright © 2008, 201 1 , Oracle and/o r its affiliates. All rights reserved. FUJITSU LIMITED prov ided technical input an d review on portions of this material. Oracle and/or its af filiates and Fujitsu Limited each own or control intellectual pr operty rights relating to products and tech nolog y descr ibed in this document, and s[...]

Copyright © 2008, 201 1, Oracle et/ou ses s o ciétés affiliées. T ous droits réservés. FUJITSU LIMITED a fourni et vérifié des données te chniques de certaines parties de ce co mposant. Oracle et/ou ses sociétés affiliées et Fujitsu Limited détien nent et contr ôlent chacune des dro its de propriété inte llectuelle relatifs aux pr o[...]

[...]

v Contents Preface xiii Identifying Server Components 1 Infrastructure Boards and Cables 1 Front Panel Diagram 3 Front Panel LEDs 5 Rear Panel Diagram 6 Rear Panel LEDs 8 Ethernet Port LEDs 9 Managing Faults 1 1 Understanding Fault Handling Options 11 Server Diagnostics Overview 12 Diagnostic Flowchart 13 Options for Accessing the Se rvice Processo[...]

vi SPARC Enterprise T5440 Server Service Manual • June 2011 ▼ Switch From the System Cons ole to the Service Processor (ILOM or ALOM CMT Compatibility Shell) 26 ▼ Switch From ILOM to the System Con sole 26 ▼ Switch From the ALOM CMT Compatibility Shell to the Sys tem Console 26 Displaying FRU Info rmation With ILOM 27 ▼ Display System Com[...]

Contents vii Identifying Faults Detected by PSH 48 ▼ Detect Faults Identified by the Oracle Solaris PSH Facility (ILOM fmdump Command) 49 Clearing Faults 52 ▼ Clear Faults Detected During PO ST 52 ▼ Clear Faults Detected by PSH 54 ▼ Clear Faults Detected in the Ex ternal I/O Expansion Unit 55 Disabling Faulty Components 55 Disabling Faulty [...]

viii SPARC Enterprise T5440 Server Service Manual • June 2011 Extending the Se rver to the Maintenan ce Position 69 Components Serv iced in the Maintenance Position 69 ▼ Extend the Server to th e Maintenan ce Position 70 ▼ Remove the Ser ver From the Rack 71 ▼ Perform Electr ostatic Discharge – Antistatic Pr evention Measures 73 ▼ Remov[...]

Contents ix ▼ Remove a Power Supply 92 ▼ Install a Power Supply 93 Power Supply Device Identifiers 94 Power Supply LED 95 Servicing PCIe Cards 96 ▼ Remove a PCIe Card 96 ▼ Install a PCIe Card 97 ▼ Add a PCIe Card 98 PCIe Device Identifiers 99 PCIe Slot Configuration Guidelines 100 Servicing CMP/Memory Modules 102 CMP/Memory Modules Ov erv[...]

x SPARC Enterprise T5440 Server Service Manual • June 2011 Servicing the Front Bezel 119 ▼ Remove the Front Bezel 120 ▼ Install the Front Bezel 121 Servicing the DVD-ROM Drive 122 ▼ Remove the DVD-ROM Drive 122 ▼ Install the DVD-ROM Drive 123 Servicing the Service Processor 124 ▼ Remove the Ser vice Processor 124 ▼ Install the Service[...]

Contents xi Servicing the Flex Cable Assembly 144 ▼ Remove the Flex C able Assembly 145 ▼ Install the Flex Cable Assembly 146 Servicing the Fron t Control Panel 148 ▼ Remove the Front Contro l Panel 148 ▼ Install the Front Contr ol Panel 149 Servicing the Front I/O Board 150 ▼ Remove the Front I/O Board 150 ▼ Install the Front I/O Boar [...]

xii SPARC Enterprise T5440 Server Service Manual • June 2011 I/O Fabric in 4P Configuration 169 Identifying Connector Pinouts 171 Serial Management Port Connec tor Pinouts 172 Network Management Port Co nnector Pinouts 173 Serial Port Connector Pinouts 174 USB Connector Pinouts 175 Gigabit Ethernet Conne ctor Pinouts 176 Server Components 177 Cus[...]

xiii Pr eface This manual pr ovides detailed pr ocedures that descri be the re moval and r eplacement of replaceabl e parts in the SP ARC Enterprise T5440 Server . This manual also includes information about the use and maintenance of the server . This document is written for technicians, system admi nistrators, authorized service pr oviders (ASPs)[...]

xiv SPARC Enterprise T5440 Server Service Manual • June 2011 ■ “Identify ing Server Components ” on page 1 Provides an overview of the server , including major boar ds and components, as well as fr ont and r ear panel features. ■ “Managing Faults” on pa ge 1 1 Describes the diagnostics that ar e available for monitoring and trou blesh[...]

Preface xv (http://primeserver.fujitsu.com/sparcenterprise/manual/ ) Title Description Manual Code SP ARC Enterprise T5440 Server Getting Started Guide Minimum steps to power on and boot the server for th e first time C120-E504 SP ARC Enterprise T5440 Server Product Notes Information about the lat est product updates and issues C120-E508 Important [...]

xvi SPARC Enterprise T5440 Server Service Manual • June 2011 Note – Product Note s are availa ble on the website onl y . Please check for the rece nt update on your product. UNIX Commands This document might not contain informa tion on basic UNIX ® commands an d procedures such as shutting down the system, booting the syst em, and configuring [...]

Preface xvii T ext Conventions * The settings on your browser might dif fer from these settings. Pr ompt Notations The following pr ompt notations are used in this manual. T ypeface* Meaning Examples AaBbCc123 The names of commands, files, and directories; on-scr een computer output Edit your .login file. Use ls -a to list all files. % You have mai[...]

xviii SPARC Enterprise T5440 Server Service Manual • June 2011 Conventions for Alert Messages This manual uses the foll owing conventions to show alert me ssages, which are intended to prevent injury to the user or bystanders as well as pr operty damage, and important messages that ar e usef ul to the user . Caution – This indicates a haz ardou[...]

Preface xix Also, important alert messages ar e shown in “Im portant Alert Messages” on page xix . Notes on Safety Important Alert Messages This manual pr ovides the following important alert signals: Caution – This indi cates a hazard ous situation could r esult in minor or moderate personal injury if the user does not perform the procedure [...]

xx SPARC Enterprise T5440 Server Service Manual • June 2011 Caution – This indicates that surfaces are hot and might cause pers onal injury if touched. A void contact. Pr oduct Handling Maintenance Caution – Certain tasks in this manual should only be performed by a certified service engine er . User must not perform th ese tasks. Incorr ect [...]

Preface xxi Caution – The following task s regar ding this product and the optional pr oducts provided fr om Fujitsu should only be performed by a certified service eng ineer . Users must not perform these tasks. Inco rrect operation of these tasks may cause malfunction. ■ Unpacking optional adapters and such packages deliver ed to the users ?[...]

xxii SPARC Enterprise T5440 Server Service Manual • June 2011 Documentation Feedback If you have any comments or requests rega r ding this document, or if you find any unclear statements in the document, please st ate your poin ts specifically on the form at the following URL. (http://www.fujitsu.com/global/contact/computing/sp arce_index.ht ml)[...]

1 Identifying Server Components These topics provide an ove rview of the server , includin g major boards and components, as well as front and rear panel features. Related Information ■ “Server Components” on page 177 Infrastructur e Boar ds and Cables The server is ba sed on a 4U c hassis and has the following boards installed: ■ Motherboa[...]

2 SPARC Enterprise T5440 Server Service Manual • June 2011 ■ Memory module – A memory module contain ing slots for an additional 12 FB-DIMMs is associated with each CMP module. ■ Service processor – The service processor (ILOM) board contr ols the server pow er and monitors server power and enviro nmental events. The service processor dra[...]

Identifying Ser ver Components 3 Fr ont Panel Diagram The server front pan el contains a re cessed system power butt on, system status a nd fault LEDs, Locator button and LED. The front pa nel also provi des access to internal hard drives, the DVD-RO M drive (if eq uipped), and the two front USB ports. The following illustration shows front panel f[...]

4 SPARC Enterprise T5440 Server Service Manual • June 2011 ■ “Rear Panel Diagram” on page 6 ■ “Servicing the Front Bezel” on page 1 19[...]

Identifying Ser ver Components 5 Fr ont Panel LEDs LED or Button Icon Description Locator LED and button (white) The Locator LED enables you to find a pa rticular system. The LED is activated using one of the following methods: • The ALOM CMT command setlocator on. • The ILOM command set /SYS/LOCATE value=Fast_Blink • Manually pres s the Loca[...]

6 SPARC Enterprise T5440 Server Service Manual • June 2011 Related Information ■ “Fr ont Panel Diagram” on page 3 ■ “Rear Panel LEDs” on page 8 ■ “Detecting Faults Using LEDs” on page 34 Rear Panel Diagram The rear panel pr ovides access to system I/O ports, PCIe ports, Gigabit Ethernet ports, power supplies, Locator butto n and[...]

Identifying Ser ver Components 7 FIGURE: Rear Panel Features Related Information ■ “Front Panel Diagram” on page 3 ■ “Rear Panel LEDs” on page 8 ■ “Ethernet Port LEDs” on page 9 ■ “Detecting Faults Using LEDs” on page 34 Figure Lege nd 1 P ower supplies 2 Serial por t 3 Serial management port 4 System status LEDs 5 USB ports[...]

8 SPARC Enterprise T5440 Server Service Manual • June 2011 Rear Panel LEDs Related Information ■ “Rear Panel Diagram” on page 6 ■ “Ethernet Port LEDs” on page 9 ■ “Detecting Faults Using LEDs” on page 34 LED Icon Description Locator LED and button (white) The Locator LED enables you to find a particular system. The LED is activa[...]

Identifying Ser ver Components 9 Ethernet Port LEDs The service processor network management port and the four 1 0/100/1000 Mbps Ethernet ports each have two LEDs. Related Information ■ “Rear Panel Diagram” on page 6 ■ “Rear Panel LEDs” on page 8 ■ “Detecting Faults Using LEDs” on page 34 LED Color Description Left LED Amber or gr[...]

10 SPARC Enterprise T5440 Server Service Manual • June 2011[...]

11 Managing Faults These topics describe the diagnosti cs tools that are avai lable for monitoring and troubleshooting the server . These topics ar e intended for technicians, service personnel, and system administrators who service and re pair computer systems. It contains the following topics: ■ “Understan ding Fault Handling Options” on pa[...]

12 SPARC Enterprise T5440 Server Service Manual • June 2011 ■ “Memory Fault Handling Overview” on page 24 Server Diagnostics Overview Y ou can use a variety of diagnostic tools, commands, and indica tors to monitor and troubleshoot a server: ■ LEDs – Provide a quick visual notification of the status of the server and of some of the FRUs[...]

Managing F aults 13 ■ V erify that the server was installed properly . ■ Vi s u a l l y i n s p e c t cables a nd power . ■ (Optional) Perform a reset of the server . Related Information ■ “Diagnostic Flowchart” on page 13 ■ SP ARC Enterprise T5440 Server In stallation and Setup Guid e ■ SP ARC Enterprise T5440 Serv er Administratio[...]

14 SPARC Enterprise T5440 Server Service Manual • June 2011 FIGURE: Diagnostic Flowchart[...]

Managing F aults 15 TA B L E : Diagnostic Flowchart Actions Action No. Diagnostic Action Resulting Action For more information 1. Check Power OK and AC Present LEDs on the server . The Power OK LED is located on the front and r ear of the chassis. The AC Present LED is located on the rear of the server on ea ch power supp ly . If these LEDs ar e no[...]

16 SPARC Enterprise T5440 Server Service Manual • June 2011 6. Determine if the fault is an environmental or configuration fault. Determine if the fault is an envir onmental fault or a configuration fault . If the fault listed by the show faulty command displays a temperature or voltage fault, then the fault is an envir onmental fault. Environmen[...]

Managing F aults 17 Related Information ■ “Server Diagnostics Overview” on pa ge 12 ■ SP ARC Enterprise T5440 Serv er Administration Guide Options for Accessing the Service Pr ocessor There are thr e e methods of intera cting with the service pr ocessor: ■ Integrated Lights Out Manager (ILOM) sh ell (default) – A vailable via the System[...]

18 SPARC Enterprise T5440 Server Service Manual • June 2011 The code examples in this document de pict use of the ILOM shell. Note – Multiple service pr ocessor accounts can be active c oncurrently . A user can be logged in under one account using the IL OM shell, and anoth er account using the ALOM CMT shell . Related Information ■ “Diagno[...]

Managing F aults 19 FIGURE: ILOM Fault Management The service pr ocessor can detect when a fault is no longer pr esent and clears the fault in several ways: ■ Fault recovery – Th e system automatically detects that the fault condition is no longer present. The service processor extinguishes the Service Required LED and updates the FRU’s PROM,[...]

20 SPARC Enterprise T5440 Server Service Manual • June 2011 Related Information ■ “Diagnostic Flowchart” on page 13 ■ “Detecting Faults Using LEDs” on page 34 ■ “Detecting Faults (Oracle Solaris OS Files an d Commands)” on page 39 ■ SP ARC Enterprise T5440 Server Installation and Setup Guide ■ SP ARC Enterprise T5440 Serv er[...]

Managing F aults 21 The Oracle Solaris OS uses the Fault Manager daemon, fmd (1M), which starts at boot time and runs in the backgr ound to monito r the system. If a component generates an error , the daemon han dles the err or by corr elating the error with data from pr evious errors and other related informatio n to di agnose the problem. Once di[...]

22 SPARC Enterprise T5440 Server Service Manual • June 2011 ■ “Oracle VTS Softwar e Packages” on page 45 ■ “Useful Oracle VTS T ests” on page 46 ■ SP ARC Enterprise T5440 Serv er Administration Guide POST Fault Management Overview Power-on self-test (POST) is a gr oup of PROM -based tests th at run when the server is powered on or r[...]

Managing F aults 23 POST Fault Management Flowchart FIGURE: Flowchart of V ariab les for POST Configuration Related Information ■ “Diagnostic Flowchart” on page 13[...]

24 SPARC Enterprise T5440 Server Service Manual • June 2011 ■ “Detecting Faults Using POST” on page 46 ■ SP ARC Enterprise T5440 Server Installation and Setup Guide ■ SP ARC Enterprise T5440 Serv er Administration Guide Memory Fault Handling Overview A variety of features plays a role in how the memory su bsystem is configured and how m[...]

Managing F aults 25 Note – Y ou can use the FB- DIMM DIAG buttons on the CMP module and memory module to identify faulty FB-DIMMs. See “FB-DIMM Fault Button Locations” on page 1 17 . Once you identify which FB-DIMMs you want to r eplace, see “Servicin g FB-DIMMs” on page 108 for FB-DIMM removal and replacement instructions. Y o u must per[...]

26 SPARC Enterprise T5440 Server Service Manual • June 2011 ■ “Switch From the System Console to th e Service Processor (ILOM or ALOM CMT Compatibility Shell)” on page 26 ■ “Switch From ILOM to the System Console” on page 26 ■ “Switch From the ALOM CM T Compatibility Shell to the System Console” on page 26 ■ SP ARC Enterprise [...]

Managing F aults 27 Displaying FRU Information W ith ILOM ■ “Display System Componen ts (ILOM show components Command)” on page 27 ■ “Display Individual Component Informati on (ILOM show Command)” on page 28 ▼ Display System Components (ILOM show components Command) The show components command displays the system components (asrkeys) [...]

28 SPARC Enterprise T5440 Server Service Manual • June 2011 EXAMPLE: Output of the show components Command W ith No Disabl ed Components EXAMPLE: Output of the show components Command Showing Disabled Components ▼ Display Individual Component Information (ILOM show Command) Use the show command to display information ab out individual component[...]

Managing F aults 29 EXAMPLE: show Command Output Contr olling How POST Runs This topic contains the following: ■ “POST Parameters” on page 30 ■ “Change POST Parameters” on page 31 ■ “Run POST in Maximum Mode” on page 32 -> show /SYS/MB/CPU0/CMP0/BR1/CH0/D0 /SYS/MB/CPU0/CMP0/BR1/CH0/D0 Targets: R0 R1 SEEPROM SERVICE PRSNT T_AMB [...]

30 SPARC Enterprise T5440 Server Service Manual • June 2011 POST Parameters The server can be configured for normal, ex tensive, or no POST execution. Y ou can also contr ol the level of tests that run, the amount of POST output that is displayed, and which reset events trigger POST by using ILOM command variables. The keyswitch_state p arameter [...]

Managing F aults 31 Related Information ■ “Diagnostic Flowchart” on page 13 ■ “Change POST Parameters” on page 31 ■ “Run POST in Maximum Mode” on page 32 ■ “Detecting Faults Using POST” on page 46 ■ “Clear Faults Detected During POST” on page 52 ■ SP ARC Enterprise T5440 Server In stallation and Setup Guid e ■ SP A[...]

32 SPARC Enterprise T5440 Server Service Manual • June 2011 ▼ Run POST in Maximum Mode This procedure describes how to run POST when you want maxi mum testing, as in the case when you ar e troubleshooti ng a se rver , or verifying a hardware u pgrade or rep ai r . 1. Access the ILOM prompt. See “Connecting to the Servic e Proces sor” on pag[...]

Managing F aults 33 EXAMPLE: show Command Output EXAMPLE: show Command Output -> stop /SYS Are you sure you want to stop /SY S (y/n)? y Stopping /SYS -> start /SYS Are you sure you want to start /S YS (y/n)? y Starting /SYS -> start /SP/console ... 2007-12-19 22:01:17.810 0:0:0>INF O: STATUS: Running RGMII 1G BCM5466R PHY level Loopback[...]

34 SPARC Enterprise T5440 Server Service Manual • June 2011 Detecting Faults This sect ion describes the differ ent methods you can use to identify system faults in the server . Detecting Faults Using LEDs The server provides the fo llowing groups of LEDs: ■ Front panel system LEDs. See “Front Panel LEDs” on page 5 . ■ Rear panel system L[...]

Managing F aults 35 The following table describes which fault LEDs are li t under given err or conditions. Use the ILOM show faulty command to obtain more information about the nature of a given fault. See “Detec t Faults (ILOM show faulty Command)” on pa ge 37 . Component Fault Fault LEDs Lit Additional Information Power supply • Service Req[...]

36 SPARC Enterprise T5440 Server Service Manual • June 2011 Related Information ■ “Diagnostic Flowchart” on page 13 ■ “Detecting Faults Using LEDs” on page 34 ■ “ILOM-to-ALOM CMT Command Reference” on page 58 ■ SP ARC Enterprise T5440 Server Installation and Setup Guide ■ SP ARC Enterprise T5440 Serv er Administration Guide [...]

Managing F aults 37 ▼ Detect Faults (ILOM show faulty Command) ● At the -> prompt, type the show faulty command. The followin g show faulty command examp les show the dif ferent kinds of output from the show fault y command: ■ Example of the show faulty command when no faults are pr esent: ■ Example of the show faulty command displaying [...]

38 SPARC Enterprise T5440 Server Service Manual • June 2011 ■ Example showing a fault that was detect ed by the PSH technology . T hese kinds of faults are distinguished fr om other kinds of faults by the presence of a sunw-msg-id and by a UUID. ■ Example showing a fault that was detected by POST . These kinds of faults are identified by the [...]

Managing F aults 39 Detecting Faults (Oracle Solaris OS Files and Commands) W ith the Oracle Solaris OS running on th e server , you have the full complement of Oracle Solaris OS files and commands availa ble for collecting information and for troubleshooting. If POST , ILOM, or the Oracle Solaris PSH fe atures do not indicate the sour ce of a faul[...]

40 SPARC Enterprise T5440 Server Service Manual • June 2011 ▼ V iew System Message Log Files The error logging daemon, syslogd , automatical ly recor ds various system warnings, errors, and faults in messag e files. These messages can alert you to system problems such as a device that is about to fail. The /var/adm dir ectory contains several m[...]

Managing F aults 41 ▼ V iew ILOM Event Log ● T ype the following comm and: Note – The ILOM event log can also be viewed through the ILOM BUI or the ALOM CMT CLI. If a “major” or “critical” event is found that was not expected and not included under ILOM show faulty than it may indicate a system fa ult. The following is an example of u[...]

42 SPARC Enterprise T5440 Server Service Manual • June 2011 About Oracle VTS Softwar e The Oracle VTS softwar e features a Java-b ased browser en vironment, an AS CII-based screen interface, and a command-line inte rface. For more information about how to use the Oracle VTS sof twar e, see the Or acle VTS 7.0 Use r ’ s Guide . The Oracle Solari[...]

Managing F aults 43 ■ If the Oracle VTS softwar e is not i nstal led, you see an error message for each missing package, as in EXAMPLE: show Command Output on page 43 . See “Oracle VTS Overview” on page 21 for a list of r equired Oracle VTS softwa re package s. 2. If the Oracle VTS software is not in st alled, you can obtain the inst allation[...]

44 SPARC Enterprise T5440 Server Service Manual • June 2011 4. (Optional) Select the test categories you want to run. Certain test categories are enabled by default. Y ou can choose to accept these. Note – Oracle VTS T ests on page 46 lists test ca tegories that are especially useful to run on this server . 5. (Optional) Customize individual t [...]

Managing F aults 45 ■ Oracle VTS T est Kernel ( Vtsk) Error – Error messages pertaining to the Oracle VTS software itself. Look here if the Or acl e VTS software app ears to be acting strangely , especially when it starts up. ■ Information – Detailed versions of all the stat us a nd error messag es that appear in the test messages ar ea. ?[...]

46 SPARC Enterprise T5440 Server Service Manual • June 2011 Useful Oracle VTS T ests Related Information ■ “Diagnostic Flowchart” on page 13 ■ “Oracle VTS Softwar e Packages” on page 45 ■ SP ARC Enterprise T5440 Server Installation and Setup Guide ■ SP ARC Enterprise T5440 Serv er Administration Guide Detecting Faults Using POST R[...]

Managing F aults 47 In the following example, POST r eport s a memory error at FB-DIMM location /SYS/MB/CPU0/CMP0/BR1/CH0/D0 . The err or was detected by POST run ning on core 7, strand 2. EXAMPLE: show Command Output Perform further investigation if needed. ■ If POST detects a faulty device, the fault is displayed and the fault information is pa[...]

48 SPARC Enterprise T5440 Server Service Manual • June 2011 ■ “POST Fault Management Fl owchart” on page 23 ■ SP ARC Enterprise T5440 Serv er Administration Guide Identifying Faults Detected by PSH When a PSH fault is detec ted, a Oracle Sola ris console message is displayed, simila r to the following example. EXAMPLE: Console Message Sho[...]

Managing F aults 49 EXAMPLE: ALOM CMT Alert of PSH Diagnosed Fault The ILOM show faulty command pr ovides summary information about the fault. See “Detect Faults (ILOM show faulty Command)” on page 37 for more information about the show faulty command. Note – The Service Required LED is also tu rned on for PSH diagnosed faults. Related Inform[...]

50 SPARC Enterprise T5440 Server Service Manual • June 2011 ■ Faulted FRU. The info rmation pr ovided in the exam ple includes the part number of the FRU ( part=541215101 ) and the serial number of the FRU ( serial=101083 ). The Location field provides the name of the FRU. In EXAMPLE: Output from the fmdump -v Command on page 50 the FRU name is[...]

Managing F aults 51 Automated Response The fault manager will attempt to remove the affected CPU from service. Impact System performance may be aff ected. Suggested Action for System Admin istrator Schedule a repair procedure t o replace the affected CPU, the identity of which can be det ermined using fmdump -v -u < EVENT_ID>. Details The Mes[...]

52 SPARC Enterprise T5440 Server Service Manual • June 2011 Clearing Faults This section describes how to c lear faults. Note – Some system faults are cleare d automatically . Related Information ■ “Diagnostic Flowchart” on page 13 ■ “POST Fault Management Overview ” on page 22 ■ “Predictive Self-Healing Overview” on page 20 ?[...]

Managing F aults 53 1. After replacing a faulty FRU, at the ILOM prompt use the show faulty command to identify POST -detected faults. Faults detected by POST are distinguished from other kinds of faults by the text: Forced fail . No UUID number is reported. Refer to EXAMPLE: Fault Detected by POST on page 54 . If no fault is reported, you do not n[...]

54 SPARC Enterprise T5440 Server Service Manual • June 2011 EXAMPLE: Fault Detected by POST ▼ Clear Faults Detected by PSH When the Oracle Solari s PSH facility de tects faults, the faul ts are logged and displayed on the co nsole. In most cases, a f ter the fault is repair ed, the corrected state is detecte d by the system and th e fault cond [...]

Managing F aults 55 ▼ Clear Faults Detected in the External I/O Expansion Unit For service processor detected faults in the External I/O Expansi on Unit, the fault must be manually clear ed from ILOM show f aulty after the problem has been rep ai re d. Note – After the problem has been repaired, the fault will also be cleared from the ILOM show[...]

56 SPARC Enterprise T5440 Server Service Manual • June 2011 Disabling Faulty Components Using Automatic System Recovery Y ou can use the Automatic System Recovery (ASR) feature to configure the server to automatically disable fa iled components until they can be r eplaced. The following components are managed by the ASR feature: ■ UltraSP ARC T[...]

Managing F aults 57 Note – A re s et or po we r cy cl e i s re qu ire d a f te r disabling or enabling a compo nent. If the status of a component is changed, there is no effect to the system until t he next res e t or po w er cy cl e. Related Information ■ “Diagnostic Flowchart” on page 13 ■ “Detecting Faults” on page 34 ■ SP ARC En[...]

58 SPARC Enterprise T5440 Server Service Manual • June 2011 1. A t the -> prompt, set the component_state property to Enabled . 2. Reset the server s o that the ASR command takes effect. Note – In the ILOM shell there is no notifi cation when the sy stem is actually powered of f. Powering off takes about a minute. Use the show /HOST command [...]

Managing F aults 59 ■ Integrated Lights Out Manager 3.0 Su pplement for the SP ARC Ent erprise T5440 Server ILOM Command ALOM CMT Command Description help [command] help [ command ] Displays a list of all available commands with syntax and descriptions. Specif ying a command name as an option displays help for that comm and. set /HOST/send_break_[...]

60 SPARC Enterprise T5440 Server Service Manual • June 2011 set /HOST/bootmode/ value [norm al|re set_nvram |bootscript= string ] bootmode value [normal|reset_nvram| bootscript= st ring ] Enables control of the fi rmware during s ystem initia lization with the following options: • normal is the default boot mo de. • reset_nvram resets OpenBoo[...]

Managing F aults 61 set /SYS/keyswitch_state value normal | stby | diag | locked setkeyswitch [-y] value normal | stby | diag | locked • -y enables y ou to skip the confirmation questi on when setting the keyswitch to stby . Sets the virtual keyswitch. set /SUS/LOCATE value= value [ Fast_blink | Off ] setlocator value [ on | off ] T urns the Loca[...]

62 SPARC Enterprise T5440 Server Service Manual • June 2011 The following table shows typical combina tions of ALOM CMT varia bles and associated POST modes. Related Information ■ “Diagnostic Flowchart” on page 13 ■ “Detecting Faults Using LEDs” on page 34 ■ “ILOM-to-ALOM CMT Command Reference” on page 58 ■ SP ARC Enterprise T[...]

63 Pr eparing to Service the System These topics de scribe how to pr epare the server for servicing. ■ “Safety Information” on page 63 ■ “Required T ools” on page 66 ■ “Obtain the Chassis Serial Number” on page 66 ■ “Obtain the Chassis Serial Number Remotely” on page 66 ■ “Powering Of f the System” on page 67 ■ “Ex[...]

64 SPARC Enterprise T5440 Server Service Manual • June 2011 Observing Important Safety Pr ecautions For your protection, observe the following safety pr ecauti ons when setting up your equipment: ■ Follow all cautions and instr uctions marked on the equipment and described in the documentation shipped wi th your system. ■ Follow all cautions [...]

Preparing to Ser vice the System 65 Electr ostatic Dischar ge Safety Measur es This topic includes the following: ■ “Handling Elec tron ic Components” on pag e 65 ■ “Antistatic W rist Strap” on page 65 ■ “Antistatic Mat” on page 65 Handling Electr onic Components Electrostatic dischar ge (ESD) sensit ive devices, such as the mothe[...]

66 SPARC Enterprise T5440 Server Service Manual • June 2011 Requir ed T ools ■ Antistatic wrist strap ■ Antistatic m at ■ No. 1 Phillips scr ewdriver ■ No. 2 Phillips scr ewdriver ■ 7 mm hex driver ■ No. 1 flat-blade screwdriver (battery r emoval) ■ Pen or pencil (power on server) ▼ Obtain the Chassis Serial Number T o obtain supp[...]

Preparing to Ser vice the System 67 Powering Of f the System Note – Additional information about powerin g off the system is located in the SP ARC Enterprise T5440 Serv er Administration Guide . This topic includes the following: ■ “Power Off (Command L i n e ) ” o n p a g e 6 7 ■ “Power Off (Graceful Shutdown)” on page 68 ■ “Powe[...]

68 SPARC Enterprise T5440 Server Service Manual • June 2011 2. Switch from the system console prompt to the service processor console prompt. Ty p e : 3. From the ILOM -> prompt, t ype: Note – T o perform an immediate shutdown, use the stop -force -script /SYS command. Ensure that all data is sa ved before entering this command. ▼ Power Of[...]

Preparing to Ser vice the System 69 Caution – Because 3.3v standby power is alway s pres ent in the system, you must unplug the power cords befor e accessing any cold-serviceable components. Extending the Server to the Maintenance Position This topic includes the following: ■ “Components Serviced in the Maintenan ce Position” on page 69 ■[...]

70 SPARC Enterprise T5440 Server Service Manual • June 2011 ▼ Extend the Server to the Maintenance Position 1. (Optional) Use the set /SYS/LOCATE command from the -> prompt to lo cate the system that requires maintenance. Once you have located the server , press th e Locator LED and button to turn it off. 2. V erify that no cables will be da[...]

Preparing to Ser vice the System 71 4. While squeezing the slide rail locks, slow ly pull the server forward until it is locked in the service position. ▼ Remove the Server Fr om the Rack The server must be removed from the ra ck to r e move or in stall th e following components: ■ Motherboard Caution – T wo people must dismoun t and carry th[...]

72 SPARC Enterprise T5440 Server Service Manual • June 2011 FIGURE: Removing the Se rver From the Rack Caution – Use two people to dismount and carry the chassi s. FIGURE: Lift W arning 4. From the front of the server , press inne r rail release buttons and pull the server forward until it is free of the rack rails. 5. Set the server on a sturd[...]

Preparing to Ser vice the System 73 ▼ Perform Electr ostatic Discharge – Antistatic Pr evention Measures 1. Prepare an antistatic surface to set parts on during the removal, installation, or replacement process. Place ESD-sensitive components such as the printed circuit boar ds on an antistatic mat. The following items can be used as an antista[...]

74 SPARC Enterprise T5440 Server Service Manual • June 2011 Caution – If the top cover is remove d before the server is powered of f , the server will immediately disable the front panel Po wer button and shut down. After such an event, you must replace the top cover and use the poweron command to power on the server . See “Power On the Serve[...]

75 Servicing Customer -Replaceable Units These topic s describe how to se rvice custom er -replacea ble units (CRUs) in the server . Related Information ■ “Servicing Field -Replaceabl e Units” on page 1 19 Hot-Pluggable and Hot-Swappable Devices Hot-pluggable devices ar e those devices th at you can r emove and install while the server is run[...]

76 SPARC Enterprise T5440 Server Service Manual • June 2011 ■ Hard drives Hot-swappable devices ar e those devices th at can be removed and installed while the server is running without affecting th e r est of the server ’s capabilities. The following devices ar e hot-swappable: ■ Fan trays ■ Power supplies Note – The chassis-mount ed h[...]

Ser vicing Customer-Replaceab le Units 77 Caution – Y ou must use hard drives designed fo r this server , which have a vented front panel to allow adequate airflow to internal system components. Installing inapprop riate hard drives could r esult in an overtemperature condition. The following situa tions inhibit your ability to hot-plug a driv e:[...]

78 SPARC Enterprise T5440 Server Service Manual • June 2011 1. At the S olaris prom pt, issue th e cfgadm -al command to list a ll drives in the device tree, including d rives that are not configured. T ype: This comma nd should identif y the Ap_id for the hard drive you wish to r emove, as in EXAMPLE: Sample Ap_id Output on page 79 . 2. Issue th[...]

Ser vicing Customer-Replaceab le Units 79 EXAMPLE: Sample Ap_id Output ▼ Install a Har d Drive (Hot-Plug) Installin g a hard drive into the server is a two-step process . Y ou must first install a hard drive into the desired drive slot. Th en you must configure that drive to the server . Perform the following process to inst all a hard drive. 1. [...]

80 SPARC Enterprise T5440 Server Service Manual • June 2011 4. Close the latch to lock the drive in place. 5. At the S olaris pro mpt, type th e cfgadm -al command to list all drives in th e device tree, including any drives t hat are not configured. T ype: This command should help you identify the Ap_id for the hard drive you installed. For an o[...]

Ser vicing Customer-Replaceab le Units 81 9. T ype the iostat -E command. T ype: The iostat -E command disp lays information about your system’s installed devices such as manufacturer , model number , serial number , size, and system error statistics. EXAMPLE: Sample Ap_id Output ▼ Remove a Har d Drive If you are r emoving a hard drive as a pre[...]

82 SPARC Enterprise T5440 Server Service Manual • June 2011 1. Note the location of each hard drive. Note – Y ou must install each hard drive in the same bay fr om which it was removed. 2. Press the hard drive latch release b utton. 3. Slide the hard drive out of its bay . ▼ Install a Hard Drive If you are installi ng a hard drive after servi[...]

Ser vicing Customer-Replaceab le Units 83 3. Close the latch to l ock the drive in place. 4. If you performed any addition al ser vice procedures, see “Power On the Server” on page 157 . Har d Drive Device Identifiers The following table lists physic al drive locations and their corr esponding default path names in OpenBoot PROM and Solaris for[...]

84 SPARC Enterprise T5440 Server Service Manual • June 2011 Har d Drive LEDs The front and r e ar panel Service Requir ed LEDs are also lit if the system detects a hard drive fault. Related Information ■ “Hard Drive Device Identifiers” on page 83 Servicing Fan T rays This topic includes the followin g: ■ “About Fan T rays” on page 85 [...]

Ser vicing Customer-Replaceab le Units 85 ■ “Fan T ray Fault LED” on page 89 About Fan T rays Four fan trays are located towar d the front of the server , arranged in two N+1 redundant pairs . Each fan tray contai ns a fan mounted in an integrated, hot-swappable CRU. If a fan tray fails, replac e it as soon as possible to maintain server avai[...]

86 SPARC Enterprise T5440 Server Service Manual • June 2011 ▼ Install a Fan T ray (Hot-Swap) 1. Slide the fan tray in to its bay until it locks into place. Ensure that the fan tray is oriented corr e ctly . Airflow in the system is from front to back. 2. V erify prop er fan tray operation . See “Fan T ray Fault LED” on p age 89 . Next Steps[...]

Ser vicing Customer-Replaceab le Units 87 ▼ Remove a Fan T ray If you are r emoving the fan trays as a pr er equisite for another service procedure, follow the ste ps in this pr ocedure. Before you begin, complete these tasks: ■ Read the se ction, “Safety Information” on page 63 . ■ Power off the server , using one of th e methods describ[...]

88 SPARC Enterprise T5440 Server Service Manual • June 2011 ▼ Install a Fan T ray 1. Slide each fan tray into its bay until it locks into place. Ensure that the fan tray is oriented corr e ctly . Airflow in the system is from front to back. 2. V erify prop er fan tray operation . See “Fan T ray Fault LED” on p age 89 . Next Steps If you are[...]

Ser vicing Customer-Replaceab le Units 89 Fan T ray Fault LED Each fan tray contains a Faul t LED that is located on the top panel of the server . The LED is visible when you slide the server partially out of the rack. The front panel Fa n Fault LED, and the fron t and rear panel Service Requir ed LEDs are also lit if the system detects a fan tray [...]

90 SPARC Enterprise T5440 Server Service Manual • June 2011 About Power Supplies The server is equipped with r edundant hot-swappable power supplies. Redundant power supplies enable you to r emove and r eplace a power supply without shutting the server down, provi ded that at least two other power supplies are online and working. Note – If a po[...]

Ser vicing Customer-Replaceab le Units 91 4. Grasp the power suppl y handle and press the release latch. 5. Pull the power supply out of the chassis. ▼ Install a Power Supply (Hot-Swap) 1. Align the replacement power supply with the empty power supply bay . 2. Slide the power supply into the bay until it is fully seated.[...]

92 SPARC Enterprise T5440 Server Service Manual • June 2011 3. Reconnect the power cord to the power supply . V erify that the power supply LED is green or blinking gr een. 4. V erify that th e system Power Supply Fault LED, and the front and rear S ervice Required LEDs are not li t. Note – See “Fr ont Panel LEDs” on pa ge 5 and “Rear Pan[...]

Ser vicing Customer-Replaceab le Units 93 If you are r emoving the power supplies as a prer equisite for another service procedur e, follow these steps. Before you begin, complete these tasks: ■ Read the se ction, “Safety Information” on page 63 . ■ Power off the server , using one of th e methods described in the section, “Powering Off t[...]

94 SPARC Enterprise T5440 Server Service Manual • June 2011 2. Slide the power supply into t he bay until it is fully seated. Next Steps ■ “Connect the Power Cords to the Server” on page 157 ■ “Power On the Server” on page 157 Power Supply Device Identifiers These are the FRU device names for power suppl ies: Device Device Identifier [...]

Ser vicing Customer-Replaceab le Units 95 Note – Power supply names in ILOM messages ar e displayed with the full FRU name, such as /SYS/PS0. Related Information ■ “Managing Faults” on page 1 1 ■ “Hot-Pluggable and Hot-Swappable Devices” on page 75 “Power Supply LED” on page 95 Power Supply LED Each power supply contains a dual-c [...]

96 SPARC Enterprise T5440 Server Service Manual • June 2011 See “Power Supp ly LED” on page 95 for specific information about power supply status LEDs. Related Information ■ “Managing Faults” on pa ge 1 1 ■ “Hot-Pluggable and Hot-Swappable Devices” on page 75 ■ “Fr ont Panel LEDs” on page 5 ■ “Rear Panel LEDs” on page [...]

Ser vicing Customer-Replaceab le Units 97 3. Remove the PCIe card the system. 4. Place the PCIe card on an antistatic mat. 5. If you are not replacing the PCIe card, in stall a PCIe fill er panel in its place. 6. Close the PCIe card latch. ▼ Install a PCIe Car d 1. Identify the correct slot for installation. 2. Open th e PCIe card la tch.[...]

98 SPARC Enterprise T5440 Server Service Manual • June 2011 3. Insert the PCIe card into its slot. 4. Close the PCIe card latch. Next Steps ■ “Install the T op Cover” on page 154 ■ “Slide the Server Into the Rack” on page 155 ■ “Power On the Server” on page 157 ▼ Add a PCIe Card Before you begin, complete these tasks: ■ Read[...]

Ser vicing Customer-Replaceab le Units 99 2. Open th e PCIe card la tch. 3. Remove the PCIe filler panel. 4. Insert the PCIe card in to its slot. 5. Close the PCIe card latch. Next Steps ■ “Install the T op Cover” on page 154 ■ “Slide the Server Into the Rack” on page 155 ■ “Power On the Server” on page 157 PCIe Device Identifiers[...]

100 SPARC Enterprise T5440 Server Service Manual • June 2011 Note – PCIe names in ILOM messages ar e displa yed with the full FRU name, such as /SYS/MB/PCIE0. Note – In the Solaris OS, PCIe slot addr esses are associated with CMP modules. The PCIe slot address in the Sola ris OS might change if you add or remove CMP modules, or if a CMP modul[...]

Ser vicing Customer-Replaceab le Units 101 Use the following g uidelines to spr ead the load evenly across CMP/memory modules. If a slot is already populated with a device, install a new device in the next available slot, in the order indicated. Note – These are g uidelines to spr ead out the I/O load acros s multiple CMP/memory module pairs. The[...]

102 SPARC Enterprise T5440 Server Service Manual • June 2011 Servicing CMP/Memory Modules This topic includes the followin g: ■ “CMP/Memory Modules Overview” on page 102 ■ “Remove a CMP/Memory Module” on page 104 ■ “Install a CMP/Memory Module” on page 105 ■ “Add a CMP/Memory Module” on page 105 ■ “CMP and Memory Modul[...]

Ser vicing Customer-Replaceab le Units 103 Related Information ■ “CMP and Memory Module Device Identifiers” on page 107 ■ “Supported CMP/Memory Module Configurations” on pag e 107 ■ “I/O Connections to CMP/Memory Modules” on page 160 ■ “Reconfiguring I/O Device Nodes” on page 162 ■ “Servicing FB-DIMMs” on page 108 ■ [...]

104 SPARC Enterprise T5440 Server Service Manual • June 2011 ▼ Remove a CMP/Memory Module Before you begin, complete these tasks: ■ Read the section, “Safety Informa tion” on page 63 . ■ Power off the server , using one of th e methods described in the section, “Powering Off the System” on page 67 . ■ “Extend the Server to the M[...]

Ser vicing Customer-Replaceab le Units 105 ▼ Install a CMP/Memory Module Note – If you ar e r eplacing a faulty CMP or memory module, y ou must transfer the FB-DIMMs on the faulty module to the replacement module. Replacement CMP/memory modules do not include FB-DIMM s. For more informati on about installing FB-DIMMs, see “Servicing FB-DIMMs [...]

106 SPARC Enterprise T5440 Server Service Manual • June 2011 ■ Power off the server , using one of th e methods described in the section, “Powering Off the System” on page 67 . ■ “Extend the Server to the Ma intenance Position” on page 70 ■ “Perform Electrostatic Disc harge – Antistatic Pr even tion Measures” on page 73 ■ ?[...]

Ser vicing Customer-Replaceab le Units 107 CMP and Memory Module Device Identifiers The following table describes device, device identifiers, and supported configurations for CMP and memory modules. Device identifiers are case-sensitive. Note – CMP and memory module names in ILOM messages a re displayed with the full FRU name, such as /SYS/MB/CPU[...]

108 SPARC Enterprise T5440 Server Service Manual • June 2011 Related Information ■ “CMP and Memory Module Device Identifiers” on page 107 ■ “Performing Node Reconfiguration” on pag e 159 Servicing FB-DIMMs ■ “Remove FB-DIMMs” on page 108 ■ “Install FB-DIMMs” on page 109 ■ “V erify FB -DIMM Replacement” on page 1 10 ?[...]

Ser vicing Customer-Replaceab le Units 109 a. Press the FB-DIMM fau lt button. See “FB-DIMM Fault Button Locations” on page 1 17 . b. Note which FB-DIMM fault LED is illuminated. 2. Push down on the eject or tabs on each side of the FB-DIMM until the FB-DIMM is released. Caution – FB-DIMMs might be hot. Use ca ution when servicing FB-DIMMs. 3[...]

110 SPARC Enterprise T5440 Server Service Manual • June 2011 ■ “Power On the Server” on page 157 ▼ V erify FB-DIMM Replacement 1. Access the ILOM - > prompt . Refer to the Integrated Lights Out Manager 3.0 Supplement for the SP ARC Enterprise T5440 Server for instr uctions. 2. Run the show faulty command to determine how to cle ar the [...]

Ser vicing Customer-Replaceab le Units 111 Example: 3. Perform the following steps to ver ify the repair: a. Set t he virtual keyswitch to diag so that POST will run in Service mode. b. Power cycle the system. Note – The server takes about one minute to power off. Use the show /HOST command to determine when the host has be en powered off. The co[...]

112 SPARC Enterprise T5440 Server Service Manual • June 2011 Note – Depending on the configuration of ILOM POST vari ables and whether POST -detected faults or not, the system mi ght boot, or the system might remain at the ok prompt. If t he system is at the ok prompt, type boot . d. Return the virtual keyswitch to Normal mod e. e. Switch to th[...]

Ser vicing Customer-Replaceab le Units 113 ▼ Add FB-DIMMs If you are upgr ading the system with a dditional FB-DIMMs, use this pr ocedure. Before you begin, complete these tasks: ■ Read the se ction, “Safety Information” on page 63 . ■ Read the sections, “F B-DIMM Configuration ” on page 1 13 and “FB-DIMM Device Identifiers” on pa[...]

114 SPARC Enterprise T5440 Server Service Manual • June 2011 ■ “Memory Bank Configurations ” on page 1 14 Supported FB-DIMM Configurations Use these FB-DIMM configuration rules to he lp you plan the memory configuration of your server: ■ U p to 16 F B - D I M M s ca n b e i n s t a l l e d i n e a c h C M P / m e m o ry mo du l e p a i r [...]

Ser vicing Customer-Replaceab le Units 115 FIGURE: Supported FB-DIMM Configurations Configuration 6 4 x 4 GByte 4 x 4 GByte 4 x 4 GByte 4 x 4 GByte 64 GBytes C o n f i g u r a t i o n 7 4 x 8 G B y t e –––3 2 G B y t e s Configuration 8 4 x 8 GByte 4 x 8 GByte – – 64 GBytes Configuration 9 4 x 8 GByte 4 x 8 GByte 4 x 8 GByte 4 x 8 GByte 1[...]

116 SPARC Enterprise T5440 Server Service Manual • June 2011 Note – See “FB-DIMM Device Identifiers” on page 1 16 for a list of FB-DIMM device identifiers and the correspond ing slots on the CMP/memory modules. Related Information ■ “Managing Faults” on pa ge 1 1 ■ “FB-DIMM Device Iden tifiers” on page 1 16 ■ “FB-DIMM Fault [...]

Ser vicing Customer-Replaceab le Units 117 The FB-DIMM address follows the same convention as the CMP or memory module upon which it is mounted. For example, /SYS/MB/CPU0/CMP0/BR1/CH0/D0 is the device identifier for the FB-DIMM mounted at J792 on CMP module 0. Related Information ■ “Managing Faults” on page 1 1 ■ “FB-DIMM Configuration”[...]

118 SPARC Enterprise T5440 Server Service Manual • June 2011 Related Information ■ “Managing Faults” on pa ge 1 1 ■ “FB-DIMM Configuration” on pa ge 1 13 ■ “FB-DIMM Device Iden tifiers” on page 1 16[...]

119 Servicing Field-Replaceable Units These topics de scribe how to service f ield-r eplaceable unit s (FRUs) in the server . Note – The procedur es in this chapter must be performed by a qualified service technician. Servicing the Fr ont Bezel Y ou must remove the front bezel in order to service the DVD-ROM drive. ■ “Remove the Fron t Bezel?[...]

120 SPARC Enterprise T5440 Server Service Manual • June 2011 Related Information ■ “Servicing the DVD-RO M Drive” on page 122 ▼ Remove the Front Bezel Before you begin, complete these tasks: ■ Read the section, “Safety Informa tion” on page 63 . ■ If you are performing additional servic e procedures, power of f the server , using [...]

Ser vicing Field-Replaceable Units 121 Note – A void bending the bezel by gradually pulling it fr om the middle and both ends simultaneously . ▼ Install the Fr ont Bezel 1. Align the bezel with the chassis front panel. 2. Press the bezel onto the front panel. The bezel is oriented with four guide pin s, and is secured with three snap-in posts. [...]

122 SPARC Enterprise T5440 Server Service Manual • June 2011 Servicing the DVD-ROM Drive Y ou must remove the fr ont bezel before servicing the DVD-ROM drive. ■ “Remove the DVD-ROM Drive” on page 122 ■ “Install the DVD-ROM Drive” on page 123 Related Information ■ “Servicing the Front Bezel” on page 1 19 ▼ Remove the DVD-ROM Dr[...]

Ser vicing Field-Replaceable Units 123 4. Slide the DVD-ROM drive out of the chassis. ▼ Install the DVD-ROM Drive 1. Slide the DVD-ROM drive into its bay . 2. Connect the DVD-ROM drive to the flex cable as sembly . 3. Install the flex cable retainer . Place the retainer into position and ti ghten the captive No. 2 Phillips scr ew . Next Steps ■[...]

124 SPARC Enterprise T5440 Server Service Manual • June 2011 ■ “Power On the Server” on page 157 Servicing the Service Pr ocessor The service processor module contains the service processor firmwar e, IDPROM, and system battery . ■ “Remove the Service Pr ocessor” on page 124 ■ “Install the Service Pr ocessor” on page 126 Related[...]

Ser vicing Field-Replaceable Units 125 3. Lift the service processo r up and out of the system. 4. Place the service proces sor on an antistatic mat. Next Steps If you are r eplacing a faulty service proce ssor , you must install the IDPROM onto the new service processo r . Do the following: ■ Remove the IDPROM from the old service processor . Se[...]

126 SPARC Enterprise T5440 Server Service Manual • June 2011 ■ Install the IDPROM onto the new service pr ocessor . See “Install the IDPRO M” on page 128 . ▼ Install the Service Processor 1. Ensure that the power cords ar e disconnected from the system. 2. Lower the service pr ocessor into position. Ensure that the service pr ocessor is o[...]

Ser vicing Field-Replaceable Units 127 ■ “Slide the Server Into the Rack” on page 155 ■ “Connect the Power Cords to the Server” on page 157 ■ “Power On the Server” on page 157 Servicing the IDPROM The IDPROM stores sy stem parameters, su ch as host I D and MAC address, ILOM configuration set tings, and OpenBoot PR OM configuration[...]

128 SPARC Enterprise T5440 Server Service Manual • June 2011 2. Place the IDPROM on an antistatic mat. ▼ Install the IDPROM Before you begin, complete these tasks: ■ Read the section, “Safety Informa tion” on page 63 . ■ Power off the server , using one of th e methods described in the section, “Powering Off the System” on page 67 .[...]

Ser vicing Field-Replaceable Units 129 ● Plug the IDPROM into its connector on t he service processor . Ensure that the service pr ocessor is orie nted corr ectly . A notch on the IDPROM corresponds to a similar notch on the connector . Servicing the Battery The battery pr ovides the power necessar y to maintain system configurati on parameters d[...]

130 SPARC Enterprise T5440 Server Service Manual • June 2011 ▼ Install the Battery 1. Place the battery into its hold er on the service processor board. Ensure that the battery is oriented corr ectly . 2. Press the battery firmly unti l it snaps into place. Next Steps ■ “Install the Service Pr ocessor” on page 126 ■ “Install the T op [...]

Ser vicing Field-Replaceable Units 131 Note – Y ou must remove all four po wer suppl ies from th e system. ■ “Perform Electr ostatic Dischar ge – Antistatic Pr evention Measure s” on page 73 ■ “Remove the T op Cover” on page 73 Do the following: 1. Remove the flex cable retainer . Loosen the captive No. 2 Phillips scr ew and lift th[...]

132 SPARC Enterprise T5440 Server Service Manual • June 2011 6. Slide the power distribut ion board up and out of the ch assis. ▼ Install the Power Distribution Board 1. Align the keyholes in the power di st ribution board with the corresp onding mushroom standof fs in the chassis. 2. Lower the power distribution board into the chassis. 3. Inst[...]

Ser vicing Field-Replaceable Units 133 ■ “Power On the Server” on page 157 Servicing the Fan T ray Carriage Y ou must remove the fan tray carriage in order to service the following components: ■ Hard drive backplane ■ Motherboard ■ Front control panel ■ Front I/O boar d This topic includes the following: ■ “Remove the Fan T ray Ca[...]

134 SPARC Enterprise T5440 Server Service Manual • June 2011 ■ “Remove a CMP/Memory Module” on page 104 Note – Y ou must remove all CPU modules an d memory modules from the system. Do the following: 1. Remove the nine No. 1 Phillips screws se curing the fan tray carriage to the top of the chassis. 2. Loosen the seven captive No. 2 Phillip[...]

Ser vicing Field-Replaceable Units 135 2. Secure the seven captive No. 2 Phillips screws 3. Install the nine No. 1Phillips screws. Next Steps ■ “Install a Fan T ray” on page 88 Note – Install all four fan trays. ■ “Install the T op Cover” on page 154 ■ “Slide the Server Into the Rack” on page 155 ■ “Power On the Server” on[...]

136 SPARC Enterprise T5440 Server Service Manual • June 2011 Related Information ■ “Servicing Har d Drives” on page 76 ■ “Servicing the Fan T ray Carriage” on p age 133 ▼ Remove the Hard Drive Backplane Before you begin, complete these tasks: ■ Read the section, “Safety Informa tion” on page 63 . ■ Power off the server , usi[...]

Ser vicing Field-Replaceable Units 137 4. Lift the backp lane up and o ut of the system. ▼ Install the Har d Drive Backplane 1. Lower the hard drive backpl ane into the system. Align the tab on the lower ed ge the backplane wi th the corresponding slot in the chassis floor .[...]

138 SPARC Enterprise T5440 Server Service Manual • June 2011 2. T ighten the three captive No. 2 Phillips screws. 3. Plug the cable into its connector on t he backplane. 4. Install the flex cable retainer . Place the retainer into position and ti ghten the captive No.2 Phillips screw . Next Steps ■ “Install the Fan T ray Carriage” on pag e [...]

Ser vicing Field-Replaceable Units 139 Servicing the Motherboar d Note – If you are r eplacing faulty motherboard, you must set diag_mode to normal or off before performing this procedur e. This topic includes the following: ■ “Remove the Motherboard” on page 139 ■ “Install the Motherboar d” on page 142 ■ “Motherboard Fastener Loc[...]

140 SPARC Enterprise T5440 Server Service Manual • June 2011 ■ “Remove the Service Pr ocessor” on page 124 ■ “Remove a CMP/Memory Module” on page 104 Note – Y ou must remove all CMP and memory modules. ■ “Remove a Fan T ray” on page 87 Note – Y ou must remove all four fan trays. ■ “Remove the Fan T ray Carriage” on pag[...]

Ser vicing Field-Replaceable Units 141 2. Remove the flex cable retainer . Loosen the captive No.2 Phillips screw an d lift the r etainer up and out of the chassis. 3. Unplug the flex cable from J9801 on the motherboard. 4. Unplug the au xiliary power cab l e from J9803 on the motherboard. 5. Unplug the front I/O connector from J9901 on the motherb[...]

142 SPARC Enterprise T5440 Server Service Manual • June 2011 ▼ Install the Motherboard 1. Ensure that all 14 captive scr ews in the motherboard are retracted. 2. Lower the motherboard down into the chassis. Guide the flex cable connector thr ough the midwall partition. 3. Secure the No. 2 captive Phillips screws. Ensure that a ll fasteners ar e[...]

Ser vicing Field-Replaceable Units 143 Next Steps ■ “Install the Fan T ray Carriage” on page 134 ■ “Install a Fan T ray” on page 88 Note – Install all four fan trays. ■ “Install a CMP/Memory Module” on page 105 Note – Install all CMP and memory modul es. ■ “Install the Service Pr ocessor” on page 126 ■ “Install a PCI[...]

144 SPARC Enterprise T5440 Server Service Manual • June 2011 Related Information ■ “Servicing the Motherboard” on page 139 Servicing the Flex Cable Assembly The flex cabl e assembly p rovides the powe r and data connection between the power supply backplane, hard drive backplane, and motherboard. This topic includes the followin g: ■ “R[...]

Ser vicing Field-Replaceable Units 145 Related Information ■ “Safety Information” on page 63 ■ “Servicing Power Suppl ies” on page 89 ■ “Servicing the Power Distri bution Board” on page 130 ■ “Servicing the Har d Drive Backplane” on page 135 ■ “Servicing the Motherboar d” on page 139 ▼ Remove the Flex Cable Assembly [...]

146 SPARC Enterprise T5440 Server Service Manual • June 2011 3. Unplug the flex cable-to-power supply backplane conn ection. 4. Unplug the flex cable-to-h ard dri ve backplane connection. 5. Unplug the flex cable-to -DVD-ROM drive connection. 6. Unplug the flex cable- to-motherboard connection. 7. Lift the flex cable up and out of the system. ▼[...]

Ser vicing Field-Replaceable Units 147 6. Install the flex cable retainer . Place the retainer into position and ti ghten the captive No. 2 Phillips scr ew . 7. Plug in the pow er cables. Next Steps ■ “Install the T op Cover” on page 154 ■ “Slide the Server Into the Rack” on page 155 ■ “Power On the Server” on page 157[...]

148 SPARC Enterprise T5440 Server Service Manual • June 2011 Servicing the Fr ont Control Panel The front contr ol panel contains system status LEDs and the Power button. This topic includes the followin g: ■ “Remove the Front Contr o l Panel” on page 148 ■ “Install the Front Contr ol Panel” on page 149 Related Information ■ “Infr[...]

Ser vicing Field-Replaceable Units 149 4. Lift the front control panel up and out of the system. 5. Place the front control panel on an antistatic mat. ▼ Install the Fr ont Control Panel 1. Lower the front con trol panel into the system.[...]

150 SPARC Enterprise T5440 Server Service Manual • June 2011 2. Install the two No. 2 Phillips screws. 3. Plug the front control panel connector into the front I/O board. 4. Plug the front control panel connector into J9901 on the motherboard. Next Steps ■ “Install the Fan T ray Carriage” on pag e 134 ■ “Install a Fan T ray” on page 8[...]

Ser vicing Field-Replaceable Units 151 ■ “Remove the Server From the Rack” on page 71 ■ “Perform Electr ostatic Dischar ge – Antistatic Pr evention Measure s” on page 73 ■ “Remove the T op Cover” on page 73 ■ “Remove a Fan T ray” on page 87 ■ “Remove the Fan T ray Carriage” on page 133 1. Unpl ug the front control pa[...]

152 SPARC Enterprise T5440 Server Service Manual • June 2011 Next Steps ■ “Install the Fan T ray Carriage” on pag e 134 ■ “Install a Fan T ray” on page 88 ■ “Install the T op Cover” on page 154 ■ “Install the Server Into the Rack” on page 154 ■ “Connect the Power Cords to the Server” on page 157 ■ “Power On the S[...]

153 Returning the Server to Operation These topics describe how to return the se rver to operation after you have performed service procedur es. Caution – Never attempt to run the server wi th the cover removed. Hazardous voltage is pres ent. Caution – Equipment damage could occur if yo u run the server with the cover removed. The cover must be[...]

154 SPARC Enterprise T5440 Server Service Manual • June 2011 ▼ Install the T o p Cover If you removed the top cover , perform t he steps in this procedure. Note – If removing the top cover caused an emergency shutdown, you must in stall the top cover and use the poweron command to restart the syste m. See “Power On the Server” on page 157[...]

Returning the Server t o Operation 155 2. Lift the server up and insert the inne r rails into the inner slide assemblies. Ensure that the inner rails ar e horizontal when the inner rails enter the inner slide assemblies. 3. Ensure that the inner r ails are engaged wit h the ball-bearing retainers on both inner slide assemblies. Note – If necessar[...]

156 SPARC Enterprise T5440 Server Service Manual • June 2011 FIGURE: Sliding the server into the rack. 2. While pushing on the release buttons, slowly push the server into the rack. Ensure that the cables do not get in the way . 3. If necessary , re-attach the CMA. a. Attach the CMA support strut to the inner glide. b. Attach the CMA to the inner[...]

Returning the Server t o Operation 157 ▼ Connect the Power Cor ds to the Server ● Reconnect both power cords to the power supplies. Note – As soon as the power cords ar e connected, standby power is applied. Depending on the configuration of the firmware, the syste m might boot. See the SP ARC Enterprise T5440 Serv er Administration Guide for[...]

158 SPARC Enterprise T5440 Server Service Manual • June 2011[...]

159 Performing Node Reconfiguration If a CMP/memory module pair develops a fault, the server can be r econfigured to run in a deg raded state until the CMP/memo ry module is repla ced. In addition, you can add CMP/memory module pairs to ex isting systems. However , adding or removing CMP/memory modules might affect in te rn a l h ard wa re d e vi c[...]

160 SPARC Enterprise T5440 Server Service Manual • June 2011 ■ “Servicing CMP/Memory Modules” on pag e 102 ■ “Servicing FB-DIMMs” on pa ge 108 I/O Connections to CMP/Memory Modules Each PCIe slot and on board I/O devic e is connected to o ne CMP module. Device address is dependent on sy stem configuration. See CMP Number on page 168 a[...]

P erforming Node Reconfig uration 161 Recovering Fr om a Failed CMP/Memory Module This topic includes the following: ■ “Options for Recoveri ng From a Failed CMP/Memory Module” on pag e 1 61 ■ “Reconfiguring I/O Device Nodes” on page 162 ■ “Reset the LDoms Guest Configuration” on page 166 Options for Recovering Fr om a Failed CMP/[...]

162 SPARC Enterprise T5440 Server Service Manual • June 2011 ■ “Servicing FB-DIMMs” on pa ge 108 ■ “ I / O C o n n e c t i o n s t o C M P / M e mo ry Mo d u l es ” o n p ag e 1 6 0 ■ “Reconfiguring I/O Devi ce Nodes” on page 162 ■ “System Bus T opology” on page 167 ■ “I/O Fabric in 2P Configura tion” on page 168 ■[...]

P erforming Node Reconfig uration 163 ▼ Reconfigure the I/O and PCIe Fabric The reconfig.pl script reconfig ures the PCIe fabr ic to reconnect the PCIe slots and onboard devices to the CMP nodes as efficiently as possible. The reconfig.pl script also r econfigures the Solaris de vice names to match the new connections between the CMP modules and [...]

164 SPARC Enterprise T5440 Server Service Manual • June 2011 9. Do one of the following: ■ If your Jumpstart server is exporting Solaris 10 8/07 or Solaris 10 5/08, type: ■ If your Jumpstart server is exporting Solaris 10 10/08, type: 10. Run the reconfig.pl script. T ype: 1 1. H alt the system. T ype: 12. Power of f the system. For example, [...]

P erforming Node Reconfig uration 165 T o remotely disable all FB-DIMMs in the system, do the following: 1. Halt the Solaris OS. 2. P ower off t he sy ste m. 3. Disable each FB-DIMM. where x is the me mory module to be disabled. The followin g example shows how to disable all th e FB-DIMMs o n MEM1. ▼ Re-Enable All Memory Modules Now that the con[...]

166 SPARC Enterprise T5440 Server Service Manual • June 2011 wher e x is the CMP/memory module to be enabled. The following example shows how to enable all the FB-DI MMs on MEM1. ▼ Reset the LDoms Guest Configuration After reconfiguring the I/O and PCIe fabr ic, you must recreate your LDoms guest configurations, as hardwar e resources tha t had[...]

P erforming Node Reconfig uration 167 System Bus T o pology Related Information ■ “I/O Fabric in 2P Configuration” on page 168 ■ “I/O Fabric in 4P Configuration” on page 169[...]

168 SPARC Enterprise T5440 Server Service Manual • June 2011 I/O Fabric in 2P Configuration Related Information ■ “System Bus T opology” on page 167 ■ “I/O Fabric in 4P Configura tion” on page 169 CMP Number Devices Contro lled CMP0 Onboard disk drives Onboard USB po rts Onboard DVD dri ve PCIe0 PCIe1 PCIe2 PCIe3 CMP1 Onboard Gbi t or[...]

P erforming Node Reconfig uration 169 I/O Fabric in 4P Configuration Related Information ■ “System Bus T opology” on page 167 ■ “I/O Fabric in 2P Configuration” on page 168 CMP Number Devices Contr olled CMP0 Onboard disk dri ves Onboard USB ports Onboard DVD drive PCIe0 PCIe1 CMP1 Onboard Gbit or 10-Gbit network PCIe4 PCIe5 CMP2 PCIe2 [...]

170 SPARC Enterprise T5440 Server Service Manual • June 2011[...]

171 Identifying Connector Pinouts This section pr ovides refer ence informatio n about the system back panel ports an d pin assignments . Related Information ■ “Identifying Server Components” on p age 1 To p i c L i n k s Reference for s ystem connector pinouts “Serial Management Port Connector Pinouts ” on page 172 “Network Management [...]

172 SPARC Enterprise T5440 Server Service Manual • June 2011 Serial Management Port Connector Pinouts The serial management conn ector (labeled SERIAL MGT) is an RJ-45 connector located on the back panel. This port is th e default connection to the system console. Pin Signal Description Pin Signal Description 1 Request to Send 5 Ground 2 Data T e[...]

Identifying Conne ctor Pinouts 173 Network Management Port Connector Pinouts The network management connector (label e d N ET MG T ) i s a n R J- 45 c o n ne ct o r located on the motherboard and can be access ed from the back panel. This port needs to be configured prior to use. Pin Signal Description Pin Signal Description 1 T ransmit Data + 5 Co[...]

174 SPARC Enterprise T5440 Server Service Manual • June 2011 Serial Port Connector Pinouts The serial port connector (TTY A) is a DB-9 connector that can be accessed fr om the back panel. Pin Signal Description Pin Signal Description 1 Data Carrier Detect 6 Data Set Ready 2R e c e i v e D a t a 7R e q u e s t t o S e n d 3T r a n s m i t D a t a [...]

Identifying Conne ctor Pinouts 175 USB Connector Pinouts T wo Universal Serial Bus (USB) ports ar e located on the motherboar d in a double-stacked layout and can be accessed fr om the back panel. T wo additional USB ports are located on the front panel. Pin Signal Description Pi n Signal Description A1 +5 V (fused) B1 +5 V (fused) A2 USB0/1- B2 US[...]

176 SPARC Enterprise T5440 Server Service Manual • June 2011 Gigabit Ethernet Connector Pinouts Four RJ-45 Gigabit Ethernet connectors (NET0, NET1, NET2, NET3) are located on the system moth erboard and can be accessed fr om the back panel. The Ethernet interfaces operate at 10 Mbit/s ec, 100 Mbit/sec, and 1000 Mbit/sec. Pin Signal Description Pi[...]

177 Server Components These topics pr ovide illustrations depi ctin g components of SP ARC Enterprise T5440 server . Related Information ■ “Identifying Server Components” on p age 1 ■ “Servicing Customer -Replaceable Units” on pag e 75 ■ “Servicing Field -Replaceabl e Units” on page 1 19 Description Links A diagram and list of cus[...]

178 SPARC Enterprise T5440 Server Service Manual • June 2011 Customer -Replaceable Units FIGURE: Customer-Replaceable Units (CRUs) Figure Legend 1 CMP modules 5 F ront bezel 2 Memor y modules 6 Hard dr ives 3 Fa n t r ay s 7 P ower supplies 4 Re mova ble me di a dr i ve 8[...]

Ser ver Components 179 Related Information ■ “Hot-Pluggable and Hot-Swappable Devices” on page 75 ■ “Servicing Har d Drives” on page 76 ■ “Servicing Fan T rays” on page 84 ■ “Servicing Power Suppl ies” on page 89 ■ “Servicing CMP/Memory Modules” on page 102 ■ “Servicing FB-DIMMs” on page 108 ■ “Servicing the [...]

180 SPARC Enterprise T5440 Server Service Manual • June 2011 Field-Replaceable Units FIGURE: Field-Replaceable Units (FRUs) Figure Legend 1 CMP/memo ry module brack et 4 P ow er supply bac kplane 2 F an cage 5 Flex cable asse mbly 3 Hard drive bac kplane 6 Aux iliary power cable[...]

Ser ver Components 181 FIGURE: Field Replaceable Units (FRUs) (M otherboard and Auxiliary Boar ds) Related Information ■ “Servicing the Se rvice Pr ocessor” on page 124 ■ “Servicing the IDPROM” on pag e 127 ■ “Servicing the Battery ” on page 129 ■ “Servicing the Power Distri bution Board” on page 130 Figure Legend 1 IDPROM 4[...]

182 SPARC Enterprise T5440 Server Service Manual • June 2011 ■ “Servicing the Fan T ray Carriage” on p age 133 ■ “Servicing the Hard Drive Backplane” on page 135 ■ “Servicing the Motherboard” on page 139 ■ “Servicing the Flex Cabl e Assembly” on page 144 ■ “Servicing the Front Control Panel” on page 148 ■ “Servic[...]

183 Index Numerics 3.3V standby (power supply rail), 2 A AC Pr esent (power supply LE D), 15, 95 adding CMP/memo ry module, 105 FB-DIMMs, 1 13 PCIe car d, 98 addre sses, device and system configuration, 1 60 advanced ECC technology, 24 Advanced Lig hts Out Manage ment (ALOM) CMT connecting to, 25 airflow , bloc ked, 16 antistatic wrist strap, 65 AS[...]

184 SP ARC Enter prise T5440 Ser ver Service Manual • June 2011 consolehistory command, 59 D DC OK (power supply LED), 95 device identifiers CMP/memory modules, 10 7 fan tray, 88 FB-DIMMs, 116 hard drive, 83 PCIe card, 99 power supply, 94 diag_level parameter, 30, 6 2 diag_mode parameter, 30, 6 2 diag_trigger par amete r, 30 , 62 diag_verbosity p[...]

Inde x 185 example POST error output, 46 fault handling, 24 installing, 109 managi ng faults in, 1 10 re-enabling to run system in deg raded state, 165 re moving , 108 troublesho oting, 24 verifying successful r eplacement, 1 1 0 flex cable assembly installing, 146 re moving , 145 fmadm command, 54 , 1 1 2 fmdump command, 49 front bezel installing,[...]

186 SP ARC Enter prise T5440 Ser ver Service Manual • June 2011 hard driv e, 79, 82 hard driv e backplane, 137 IDPRO M, 128 motherboard, 142 PCIe card, 97 power distribution boar d, 1 32 power supply, 91, 9 3 service processor, 12 6 top cover, 154 Integrated Lights Out Manager and fault detection in External I/O Expansi on Unit, 18 iostat -E comm[...]

Inde x 187 installing, 97 rem ovi ng, 9 6 PCIe fabric r econfiguration, 163 pinouts Gigabit Ethe rnet ports, 1 76 network management port, 173 serial ma nagement p ort, 1 72 serial port (DB-9), 174 USB ports, 17 5 power cords plugging into server, 157 unplugging before servicing the system, 6 5 power distribution board about, 2 installing, 132 re m[...]

188 SP ARC Enter prise T5440 Ser ver Service Manual • June 2011 service processor, 12 4 reset command, 60 rese t, system using ILOM, 32 using POST commands, 32 resetsc command, 60 S safety information, 63 safety symbols, 64 sanity check for ha rdwar e componen ts, 22 SCC module and host ID, 2 and MAC addresses, 2 serial management port pinouts, 1[...]

Inde x 189 Power OK LED state, 15 using LEDs, 34 using O racle VTS , 15 using P OST, 15, 1 7 using the show faulty command, 15 U UltraSP ARC T2+ multicore pr ocessor, 2 1 Universal Unique Id entifier (UUID), 21, 49 USB ports front, 3 pinouts, 175 V virtual keyswitch, 3 1, 1 1 1 X XAUI card about, 1 configuration guidel ines, See PCIe c onfiguration[...]

190 SP ARC Enter prise T5440 Ser ver Service Manual • June 2011[...]