Fujitsu M4000/M5000 manual

SP ARC Enterprise M4000/M5000 Servers Installation Guide P ar t No .: 819-2211-14, Manual Code: C120-E351-07EN December 2010, Revision A[...]

Please Recycle Copyright © 2007, 2010, Oracle and/or its affiliates. All rights reserved. FUJITSU LIMITED provided technical input and review on portions of this material. Oracle and/or its affiliates and Fujitsu Limited each own or contr ol intellectual property rights relating to pr oducts and technology described in this document, and such pr[...]

Copyright © 2007, 2010, Oracle et/ou ses sociétés affiliées. T ous droits réservés. FUJITSU LIMITED a fourni et vérifié des données techniques de certaines parties de ce composant. Oracle et/ou ses sociétés affiliées et Fujitsu Limited détiennent et contrôlent chacune des droits de pr opriété intellectuelle relatifs aux pr oduit [...]

[...]

v Contents Preface ix 1. Installation Overview 1–1 1.1 Installation W orkflow 1–1 2. Preparing to Install the Server 2–1 2.1 Safety Precautions 2–1 2.2 Before Installing the Server 2–2 2.2.1 Facility Power 2–2 2.2.1.1 Facility Power Requirements and Characteristics 2–4 2.2.1.2 Grounding 2–7 2.2.2 Cable Connections 2–8 2.2.3 Checki[...]

vi SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010 3.3 Connecting the Administration Console 3–5 3.3.1 Connecting the Console 3–7 3.3.2 Initializing the XSCF Unit 3–9 3.4 Powering On the Server 3–10 3.4.1 V erifying the Configuration 3–1 1 3.4.2 Checking the Dual-Power Feed 3–15 3.5 Connecting Additional Periph[...]

Contents vii B.2.6 Using the fmstat Command B–8 B.3 T raditional Oracle Solaris Diagnostic Commands B–9 B.3.1 Using the iostat Command B–9 B.3.1.1 Options B–9 B.3.2 Using the prtdiag Command B–1 1 B.3.2.1 Options B–1 1 B.3.3 Using the prtconf Command B–14 B.3.3.1 Options B–14 B.3.4 Using the netstat Command B–16 B.3.4.1 Options B?[...]

viii SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010[...]

ix Pr eface This installation guide describes how to install and set up the SP ARC Enterprise M4000/M5000 servers from Oracle and Fujitsu. This document is intended for authorized service providers. Refer ences herein to the M4000 server or M5000 server are r eferences to the SP ARC Enterprise M4000 or SP ARC Enterprise M5000 server . This section [...]

x SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010 Book Titles Sun/Oracle Fujitsu SP ARC Enterprise M4000/M5000 Servers Site Planning Guide 819-2205 C120-H015 SP ARC Enterprise Equipment Rack Mounting Guide 819-5367 C120-H016 SP ARC Enterprise M4000/M5000 Servers Getting Started Guide * * All getting started guides ar e pri[...]

Preface xi T ext Conventions This manual uses the following fonts and symbols to express specif ic types of information. Notes on Safety Read the following documents thoroughly before using or handling any SP ARC Enterprise M4000/M5000 server . ■ SP ARC Enterprise M3000/M4000/M5000/M8000/M9000 Servers Important Legal and Safety Information ■ SP[...]

xii SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010 Documentation Feedback If you have any comments or requests r egar ding this document, go to the following web sites. ■ For Oracle users: http://docs.sun.com ■ For Fujitsu users in U.S.A., Canada, and Mexico: http://www.computers.us.fujitsu.com/www/support_servers.sht[...]

1-1 CHAPTER 1 Installation Overview This chapter provides the pr ocess for installing the servers. 1.1 Installation W orkf low Installing a server requir es the steps in FIGURE 1- 1 .[...]

1-2 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010 FIGURE 1-1 W orkflow Required for Installation Checking the cables and environmental conditions. “Before Installing the Server” on page 2-2 Connecting the console “Connecting the Administration Console” on page 3-5 Powering on the server “Powering On the Server?[...]

2-1 CHAPTER 2 Pr eparing to Install the Server This chapter describes the items you are requir ed to check, the environmental requir ements for installation, installation areas, and other related matters. It contains the following sections: ■ Section 2.1, “Safety Precautions” on page 2-1 ■ Section 2.2, “Before Installing the Server” on [...]

2-2 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010 ■ Be careful not to allow the ambient temperature to rise sharply in winter . Such a sudden temperature change would cause condensation to form inside the product. Allow for a suff icient warm-up period prior to operation. ■ Do not install the server near a copy machi[...]

Chapter 2 Preparing to Install the Ser ver 2-3 T ABLE 2-1 Electrical Specifications for the M4000 Server Parameter V alue Number of power cords 2 (1 power cord per power supply unit) Redundancy 1 + 1 redundant. Second power supply is redundant at 200 V AC Input current V oltage range 100–127 V AC 200–240 V AC Current, maximum 24.0A at 100–127[...]

2-4 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010 2.2.1.1 Facility Power Requirements and Characteristics For proper r edundancy your facility should have two independent power sources: Either circuit br eakers connected to separate power company utility feeds or UPS (uninterruptible power system). For power redundancy t[...]

Chapter 2 Preparing to Install the Ser ver 2-5 FIGURE 2-2 M5000 Server W ith Redundant PSU Connection PSU#0 Circuit breaker PSU#1 PSU#2 PSU#3 #3 #2 #1 #0[...]

2-6 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010 For a dual-power feed connection, connect the individual power cords separately to each AC power supply system. FIGURE 2-3 M4000 Server W ith Dual-power Feed Connection PSU#0 PSU#1 #0 #1 Circuit breaker Circuit breaker[...]

Chapter 2 Preparing to Install the Ser ver 2-7 FIGURE 2-4 M5000 Server W ith Dual-power Feed Connection 2.2.1.2 Grounding The system is shipped with grounding-type (thr ee-wire) power cor ds. Always connect the cords into gr ounded power outlets. Contact your facilities manager or a qualified electrician to determine what type of power is supplied [...]

2-8 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010 2.2.2 Cable Connections T ABLE 2-3 lists the powercor ds for the servers. Note – For servers that have the B-type plug, confirm that a 20A over current protection device is available outside the server . If one is not available, prepar e an external 20A overcurr ent pro[...]

Chapter 2 Preparing to Install the Ser ver 2-9 2.3 T ools and Equipment The following sections list the tools that are r equired to install the servers. The following tools are r equired to install the servers: ■ Screwdriver , Phillips No. 2 ■ Antistatic wrist strap ■ Antistatic mat ■ Ethernet cable of category 5 or higher ■ Console (one [...]

2-10 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010[...]

3-1 CHAPTER 3 Installing the Server This chapter describes how to install the server . It contains the following sections: ■ Section 3.1, “Checking Components” on page 3-1 ■ Section 3.2, “Connecting Input Power Cords” on page 3-2 ■ Section 3.3, “Connecting the Administration Console” on page 3-5 ■ Section 3.4, “Powering On the[...]

3-2 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010 2. Check for a model name and input format on the shipping list. If any of the items on the packing list are missing, incorrect, or damaged, contact your sales repr esentative. 3.2 Connecting Input Power Cor ds The servers are shipped with gr ounding-type (three-wir e) po[...]

Chapter 3 Installing the Server 3-3 3.2.1 Connecting a UPS Unit An uninterruptible power supply (UPS) unit is used to provide a stable supply of power to the system in the event of a power failure or an extensive power interruption. A UPS with an UPC interface can be connected to the UPC ports on the eXtended System Control facility unit (XSCFU or [...]

3-4 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010 FIGURE 3-1 M5000 Server Dual-power Feed UPC Connections 3.2.2 V erifying the Power Input Connections Before Applying Power ● Have the site electrician verify that the input power source fulf ills the power requirements. Refer to the SP ARC Enterprise M4000/M5000 Servers[...]

Chapter 3 Installing the Server 3-5 3.3 Connecting the Administration Console The serial port on the XSCF Unit is a RJ-45 interface port used to monitor the boot process and to modify the default settings. The port is monitored and conf igured using an administrative console connected to the serial port by a serial cable. Y ou can monitor and confi[...]

3-6 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010 FIGURE 3-2 Ports on XSCF Unit (M5000 Server Shown) Location Number Component 1 RCI P ort 2 Serial P or t 3 USB por t 4 LAN 1 (Ethernet#1) 5 4 2 7 6 1 3[...]

Chapter 3 Installing the Server 3-7 See Section A.1, “M4000 Server V iews” on page A-1 for the location of the XSCF Unit on the SP ARC Enterprise M4000 server . 3.3.1 Connecting the Console This section explains how to physically connect and configure the console. 1. Connect the administrative console to the serial port using the serial cable t[...]

3-8 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010 FIGURE 3-3 Operator Panel Mode Switch For more details on the operator panel see Section A.3, “Operator Panel Overview” on page A-9 . 4. T urn on the input power . Note – W ait at least 30 seconds before turning on the system power that you turned off, by pulling ou[...]

Chapter 3 Installing the Server 3-9 Note – If Step 10 is not performed within 1 minute the login certification will expire. 1 1. Conf irm that the XSCF Shell prompt is displayed on the administration console. 3.3.2 Initializing the XSCF Unit T o use full XSCF functionality , various settings need to be set. 1. Set the required settings. See secti[...]

3-10 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010 Note – setdualpowerfeed requir es a complete chassis power cycle (all power cords r emoved) to apply any changes. Make certain to allow 30 seconds before plugging the power cords back into the chassis. T o perform XSCF initial settings, use the XSCF default user accoun[...]

Chapter 3 Installing the Server 3-11 6. Conf irm that the POWER LED (green) on the operator panel is lit. 7. Check the POWER LED on each component. If the POWER LEDs are not lit see Appendix B for installation troubleshooting information. 8. Press and hold the Enter key , and press the “#.” (shift-3 and period) keys. These key combinations swit[...]

3-12 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010 2. T ype the showhardconf command with the -u option from the XSCF Shell. See the Section B.2.1, “Using the showhardconf Command” on page B-2 for details. 3. Use the console command to go to the ok prompt. XSCF> showhardconf -u SPARC Enterprise M5000; Memory_Size:[...]

Chapter 3 Installing the Server 3-13 4. From the ok prompt, use the probe-scsi-all command to conf irm that the storage devices are installed. 5. Use the show-devs command to conf irm that the PCI devices are installed. ok probe-scsi-all /pci@0,600000/pci@0/pci@8/pci@0/scsi@1 MPT Version 1.05, Firmware Version 1.07.00.00 Target 0 Unit 0 Disk SEAGAT[...]

3-14 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010 The show-devs command command output continued.. 6. Compare the conf iguration shown by showhardconf -u , probe-scsi-all, and show-devs with the shipping list. If the configuration is incorrect contact your sales r epresentative. 7. Boot the Oracle Solaris operating syst[...]

Chapter 3 Installing the Server 3-15 3.4.2 Checking the Dual-Power Feed If the dual-power feed option is used, follow the procedure below to conf irm that the system can operate even if one power feed is stopped. Note – Dual-Power Feed mode cannot be used with 100V power . 1. Conf irm that the system is powered on. 2. Switch off all main line swi[...]

3-16 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010[...]

4-1 CHAPTER 4 Connecting the Domains to the Network This chapter discusses how to establish a network for the servers. It contains the following sections: ■ Section 4.1, “Overview of Network Configuration” on page 4-1 ■ Section 4.2, “Connecting to the Network” on page 4-1 ■ Section 4.3, “V erifying the Network Connection” on page [...]

4-2 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010 ● Connect the network to the domains using an Ethernet cable. Y ou can connect to either the Gigabit Ethernet (GbE) port on the I/O unit or on an Ethernet card installed in the I/O unit. 4.3 V erifying the Network Connection 1. Check the LAN link lamp on the I/O Unit or[...]

A-1 APPENDIX A System V iews Appendix A provides views of the systems. This appendix has the following sections: ■ Section A.1, “M4000 Server V iews” on page A-1 ■ Section A.2, “M5000 Server V iews” on page A-5 ■ Section A.3, “Operator Panel Overview” on page A-9 A.1 M4000 Server V iews FIGURE A-1 shows the M4000 server[...]

A-2 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010 FIGURE A-1 M4000 Server Component Locations 1 2 5 11 13 14 17 16 37 35 36 28 27 26 21 12 29 30 31 35 34 33 32 4 15 7 8 9 10 3 6 22 24 23 25 40 41 38 39 19 18 20[...]

Appendix A System Views A-3 Location Number Component 1 60-mm fan (F AN_B#0) 2 60-mm fan (F AN_B#1) 3 T op cover 4 Fan cover 5 Backplane Unit (BPU_A - includes IOBP , Power distribution board) 6 172-mm fan backplane (F ANBP_A) 7 60-mm fan backplane (F ANBP_B) 8 T ape drive backplane (T APEBP) 9 Hard disk drive backplane (HDDBP#0) 10 CD-R W/DVD-R W [...]

A-4 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010 30 Memory board (MEMB#1) 31 Memory board (MEMB#0) 32 PCI slot (IOU#0 PCI#0) 33 PCI slot (IOU#0 PCI#1) 34 PCI slot (IOU#0 PCI#2) 35 PCI slot (IOU#0 PCI#3) 36 PCI slot (IOU#0 PCI#4) 37 eXtended System Control facility unit (XSCFU) 38 I/O Unit (IOU#0) 39 DC-DC Converter Rise[...]

Appendix A System Views A-5 A.2 M5000 Server V iews FIGURE A-2 shows the M5000 server .[...]

A-6 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010 FIGURE A-2 M5000 Server Component Locations 1 54 17 19 46 2 3 4 5 6 8 7 9 10 16 18 20 21 22 23 24 25 26 41 42 43 45 44 36 37 39 38 40 27 55 56 57 58 59 60 62 61 11 12 13 14 15 47 48 49 50 51 52 53 29 28 30 31 32 33 34 35[...]

Appendix A System Views A-7 Location Number Component 1 T op cover 2 CPU module (CPUM#0) 3 CPU module (CPUM#1) 4 CPU module (CPUM#2) 5 CPU module (CPUM#3) 6 172-mm fan (F AN_A#1) 7 172-mm fan (F AN_A#0) 8 172-mm fan (F AN_A#3) 9 172-mm fan (F AN_A#2) 10 Backplane unit (BPU_B - includes IOBP , Power distribution board, bus bar) 1 1 172-mm fan backpl[...]

A-8 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010 29 DC-DC Converter Riser (DDCR IOU#0 Not shown) 30 DC-DC Converter (DDC_B on DDCR on IOU#0) 31 DC-DC Converter (DDC_A IOU#0 Not shown) 32 I/O Unit (IOU#1) 33 DC-DC Converter Riser (DDCR IOU#1 Not shown) 34 DC-DC Converter (DDC_B on DDCR on IOU#1) 35 DC-DC Converter (DDC_A[...]

Appendix A System Views A-9 A.3 Operator Panel Overview When no network connection is available the operator panel is used to start or stop the system. The operator panel displays three LED status indicators, a power switch, and a security keyswitch. The panel is located on the front of the system, in the upper right. When the system is running the[...]

A-10 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010 FIGURE A-3 M4000 Server Operator Panel FIGURE A-4 shows the M5000 server operator panel. Location Number Component 1 POWER LED 2 XSCF ST ANDBY LED 3 CHECK LED 4 Power switch 5 Mode switch (keyswitch) 6 Antistatic ground socket 1 2 3 4 5 6[...]

Appendix A System Views A-11 FIGURE A-4 M5000 Server Operator Panel Location Number Component 1 POWER LED 2 XSCF ST ANDBY LED 3 CHECK LED 4 Power switch 5 Mode switch (keyswitch) 6 Antistatic ground socket 1 2 3 4 5 6[...]

A-12 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010 During startup, the firmwar e toggles the front panel LEDs on and of f to verify that each one is working correctly . After that, the front panel LEDs operate as described in T ABLE A-1 . T ABLE A-1 Operator Panel LEDs and Switches Icon Name Color Description POWER LED G[...]

Appendix A System Views A-13 The following table provides the meanings of the mode switch. T ABLE A-2 Meanings of the Mode Switch Function Mode Switch State Def inition Locked Service Inhibition of Break Signal Reception Enabled. Reception of the br eak signal can be enabled or disabled for each domain using setdomainmode . Disabled Power On/Off by[...]

A-14 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010[...]

B-1 APPENDIX B Fault Isolation This chapter describes basic fault isolation information related to installation of the SP ARC Enterprise M4000/M5000 servers from Oracle and Fujitsu. This appendix has the following sections: ■ Section B.1, “Corrective Actions to Common Problems” on page B-1 ■ Section B.2, “Using the Diagnostic Commands” [...]

B-2 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010 ■ Refer to the SP ARC Enterprise M4000 /M5000 Servers Service Manual for LED status. B.2 Using the Diagnostic Commands The following commands are detailed in this section. ■ Section B.2.1, “Using the showhardconf Command” on page B-2 ■ Section B.2.2, “Using th[...]

Appendix B F ault Isolation B-3 An example of the showhardconf output. . XSCF> showhardconf SPARC Enterprise M5000; + Serial:BCF07500B6; Operator_Panel_Switch:Locked; + Power_Supply_System:Dual; SCF-ID:XSCF#0; + System_Power:On; System_Phase:Cabinet Power On; Domain#0 Domain_Status:Initialization Phase; Domain#1 Domain_Status:Initialization Phas[...]

B-4 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010 showhardconf output continued. Refer to the showhardconf man page for more information. DDC_A#0 Status:Normal; DDC_A#1 Status:Normal; DDC_A#2 Status:Normal; DDC_A#3 Status:Normal; DDC_B#0 Status:Normal; DDC_B#1 Status:Normal; IOU#0 Status:Normal; Ver:0101h; Serial:BF07486[...]

Appendix B F ault Isolation B-5 B.2.2 Using the showlogs Command The showlogs command displays the contents of a specified log in or der of timestamp starting with the oldest date. The showlogs command displays the following logs: ■ error log ■ power log ■ event log ■ temperature and humidity recor d ■ monitoring message log ■ console m[...]

B-6 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010 B.2.3 Using the showstatus Command The showstatus displays the information concerning the server ’s degraded FRUs. An asterisk (*) which indicates that the unit has been degraded is displayed along with any of the following states: ■ Normal ■ Faulted ■ Degraded ?[...]

Appendix B F ault Isolation B-7 At least three lines of new output are deliver ed to the user with the -V option: ■ The first line is a summary of information you have seen before in the console message but includes the timestamp, the UUID, and the Message-ID. ■ The second line is a declaration of the certainty of the diagnosis. In this case yo[...]

B-8 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010 B.2.5.1 fmadm config Command The fmadm config command output shows the version numbers of the diagnosis engines in use by your server , as well as their current state. Y ou can check these versions against information on the My Oracle Support website to determine if you a[...]

Appendix B F ault Isolation B-9 B.3 T raditional Oracle Solaris Diagnostic Commands These superuser commands can help you determine if you have issues in your server , in the network, or within another server that you are networking with. The following commands are detailed in this section. ■ Section B.3.1, “Using the iostat Command” on page [...]

B-10 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010 The following example shows output for one iostat command. -e Displays device error summary statistics. The total errors, har d errors, soft err ors, and transport errors are displayed. Provides a short table with accumulated errors. Identif ies suspect I/O devices. -E D[...]

Appendix B F ault Isolation B-11 B.3.2 Using the prtdiag Command The prtdiag command displays configuration and diagnostic information. The diagnostic information identifies any failed component. The prtdiag command is located in the /usr/platform/ platform-name /sbin/ directory . Note – The prtdiag command might indicate a slot number different [...]

B-12 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010 The following example shows output for the prtdiag command in verbose mode. # prtdiag -v System Configuration: xxxx Server System clock frequency: 1012 MHz Memory size: 262144 Megabytes ==================================== CPUs ==================================== CPU CP[...]

Appendix B F ault Isolation B-13 prtdiag -v output continued. IO Lane/Frq LSB Type LPID RvID,DvID,VnID BDF State Act, Max Name Model Logical Path ------------ 00 PCIx 0 2, 50, 1000 5, 1, 0 okay --, 133 scsi-pci1000,50 LSI,1064 /pci@0,600000/pci@0/pci@8/pci@0/scsi@1 00 PCIx 0 10, 1648, 14e4 5, 2, 0 okay --, 133 network-pci14e4,1648 NA /pci@0,600000/[...]

B-14 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010 B.3.3 Using the prtconf Command Similar to the show-devs command run at the ok prompt, the prtconf command displays the devices that are configur ed. The prtconf command identifies har dware that is r ecognized by the Oracle Solaris OS. If hardwar e is not suspected of b[...]

Appendix B F ault Isolation B-15 The following example shows output for the prtconf command. # prtconf System Configuration: xxxx Memory size: 1024 Megabytes System Peripherals (Software Nodes): SUNW,Sun SPARC packages (driver not attached) SUNW,builtin-drivers (driver not attached) deblocker (driver not attached) disk-label (driver not attached) t[...]

B-16 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010 B.3.4 Using the netstat Command The netstat command displays the network status. B.3.4.1 Options T ABLE B-6 describes options for the netstat command and how those options can help troubleshooting. The following example shows output for the netstat -p command. T ABLE B-6[...]

Appendix B F ault Isolation B-17 B.3.5 Using the ping Command The ping command sends ICMP ECHO_REQUEST packets to network hosts. Depending on how the ping command is configur ed, the output displayed can identify troublesome network links or nodes. The destination host is specified in the variable hostname . B.3.5.1 Options T ABLE B-7 describes opt[...]

B-18 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010 The following example shows output for the ping -s command. B.3.6 Using the ps Command The ps command lists the status of processes. Using options and rearranging the command output can assist in determining the resource allocation. B.3.6.1 Options T ABLE B-8 describes o[...]

Appendix B F ault Isolation B-19 Note – When using sort with the -r option, the column headings are printed so that the value in the first column is equal to zer o. B.3.7 Using the prstat Command The prstat utility iteratively examines all active processes and reports statistics based on the selected output mode and sort order . The prstat comman[...]

B-20 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010 B.3.7.1 Options T ABLE B-9 describes options for the prstat command and how those options can help troubleshooting. The following example shows output for the prstat command. T ABLE B-9 Options for prstat Option Description How It Can Help No option Displays a sorted lis[...]