Sun Microsystems CP3220 manual

Sun Microsystems, Inc. www .sun.com Submit comments about this document at: http://www.sun.com/hwdocs/feedback Sun Netra ™ CP3220 Blade Ser v er User’ s Guide P ar t No . 820-1982-12 January 2010, Revision 01[...]

Please Recycle Copyright © 2010 Sun Microsystems, Inc., 4150 Network Cir cle, Santa Clara, California 95054, U.S.A. All rights reserved. This distribution may include materials developed by third parties. Parts of the product may be derived fr om Berkeley BSD systems, licensed from the University of California. UNIX is a r egistered trademark in t[...]

iii Contents Preface xv 1. Introduction 1–1 1.1 Overview 1–2 1.2 Features 1–2 1.3 Physical Description 1–3 1.3.1 Front Panel Components 1–3 1.3.2 Blade Server Diagram 1–6 1.4 System Configurations 1–7 1.4.1 AMC Modules 1–7 1.4.2 Advanced Rear T ransition Module 1–8 1.5 Hot-Swap Support 1–12 1.6 System Components 1–12 1.6.1 Req[...]

iv Sun Netra CP3220 Blade Server User’s Guide • January 2010 2. Hardware Installation and Service 2–1 2.1 Safety and T ool Requirements 2–2 2.1.1 Equipment and Operator Safety 2–2 2.1.2 Materials and T ools Required 2–3 2.2 Installing the Blade Server 2–3 2.2.1 Preparing for the Installation 2–3 2.2.1.1 Check Power , Thermal, Enviro[...]

Contents v 2.3.4 Powering On the System 2–18 2.3.5 Automatic Power-Of f Events 2–18 2.3.6 Servicing DIMMs 2–19 2.3.6.1 DIMM Requirements 2–19 2.3.6.2 Installing a DDR2 DIMM 2–21 2.3.6.3 Removing a DDR2 DIMM 2–22 2.3.7 Installing the Optional Compact Flash Card 2–24 2.3.8 Installing Optional AMC Cards 2–26 2.3.9 Adding or Replacing a[...]

vi Sun Netra CP3220 Blade Server User’s Guide • January 2010 4. Conf iguring and Using BIOS Firmware 4–1 4.1 About BIOS Settings 4–2 4.1.1 Navigating BIOS Screens 4–2 4.1.2 BIOS Considerations 4–2 4.1.2.1 BIOS Option ROMs on the Sun Netra CP3220 Blade Server 4–2 4.1.2.2 AMD PowerNow! Feature Enabled by Default 4–3 4.1.3 Description [...]

Contents vii 5.4.5 Broadcom 5715C Gigabit Ethernet 5–6 5.4.6 Sun Dual 10-Gbit Ethernet/Quad 1-Gbit RGMII Network Interface Chip (Sun 10 GbE Multithreaded Networking ASIC) 5–7 5.5 I/O Components 5–7 5.5.1 AMC Slots 5–7 5.5.2 EIDE/A T A for Compact Flash 5–8 5.5.3 SAS/SA T A 5–8 A. Physical Characteristics A–1 A.1 Form Factor A–2 A.2 [...]

viii Sun Netra CP3220 Blade Server User’s Guide • January 2010[...]

ix Figur es FIGURE 1-1 Sun Netra CP3220 Dual-Core Blade Server (Front View) 1–4 FIGURE 1-2 Sun Netra CP3220 Quad-Core Blade Server (Front View) 1–5 FIGURE 1-3 Sun Netra CP3220 Blade Server (Component Side View) 1–6 FIGURE 1-4 Sun Netra CP3220 Blade Server in Shelf Enclosure 1–7 FIGURE 1-5 Sun Netra CP32x0 SAS Storage Advanced Rear Transitio[...]

x Sun Netra CP3220 Blade Server User’s Guide • January 2010 FIGURE 4-1 BIOS Main Menu 4–6 FIGURE 4-2 Boot Settings Menu 4–7 FIGURE 4-3 Boot Device Priority Menu 4–8 FIGURE 4-4 Security Settings Menu 4–10 FIGURE 4-5 Change Password Menu 4–10 FIGURE 5-1 Block Diagram 5–2 FIGURE 5-2 AMD Opteron Processors Block Diagram 5–4 FIGURE A-1[...]

Figures xi FIGURE B-18 Boot Device Priority Menu B–11 FIGURE B-19 Boot Hard Disk Drive Priority Menu B–11 FIGURE B-20 Security Settings Menu B–12 FIGURE B-21 Change Password Settings Menu B–12 FIGURE B-22 Chipset Main Menu B–13 FIGURE B-23 NorthBridge Chipset Configuration Menu B–13 FIGURE B-24 NorthBridge Chipset Memory Configuration M[...]

xii Sun Netra CP3220 Blade Server User’s Guide • January 2010[...]

xiii T ables TABLE 1-1 I/O Configurations 1–11 TABLE 2-1 Local Area Network Information 2–5 TABLE 2-2 Netinstall Boot Device Table 2–15 TABLE 2-3 Extra MAC Addresses for Virtual LAN Configuration 2–16 TABLE 2-4 Pin Functions on Jumper 1 2–30 TABLE 4-1 BIOS Setup Screens Summary 4–3 TABLE 4-2 POST Options 4–15 TABLE A-1 Airflow Require[...]

xiv Sun Netra CP3220 Blade Server User’s Guide • January 2010[...]

xv Pr eface The Sun Netra CP3220 Blade Server User ’ s Guide describes the hardware specif ications, function, and physical properties of the Sun Netra™ CP3220 blade server . It also provides detailed information on the system firmwar e. The Sun Netra CP3220 Blade Server User ’ s Guide is written for system integration engineers, field applic[...]

xvi Sun Netra CP3220 Blade Server User’s Guide • January 2010 Using UNIX Commands This document might not contain information about basic UNIX ® commands and procedur es such as shutting down the system, booting the system, and configuring devices. Refer to the following for this information: ■ Software documentation that you received with y[...]

Preface xvii T ypographic Conventions Related Documentation The following table lists the documentation for this product. Except for the Important Safety Information for Sun Hardware Systems , all the documents listed are available online at: http://docs.sun.com/app/docs/prod/cp3220.brd#hic T ypeface * * The settings on your browser might differ fr[...]

xviii Sun Netra CP3220 Blade Server User’s Guide • January 2010 Documentation, Support, and T raining Thir d-Party W eb Sites Sun is not responsible for the availability of third-party web sites mentioned in this document. Sun does not endorse and is not responsible or liable for any content, advertising, products, or other materials that are a[...]

1-1 CHAPTER 1 Intr oduction This chapter provides an overview of the features, conf igurations, and system requir ements of the Sun Netra CP3220 blade server . This chapter contains the following topics: ■ Section 1.1, “Overview” on page 1-2 ■ Section 1.2, “Features” on page 1-2 ■ Section 1.3, “Physical Description” on page 1-3 ?[...]

1-2 Sun Netra CP3220 Blade Server User’s Guide • January 2010 1.1 Overview The Sun Netra CP3220 blade server is a high-performance, single-board computer based on an AMD Opteron X64 pr ocessor . The blade server is designed for high availability in a switched network computing environment. This blade server is compliant with Advanced T elecommu[...]

Chapter 1 Introduction 1-3 ■ E-IDE master to support one Compact Flash socket supporting up to 16-Gbyte user flash (accessible when blade is r emoved from chassis) ■ Management support using on-board IPM contr oller (Renesas H8) that provides a dual IPMB bus and IPMI redundant channels ■ Rear I/O expansion provided to an optional R TM, compat[...]

1-4 Sun Netra CP3220 Blade Server User’s Guide • January 2010 FIGURE 1-1 Sun Netra CP3220 Dual-Cor e Blade Server (Front V iew) Figure Legend 1 Locking screws 6 Reset button 2 Latches 7 10/100/1000 Ethernet management port 3 Out-of-service (OOS) LED 8 Serial port 4 OK LED 9 USB ports 5 AMC card slots RES ET[...]

Chapter 1 Introduction 1-5 FIGURE 1-2 Sun Netra CP3220 Quad-Cor e Blade Server (Front V iew) Figure Legend 1 Locking screws 6 Reset button 2 Latches 7 10/100/1000 Ethernet management port 3 Out-of-service (OOS) LED 8 Serial port 4 OK LED 9 USB ports 5 AMC card slots[...]

1-6 Sun Netra CP3220 Blade Server User’s Guide • January 2010 1.3.2 Blade Server Diagram FIGURE 1-3 Sun Netra CP3220 Blade Server (Component Side V iew) Figure Legend 1 Compact Flash card 4 Zone 1 power connector 2 Zone 3 connectors 5 CPU Heatsink 3 Zone 2 connectors 6 DIMMs[...]

Chapter 1 Introduction 1-7 1.4 System Conf igurations Sun Netra CP3220 blade servers can be installed into an A TCA shelf (chassis), as shown in FIGURE 1-4 . The blade servers can be deployed in various electrical configurations to suit user r equirements. For example, the blade server can be configur ed to boot from a network as a diskless client [...]

1-8 Sun Netra CP3220 Blade Server User’s Guide • January 2010 1.4.2 Advanced Rear T ransition Module Y ou can install an optional Sun Netra CP32x0 Advanced Rear T ransition Module (AR TM) ( FIGURE 1-5 ) into the rear of the A TCA shelf, opposite the Sun Netra CP3220 blade server ( FIGURE 1-6 ). The Sun Netra CP32x0 SAS Storage Advanced Rear T r[...]

Chapter 1 Introduction 1-9 Note – Use only serial cables that are less than 10 meters in length. FIGURE 1-6 shows the physical relationship between the Sun Netra CP3220 blade server , the AR TM, and the backplane in a typical A TCA system. Figure Legend 1 Serial port 2 10/100/1000 MBASE-T management port 3 External SAS port (secondary) 4 External[...]

1-10 Sun Netra CP3220 Blade Server User’s Guide • January 2010 FIGURE 1-6 Sun Netra CP3220 Blade Server , Backplane, and Relationship to AR TM Note – When using the Sun Netra CP32x0 AR TM with the Sun Netra CP3220 blade server , use shielded cables of less than 10 meters in length for serial I/O ports. Caution – Y ou must use shielded cable[...]

Chapter 1 Introduction 1-11 10/100/1000BASE-T per second Ethernet RJ-45 port from the host to the rear of the system. This port can be used to accomplish, optionally , a network boot as a diskless client. The other configurations requir e IHV hardware. T ABLE 1-1 I/O Conf igurations I/O Hard ware Required Description Ethernet Sun Netra CP32x0 AR TM[...]

1-12 Sun Netra CP3220 Blade Server User’s Guide • January 2010 1.5 Hot-Swap Support In general, the hot-swap process includes the orderly connection of the har dware and software. The pr ocess uses hardwar e connection control to connect the hardware in an orderly sequence. The pr ocess includes the use of pins of differ ent lengths to accompli[...]

Chapter 1 Introduction 1-13 Caution – Y ou can damage the Sun Netra CP3220 blade server components if you install the blade server in a chassis that does not provide suff icient cooling. For more information, see Section 2.2.1.1, “Check Power , Thermal, Environmental, and Space Requirements” on page 2-4 . Note – Use only shielded serial cab[...]

1-14 Sun Netra CP3220 Blade Server User’s Guide • January 2010 1.7 T echnical Support and W arranty Should you have any technical questions or support issues that are not addressed in the Sun Netra CP3220 blade server documentation set or on the technical support web site, contact your local Sun Services repr esentative. This hardwar e carries [...]

Chapter 1 Introduction 1-15 FIGURE 1-7 Sun Netra CP3220 Blade Server Bar code Labeling P ar t number label Ser ial number label[...]

1-16 Sun Netra CP3220 Blade Server User’s Guide • January 2010[...]

2-1 CHAPTER 2 Har dware Installation and Service This chapter describes the Sun Netra CP3220 blade server hardwar e installation and service procedur es. This chapter contains the following topics: ■ Section 2.1, “Safety and T ool Requirements” on page 2-2 ■ Section 2.2, “Installing the Blade Server” on page 2-3 ■ Section 2.3, “Serv[...]

2-2 Sun Netra CP3220 Blade Server User’s Guide • January 2010 2.1 Safety and T ool Requir ements 2.1.1 Equipment and Operator Safety Refer to the Important Safety Information for Sun Hardware Systems (816-7190) for general safety information. Read the following safety statements that are specific to the Sun Netra CP3220 blade server carefully b[...]

Chapter 2 Hardware Installation and Ser vice 2-3 The grounded mat or the chassis must be connected to a facility ground to prevent a f loating ground. ■ Keep blade servers in the antistatic bags until they are needed. ■ Remove a blade server from its antistatic bag only when wearing a properly connected ground strap. ■ Place blade servers tha[...]

2-4 Sun Netra CP3220 Blade Server User’s Guide • January 2010 4. V erify that local area network (LAN) preparations are completed (see Section 2.2.1.2, “Local Network IP Addresses and Host Names W orksheet” on page 2-5 ). 5. Ensure that the host names and their network IP addresses ar e allocated and register ed at the site. Record this inf[...]

Chapter 2 Hardware Installation and Ser vice 2-5 2.2.1.2 Local Network IP Addresses and Host Names W orksheet Collect the information listed in T ABLE 2-1 to connect hosts to the LAN. Ask your network administrator for help, if necessary . This information is not needed for a stand-alone installation. Y ou may need the MAC (Ethernet) addresses of t[...]

2-6 Sun Netra CP3220 Blade Server User’s Guide • January 2010 2.2.1.3 Installation Procedur e Summary This section summarizes the high-level procedures that ar e required to install the Sun Netra CP3220 blade server . Ensur e that you are familiar with the information in Section 2.2.2, “Configuring the Hardware” on page 2-6 through the end [...]

Chapter 2 Hardware Installation and Ser vice 2-7 2.2.2.1 V erify Chassis Fan T ray Upgrade Caution – The Sun Netra CT 900 server fan tray upgrade kit (594-4953) must be installed in the chassis before the Sun Netra CP3220 blade server is installed. This fan tray upgrade is requir ed to provide adequate cooling and pr event the system from over he[...]

2-8 Sun Netra CP3220 Blade Server User’s Guide • January 2010 2.2.2.3 Configuring the Advanced Rear T ransition Module Hardwar e If you are using a Sun Netra CP32x0 Advanced Rear T ransition Module (ARTM), refer to the appr opriate documentation. See Section , “Related Documentation” on page -xvii . Y ou can also see Section A.3, “Connect[...]

Chapter 2 Hardware Installation and Ser vice 2-9 FIGURE 2-1 Installing the Sun Netra CP32x0 AR TM[...]

2-10 Sun Netra CP3220 Blade Server User’s Guide • January 2010 ▼ T o Install an AR TM 1. V erify that you have taken the necessary antistatic precautions. See Section 2.1.1, “Equipment and Operator Safety” on page 2-2 . 2. From the rear of the system, choose an appropriate slot for the AR TM. The AR TM must be installed, inline, behind a [...]

Chapter 2 Hardware Installation and Ser vice 2-11 FIGURE 2-2 Injector/Ejector Latch and Locking Scr ew on the ARTM 6. Carefully align the edges of the AR TM with the card guides in the appropriate slot. Look into the enclosure to verify corr ect alignment of the rails in the guides. 7. Keep the AR TM aligned in the guides, and slide the AR TM in un[...]

2-12 Sun Netra CP3220 Blade Server User’s Guide • January 2010 10. Install the Sun Netra CP3220 blade server into the front of the A TCA shelf in the corresponding slot. See Section 2.2.3.2, “Installing the Blade Server Into the Shelf” on page 2-12 for instructions. 2.2.3.2 Installing the Blade Server Into the Shelf Note – Y ou can instal[...]

Chapter 2 Hardware Installation and Ser vice 2-13 2.2.4 Connecting External I/O Cables Front panel ports ar e typically used for maintenance and troubleshooting purposes in installed and running systems. External I/O cables are connected to the Sun Netra CP3220 blade server or to the Sun Netra CP32x0 ARTM. T o connect each of these following cables[...]

2-14 Sun Netra CP3220 Blade Server User’s Guide • January 2010 FIGURE 2-3 Serial Port on the Sun Netra CP3220 Blade Server 3. Use one of the following to establish a full-duplex serial terminal connection with the Sun Netra CP3220 blade server: ■ The tip utility ■ The minicom utility Serial por t RES ET[...]

Chapter 2 Hardware Installation and Ser vice 2-15 ■ A telnet utility (Connect to the proper port on a Network T erminal Server to which the Sun Netra CP3220 is connected.) ■ Another suitable serial communications program on the system console For example, if you are using a UNIX system as the system console, at the UNIX prompt in a command tool[...]

2-16 Sun Netra CP3220 Blade Server User’s Guide • January 2010 The Sun Netra CP3220 blade server supports virtual LAN configuration for the Sun 10 GbE Multithreaded Networking ASIC ports (MAC addresses 4, 5, 6, and 7). When configur ed, the virtual LAN feature enables the assignment of multiple MAC address to one port. T ABLE 2-3 lists the extr[...]

Chapter 2 Hardware Installation and Ser vice 2-17 2.3 Service Pr ocedures 2.3.1 Hot-Swapping the Sun Netra CP3220 Blade Server Y ou can remove the Sun Netra CP3220 blade server without powering of f the entire chassis by performing these steps. 1. Power off the blade server . See Section 2.3.2, “Powering Off the Sun Netra CP3220 Blade Server” o[...]

2-18 Sun Netra CP3220 Blade Server User’s Guide • January 2010 2.3.3 Removing the Sun Netra CP3220 Blade Server 1. Power off the Sun Netra CP3220 blade server . Use the instructions in Section 2.3.2, “Powering Off the Sun Netra CP3220 Blade Server” on page 2-17 . 2. If installed, remove all cables from the front of the Sun Netra CP3220 blad[...]

Chapter 2 Hardware Installation and Ser vice 2-19 2.3.6 Servicing DIMMs 2.3.6.1 DIMM Requirements The Sun Netra CP3220 blade server supports a total of eight DIMMs and the maximum memory capacity of 32 Gbytes (using four 4-Gbyte DIMMs). The Sun Netra CP3220 blade server accommodates the following DIMMs and configurations: ■ Up to eight standard D[...]

2-20 Sun Netra CP3220 Blade Server User’s Guide • January 2010 FIGURE 2-4 Locating DIMM Slots Populate DIMMs in matching pairs, starting with Pair 0, then adding Pair 1, Pair 2, and Pair 3 as needed. P air 0 P air 1 BA BA BA BA P air 2 P air 3[...]

Chapter 2 Hardware Installation and Ser vice 2-21 2.3.6.2 Installing a DDR2 DIMM The following procedur e provides a general guide for installing additional memory . However , for specif ic directions on installing DIMMs on the Sun Netra CP3220 blade server , r efer to the documentation that shipped with the DIMMs. 1. Access the blade server by per[...]

2-22 Sun Netra CP3220 Blade Server User’s Guide • January 2010 FIGURE 2-5 Installing a DIMM 6. Press the top edge of the DIMM toward the blade server until the retainer clips click into place in the notches on the DIMM sides ( FIGURE 2-5 ). The small metal retainer clips on each side of the DIMM slot are spring-loaded, and they should click int[...]

Chapter 2 Hardware Installation and Ser vice 2-23 If an ESD mat is not available, you can place the blade server on the antistatic envelope in which it was packaged. Caution – Do not place blade servers on top of an antistatic bag unless the outside of the bag also has antistatic protective properties. 2. T ake antistatic precautions: Attach and [...]

2-24 Sun Netra CP3220 Blade Server User’s Guide • January 2010 2.3.7 Installing the Optional Compact Flash Car d An IDE Compact Flash card can be installed on the Sun Netra CP3220 blade server . The Compact Flash card is not hot-swappable, and there is no access to the Compact Flash card once the Sun Netra CP3220 is installed in an A TCA shelf.[...]

Chapter 2 Hardware Installation and Ser vice 2-25 FIGURE 2-7 Compact Flash Location Note – Sun Compact Flash cards have a life time of 2,000,000 write/erase cycles. Users are r esponsible for ensuring that the operating system and applications do not exceed this limitation.[...]

2-26 Sun Netra CP3220 Blade Server User’s Guide • January 2010 2.3.8 Installing Optional AMC Car ds An Advanced Mezzanine card (AMC) is a card or module that pr ovides additional functionality to the Sun Netra CP3220 blade server . The blade server contains two AMC slots in which you can install an optional AMC device. An AMC device can be inst[...]

Chapter 2 Hardware Installation and Ser vice 2-27 FIGURE 2-8 Removing an AMC Filler Panel 4. Retrieve the AMC module from its shipping kit and place it on an antistatic surface. 5. Insert the AMC module through the cutout and into the AMC slot FIGURE 2-9 .[...]

2-28 Sun Netra CP3220 Blade Server User’s Guide • January 2010 FIGURE 2-9 Installing an AMC Car d Caution – Do not use excessive force when installing the AMC module into the slot. Y ou might damage the AMC connector on the Sun Netra CP3220 blade server , causing permanent damage to the AMC module or the blade server . If the AMC module does [...]

Chapter 2 Hardware Installation and Ser vice 2-29 7. Press on the front face of the AMC card until the card is fully seated into the AMC connector . 8. Press the black ejector in, toward the AMC card, to activate the card. 9. Refer to the AMC module documentation for software and cabling installation instructions. 2.3.9 Adding or Replacing a T OD C[...]

2-30 Sun Netra CP3220 Blade Server User’s Guide • January 2010 FIGURE 2-10 Jumper 1 in the Run Position T ABLE 2-4 provides information on the pin functions on jumper 1. T ABLE 2-4 Pin Functions on Jumper 1 Pin Number Purpose Pin 1 Battery Feed Pin 2 VCC_R TC (destination for battery power) Pin 3 BA TT_CLR (r esistor to GND, used to drain capac[...]

Chapter 2 Hardware Installation and Ser vice 2-31 T o reset the jumper and r eturn the CMOS settings to the default settings, perform the following steps: 1. Remove the jumper housing from the run position (P1/P2) and move it to the reset position (P2/P3). FIGURE 2-11 Jumper 1 in the Reset Position 2. W ait at least one second for the CMOS settings[...]

2-32 Sun Netra CP3220 Blade Server User’s Guide • January 2010 2.3.10.2 Changing the OOS LED Color The color of the Out-of-service (OOS) LED can be set to red or amber by moving jumper 2 to the appropriate position. Amber is the default color for the OOS LED. T o change the Jumper 2 position to red: 1. Remove the jumper housing from the default[...]

Chapter 2 Hardware Installation and Ser vice 2-33 Users can change the default behavior of the out-of-service (OOS) LED through the IPMC by using an LED1 control bit. This bit is available only on the Sun Netra CP3220 blade server . Y ou can use the set and get IPMC control byte IPMI commands, which are the same commands used to control the Gr een [...]

2-34 Sun Netra CP3220 Blade Server User’s Guide • January 2010 ▼ V iewing OOS LED Settings ● At the clia CLI, enter the Get IPMI Control Bits command. Data Bytes Command NetFn Opcode Get IPMI Control Bits 0x2E 0xE9 T ype Byte Data Field Request Data 1 00 20 0 32 A Response Data 1 Completion Code: • [00] OK • [C1] Command not supported ?[...]

Chapter 2 Hardware Installation and Ser vice 2-35 ▼ Setting OOS LED Behavior Note – Y ou must always perform a read, modify , and write to change any of the bits in the control byte. ● At the clia CLI, enter the Set IPMI Control Bits command. Data Bytes Command NetFn Opcode Set IPMI Control Bits 0x2E 0xE9 T ype Byte Data Field Request Data 1 [...]

2-36 Sun Netra CP3220 Blade Server User’s Guide • January 2010 2.3.12 Resetting the Sun Netra CP3220 Blade Server Caution – Do not operate the A TCA shelf without all fans, component heatsinks, air baff les, and covers installed. Severe damage to components can occur if the A TCA shelf is operated without adequate cooling mechanisms. 1. Use a[...]

3-1 CHAPTER 3 Softwar e Configuration This chapter provides pr ocedures and information about configuring the softwar e. This chapter contains the following topics: ■ Section 3.1, “Operating Systems” on page 3-2 ■ Section 3.2, “Software Updates” on page 3-2 ■ Section 3.3, “SunVTS Software” on page 3-3 ■ Section 3.4, “Configuri[...]

3-2 Sun Netra CP3220 Blade Server User’s Guide • January 2010 3.1 Operating Systems The Sun Netra CP3220 blade server has been tested for compatibility with the following operating systems: ■ W indRiver Linux version 3.1 ■ Solaris 10 OS, Release S10U4 and subsequent versions that may be tested for compatibility with the Sun Netra CP3220 bla[...]

Chapter 3 Software Configuration 3-3 3.3 SunVTS Softwar e Note – The Sun V alidation T est Suite (SunVTS software) runs on the Solaris OS only . There ar e similar test suites available for the Linux operating systems. The SunVTS software is a compr ehensive software suite that tests and validates the Sun Netra CP3220 blade server by verifying th[...]

3-4 Sun Netra CP3220 Blade Server User’s Guide • January 2010 3.4 Conf iguring Sun Netra CP3220 For 1GbE or 10GbE Switches The extended fabric on the Sun Netra CP3220 blade server is capable of operating at either 1 Gbps or 10 Gbps. The Sun Netra CP3220 can be used in the Sun Netra CT 900 server with either the Sun Netra CP3240 10-GbE switch or[...]

Chapter 3 Software Configuration 3-5 3.5 Conf iguring Alternate OOS LED Behavior Administrators and service technicians can change the default behavior of the out-of-service (OOS) LED through the IPMC by using an LED1 contr ol bit. This bit is available only on the Sun Netra CP3220 blade server . Use the set and get IPMC control byte IPMI commands,[...]

3-6 Sun Netra CP3220 Blade Server User’s Guide • January 2010 ▼ Displaying Conf iguration of OOS LED Behavior Use the following command to display the current conf iguration of OOS LED behavior . Data Bytes Command NetFn Opcode Get IPMC Control Bits 0x2E 0xE8 T ype Byte Data Field Request Data 1 00 20 0 32 A Response Data 1 Completion Code: [[...]

Chapter 3 Software Configuration 3-7 ▼ Setting Conf iguration of OOS LED Behavior Use the following command to set the configuration of OOS LED behavior . Data Bytes Note – If an attempt is made to write 0 to any reserved bit (2 to 7), IPMC will reject the command with completion code 0xCC. Command NetFn Opcode Set IPMI Control Bits 0xE9 0xE9 T[...]

3-8 Sun Netra CP3220 Blade Server User’s Guide • January 2010[...]

4-1 CHAPTER 4 Conf iguring and Using BIOS Firmwar e This chapter describes how to use the BIOS (Basic Input Output System) to configure the blade server . This chapter contains the following topics: ■ Section 4.1, “About BIOS Settings” on page 4-2 ■ Section 4.2, “Changing the Configuration of a BIOS Menu Item” on page 4-4 ■ Section 4.[...]

4-2 Sun Netra CP3220 Blade Server User’s Guide • January 2010 4.1 About BIOS Settings This section describes how to view and modify the BIOS settings. The BIOS has a Setup utility stored in the BIOS f lash memory . The Setup utility reports system information and can be used to configur e the BIOS settings. The configur ed data is provided with[...]

Chapter 4 Configur ing and Using BIOS Firmware 4-3 4.1.2.2 AMD PowerNow! Feature Enabled by Default The AMD PowerNow! feature, which is accessed from the BIOS Setup utility Advanced menu, is enabled by default on the Sun Netra CP3220 blade server . Some problems have been observed when using this feature on certain operating systems. If you want to[...]

4-4 Sun Netra CP3220 Blade Server User’s Guide • January 2010 4.2 Changing the Conf iguration of a BIOS Menu Item Y ou can change the BIOS configuration by using a terminal (or terminal emulator connected to a computer) through the serial console port on the fr ont of the Sun Netra CP3220 blade server . Note – Using the ANSI terminal emulatio[...]

Chapter 4 Configur ing and Using BIOS Firmware 4-5 4.3 Setting the Boot Device Using BIOS Setup Scr eens Before beginning this pr ocedure, ensur e that you have installed the serial cable as described in Section 2.2.4, “Connecting External I/O Cables” on page 2-13 . Note – See Section 4.1.3, “Description of the BIOS Screens” on page 4-3 f[...]

4-6 Sun Netra CP3220 Blade Server User’s Guide • January 2010 FIGURE 4-1 BIOS Main Menu 5. Using the arrow keys, move across the top of the screen to the Boot menu and press the Enter key . The Boot Settings menu is displayed ( FIGURE 4-2 ).[...]

Chapter 4 Configur ing and Using BIOS Firmware 4-7 FIGURE 4-2 Boot Settings Menu 6. Move down the list, select the Boot Device Priority option, and press Enter . The Boot Device Priority menu is displayed ( FIGURE 4-3 ).[...]

4-8 Sun Netra CP3220 Blade Server User’s Guide • January 2010 FIGURE 4-3 Boot Device Priority Menu 7. Select the NVIDIA Boot Agent device as the 1st Boot Device. 8. Disable all unneeded boot devices in the menu. 9. Use the arrow keys to move to the Exit menu, and press Enter . The confirmation dialog box is displayed. 10. Press Enter to select [...]

Chapter 4 Configur ing and Using BIOS Firmware 4-9 4.4 Changing the BIOS Continuous Boot Setting T raditionally , the BIOS of a PC would go through the list of bootable devices and try to boot up the OS. If all devices failed to boot, BIOS would print a message to inform the user and wait for user intervention. In the A TCA environment, ther e is t[...]

4-10 Sun Netra CP3220 Blade Server User’s Guide • January 2010 FIGURE 4-4 Security Settings Menu FIGURE 4-5 Change Passwor d Menu[...]

Chapter 4 Configur ing and Using BIOS Firmware 4-11 3. Move down the list, select the Change Supervisor Password or Change User Password option, and press Enter . The Change Password menu is displayed ( FIGURE 4-5 ). 4. T ype a password, then press Enter . 5. Use the arrow keys to move to the Exit Menu. 6. Select OK to conf irm the changes you made[...]

4-12 Sun Netra CP3220 Blade Server User’s Guide • January 2010 4.7 Updating the BIOS When they become necessary , updated BIOS images will be available as patches on the following web site: http://sunsolve.sun.com/ Use the Solaris BIOS Update Utility or the Linux BIOS Update Utility to implement the updates. For more information, see the Sun Ne[...]

Chapter 4 Configur ing and Using BIOS Firmware 4-13 For example: 3. T o boot the blade server from the Shelf Manager , type: Note – Once the blade server is booted, reset the blade server to use the primary BIOS image (page 0). 4.10 Perform a Live Firmwar e Upgrade T o upgrade the BIOS firmware while r etaining the current BIOS image, follow thes[...]

4-14 Sun Netra CP3220 Blade Server User’s Guide • January 2010 4.1 1 Power -On Self-T est The system provides a rudimentary power -on self-test (POST) that runs each time the blade server boots to check the basic devices requir ed for the system to operate. The progr ess of the self-test is indicated by a series of POST codes. These codes appea[...]

Chapter 4 Configur ing and Using BIOS Firmware 4-15 4. On the Boot Settings Conf iguration screen ( FIGURE B-17 ), you can enable or disable the options shown in T ABLE 4-2 T ABLE 4-2 POST Options Option Description Quick Boot This option is disabled by default. If you enable Quick Boot, the BIOS skips certain tests while booting, such as the exten[...]

4-16 Sun Netra CP3220 Blade Server User’s Guide • January 2010[...]

5-1 CHAPTER 5 Har dware Ar chitectur e This chapter provides information about the hardwar e architecture. This chapter contains the following topics: ■ Section 5.1, “Block Diagram” on page 5-2 ■ Section 5.2, “The AMD Opteron Pr ocessor” on page 5-3 ■ Section 5.3, “Memory” on page 5-4 ■ Section 5.4, “Networking and I/O” on p[...]

5-2 Sun Netra CP3220 Blade Server User’s Guide • January 2010 5.1 Block Diagram FIGURE 5-1 Block Diagram[...]

Chapter 5 Hardware Architecture 5-3 5.2 The AMD Opter on Processor AMD Opteron pr ocessors with Direct Connect Architectur e include several new features, including seamless quad-core upgradability and DDR2 memory . AMD Opteron pr ocessors with DDR2 memory feature a common core ar chitecture that is consistent across 1-way , 2-way , and 8-way syste[...]

5-4 Sun Netra CP3220 Blade Server User’s Guide • January 2010 FIGURE 5-2 AMD Opter on Processors Block Diagram 5.3 Memory The Sun Netra CP3220 blade server supports 1-Gbyte, 2-Gbyte, and 4-Gbyte register ed DDR2-667 memory , for up to 32 Gbytes memory total. When four DIMM slots or less are populated, the DIMM clock rate will be set to the max [...]

Chapter 5 Hardware Architecture 5-5 5.4 Networking and I/O Networking and I/O are pr ovided by the following chips and interconnects: ■ nV idia MCP55 (southbridge) ■ PCI Express Bus ■ Dual BIOS ■ T rusted Platform Module ■ Broadcom 5715C Gbit Ethernet chip ■ Sun Sun 10 GbE Multithreaded Networking ASIC Dual 10-Gbit + Dual 1-Gbit Etherne[...]

5-6 Sun Netra CP3220 Blade Server User’s Guide • January 2010 5.4.2 PCI Expr ess Bus PCI Express 1.0 (PCIe) is a high-speed, point-to-point dual simplex chip interconnect. It is the latest extension of the PCI bus. PCI e operates at 2.5 GHz and supports land widths of x1, x2, x4, x8, x16, and x32. Additional features include: ■ Serial point-t[...]

Chapter 5 Hardware Architecture 5-7 5.4.6 Sun Dual 10-Gbit Ethernet/Quad 1-Gbit RGMII Network Interface Chip (Sun 10 GbE Multithr eaded Networking ASIC) The Sun Netra CP3220 blade server is equipped with one Sun Dual 10-Gbit Ethernet/Quad 1-Gbit RGMII Network Interface chip that is specifically designed to support multicore and multithr eaded proce[...]

5-8 Sun Netra CP3220 Blade Server User’s Guide • January 2010 5.5.2 EIDE/A T A for Compact Flash EIDE is an enhanced IDE controller , implemented through the nV idia MCP55 chip. The Sun Netra CP3220 blade server contains one on-board 50-pin T ype II Compact Flash connector , for use with an optional compact flash car d. The location of the comp[...]

A-1 APPENDIX A Physical Characteristics Specifications for the Sun Netra CP3220 blade server ar e provided in the following sections: ■ Section A.1, “Form Factor” on page A-2 ■ Section A.2, “Power and Thermal Metrics” on page A-2 ■ Section A.3, “Connectors and Pinouts” on page A-4[...]

A-2 Sun Netra CP3220 Blade Server User’s Guide • January 2010 A.1 Form Factor The Sun Netra CP3220 blade server is a standard 8-rack unit (8U) factor , single-slot wide. It complies with the board mechanical dimensions that are r equired by the PICMG 3.0 R1.0 specification: ■ 322.25 mm x 280 mm (12.7 inches x 1 1.0 inches) ■ 30.48 mm (1.2 i[...]

Appendix A Physical Characteristics A-3 A.2.2 PICMG Boar d Cooling Requir ements T ABLE A-1 provides the blade server boar d cooling requir ements. No alarms are triggered at any of the listed temperatures for the given airf low . A.2.3 PICMG AR TM Cooling Requir ements T ABLE A-2 provides the Pressur e Drop vs. Flow Rate for the AR TM. T ABLE A-1 [...]

A-4 Sun Netra CP3220 Blade Server User’s Guide • January 2010 A.3 Connectors and Pinouts A.3.1 Fr ont Panel Connectors The front panel has the following connectors, see FIGURE 1- 1 : ■ One 10/100/1000BASE-T Ethernet port (RJ-45) ■ One serial port (RJ-45) ■ T wo USB ports A.3.1.1 Ethernet Port The Ethernet connector is an RJ-45 connector .[...]

Appendix A Physical Characteristics A-5 A.3.1.2 USB Ports FIGURE A-2 shows the connector pin assignments for both of the front panel USB ports. FIGURE A-2 Front Panel USB Connector T ABLE A-5 lists the USB port connector pin assignments. 2 DA- 6 DB- 3 DB+ 7 DD+ 4 DC+ 8 DD- T ABLE A-4 USB Port Pin Assignments Pin Signal Name Description 1 VCC +5 VDA[...]

A-6 Sun Netra CP3220 Blade Server User’s Guide • January 2010 A.3.1.3 Serial Port FIGURE A-3 shows the connector pin assignments for the front panel serial port. T ABLE A-5 lists the serial port connector pin assignments. FIGURE A-3 Front Panel Serial RJ-45 Connector A.3.2 AMC Connectors T wo 170-pin connectors make up the AMC card connections.[...]

Appendix A Physical Characteristics A-7 ■ T wo -48 VDC power feeds (four signals each; eight signals total) ■ T wo IPMB ports (two signals each; four signals total) ■ Geographic address (eight signals) The analog test and ring voltage pins are left unconnected. FIGURE A-4 shows the pin assignments. FIGURE A-4 Power Distribution Connector (Zon[...]

A-8 Sun Netra CP3220 Blade Server User’s Guide • January 2010 13 SCL_A IPMB Clock, Port A 14 SDA_A IPMB Data, Port A 15 SCL_B IPMB Clock, Port B 16 SDA_B IPMB Data, Port B 17 MT1_TIP Metallic T est #1 T ip 18 MT1_TIP Metallic T est #2 T ip 19 -RING_A Ringing Generator A Negative Ringing 20 -RING_B Ringing Generator B Negative Ringing 21 MT1_RIN[...]

Appendix A Physical Characteristics A-9 A.3.4 Data T ransport Connector (Zone 2) The data transport connector consists of two 120-pin HM-Zd connectors, labeled P20 and P23, with 40 differ ential pairs each. These are called the Zone 2 connectors. The Zone 2 connectors provides the following signals: ■ T wo 10/100/1000BASE-T/TX Ethernet base fabri[...]

A-10 Sun Netra CP3220 Blade Server User’s Guide • January 2010 A.3.5 Advanced Rear T ransition Module Connector (Zone 3) The Sun Netra CP3220 blade server provides all the I/O connections for r ear access through the Zone 3 AR TM connector . The connector view and the pinout for the Zone 3 connector are shown in FIGURE A-6 . FIGURE A-6 Zone 3 C[...]

Appendix A Physical Characteristics A-11 T ABLE A-8 shows the J31 connector pin assignments, used for AMC I/O signals. T ABLE A-8 J31 Connector Pin Assignments Row Interface A B C D E F 1 AMC1 EO Ports TX1_13+ TX1_13- RX1_12+ RX1_12- TX1_12+ TX1_12- 2 RX1_14+ RX1_14- TX1_14+ TX1_14- RX1_13+ RX1_13- 3 TX1_17+ TX1_17- RX1_15+ RX1_15- TX1_15+ TX1_15- [...]

A-12 Sun Netra CP3220 Blade Server User’s Guide • January 2010 T ABLE A-9 shows the J32 connector pin assignments, which are used for infrastructure signals. T ABLE A-10 shows the J33 connector pin assignments, which are used for PCIe signals. T ABLE A-9 J32 Connector Pin Assignments Row Interface A B C D E F 1 AMC2 EO Ports NC NC RX2_20+ RX2_2[...]

B-1 APPENDIX B BIOS Scr eens This appendix provides examples of the first-level and second-level screens from the BIOS menu. T o enter the BIOS menu, press the F2 key during the POST portion of the boot process. FIGURE B-1 shows the BIOS menu tree. FIGURE B-2 through FIGURE B-29 show the screens within the BIOS menu tr ee.[...]

B-2 Sun Netra CP3220 Blade Server User’s Guide • January 2010 FIGURE B-1 BIOS Menu T ree Advanced Main PCI/PnP Boot Secur ity Chipset CPU Configuration IDE Configuration Super IO Configuration A CPI Configuration Event Log Configuration MPS Configuration PCI Express Smbios Remote Clear NVRAM Plug & Pla y OS PCI Latency Timer Allocate IRQ to[...]

Appendix B BIOS Screens B-3 FIGURE B-2 BIOS Main Menu FIGURE B-3 Advanced Configuration Menu[...]

B-4 Sun Netra CP3220 Blade Server User’s Guide • January 2010 FIGURE B-4 CPU Configuration Menu FIGURE B-5 IDE Configuration Menu[...]

Appendix B BIOS Screens B-5 FIGURE B-6 Super IO Configuration Menu FIGURE B-7 ACPI Settings Menu[...]

B-6 Sun Netra CP3220 Blade Server User’s Guide • January 2010 FIGURE B-8 Event Logging Details Menu FIGURE B-9 MPS Configuration Menu[...]

Appendix B BIOS Screens B-7 FIGURE B-10 PCI Express Configuration Menu FIGURE B-11 SMBIOS Configuration Menu[...]

B-8 Sun Netra CP3220 Blade Server User’s Guide • January 2010 FIGURE B-12 Remote Access Configuration Menu FIGURE B-13 USB Configuration Menu[...]

Appendix B BIOS Screens B-9 FIGURE B-14 Advanced PCI/PnP Settings Menu FIGURE B-15 Advanced PCI/PnP Settings Menu Continued[...]

B-10 Sun Netra CP3220 Blade Server User’s Guide • January 2010 FIGURE B-16 Boot Settings Menu FIGURE B-17 Boot Settings Configuration Menu[...]

Appendix B BIOS Screens B-11 FIGURE B-18 Boot Device Priority Menu FIGURE B-19 Boot Hard Disk Drive Priority Menu[...]

B-12 Sun Netra CP3220 Blade Server User’s Guide • January 2010 FIGURE B-20 Security Settings Menu FIGURE B-21 Change Password Settings Menu[...]

Appendix B BIOS Screens B-13 FIGURE B-22 Chipset Main Menu FIGURE B-23 NorthBridge Chipset Configuration Menu[...]

B-14 Sun Netra CP3220 Blade Server User’s Guide • January 2010 FIGURE B-24 NorthBridge Chipset Memory Configuration Menu FIGURE B-25 NorthBridge Chipset ECC Configuration Menu[...]

Appendix B BIOS Screens B-15 FIGURE B-26 NorthBridge Chipset DRAM Configuration Menu FIGURE B-27 SouthBridge Chipset Configuration Menu[...]

B-16 Sun Netra CP3220 Blade Server User’s Guide • January 2010 FIGURE B-28 Hyper T ransport Configuration Menu FIGURE B-29 Exit Options Menu[...]

Appendix B BIOS Screens B-17[...]

Index-1 Index A Advanced PCI/PnP Settings menu, B-9 Airflow Requirements, A-3 AMC connectors, A-6 AMC devices additional I/O, 1-7 installing, 2-26 AMC.1 T ype 4E2 cards, 1-7 B barcode labels, locating, 1-14 BIOS about settings, 4-2 AMD PowerNow!, 4-3 changing boot device, 4-5 changing configuration, 4-4 changing passwords, 4-9 screen descriptions[...]

Index-2 Sun Netra CP3220 Blade Server User’ s Guide • January 2010 contacting support, 1-14 CPU Configuration menu, B-4 D data transport connector, A-9 DDR-2 DIMM. See DIMMs, 2-19 DIMMs described, 2-19 installing, 2-21 removing, 2-22 E electric shock caution, 2-2 Ethernet, RJ-45, A-4 Event Logging Configuration menu, B-6 F front panel, A-6 H [...]

Index-3 hardwar e, 1-13 safety, 2-2 software, 1-13 revision number , locating, 1-14 RJ-45 Ethernet, A-4 R TM Pressure Dr op, A-3 S Security Settings menu, B-12 serial number , locating, 1-14 port, A-6 SMBIOS Configuration menu, B-7 software OS support, 3-2 SunVTS, 3-3 software r equirements, 1-13 Southbridge chipset menu, B-14, B-15 Sun Services, [...]

Index-4 Sun Netra CP3220 Blade Server User’ s Guide • January 2010[...]