Dell C8000 manual

Dell PowerEdge C8000 Hardware Owner’s Manual Regulatory Model: B10S Regulatory T ype: B10S001[...]

Notes, Cautions, and W arnings NOTE: A NOTE indicates important information that helps you make b etter use of your computer. CAUTION: A CAUTION indicates potential damage to hardware or loss of data if instructions are not followed. WAR NI NG : A WARNING indicates a potential for property damage, personal injury , or death. ______________ ______ I[...]

Contents 3 Contents 1 About the System . . . . . . . . . . . . . . . . . . 11 Accessing Sy stem Feat ures During Startup . . . . . . . 12 Front-Panel Features and Indicators . . . . . . . . . . 13 Back-Panel Features and Indicators . . . . . . . . . . 15 Server Enclosure Indicator Codes . . . . . . . . . . . . 18 NIC Indicator Codes . . . . . . . .[...]

4 Contents Sy stem Event Log . . . . . . . . . . . . . . . . . . . . . 50 Processor Error . . . . . . . . . . . . . . . . . . . 50 Memory Ecc . . . . . . . . . . . . . . . . . . . . . 51 PCIe Error . . . . . . . . . . . . . . . . . . . . . . 53 IOH Core Error . . . . . . . . . . . . . . . . . . . 54 SB Error . . . . . . . . . . . . . . . . . . . . [...]

Contents 5 Advanced Menu . . . . . . . . . . . . . . . . . . . . . 77 Power Management . . . . . . . . . . . . . . . . 78 CPU Configuration . . . . . . . . . . . . . . . . . 88 Memory Configuration . . . . . . . . . . . . . . . 92 SATA Configuration . . . . . . . . . . . . . . . . . 95 PCI Configuration . . . . . . . . . . . . . . . . . . 98 USB Co[...]

6 Contents 3 Installing System Components . . . . . . . 187 Safety Instructions . . . . . . . . . . . . . . . . . . . 187 About the Illustrations . . . . . . . . . . . . . . . . . 188 Recommended T ools . . . . . . . . . . . . . . . . . . 188 Inside the Sy stem . . . . . . . . . . . . . . . . . . . . 189 Sled Blank . . . . . . . . . . . . . . . . .[...]

Contents 7 Fan Modules . . . . . . . . . . . . . . . . . . . . . . . 207 Removing a Fan Module . . . . . . . . . . . . . . 207 Installing a Fan Module . . . . . . . . . . . . . . . 208 Front Panel Board . . . . . . . . . . . . . . . . . . . . 209 Removing the Front Panel Board . . . . . . . . . . 209 Installing the Front Panel Board . . . . . . . .[...]

8 Contents Replacing Sled Modules in the Server Enclosure . . . . . . . . . . . . . . . . . . . . . . . . 230 Installing the External PDU into the Rack . . . . . . . 231 Connecting the Power Cables . . . . . . . . . . . . . 237 Connecting the Power Cables to the Server Enclosure with Internal Power Source . . . . . . . . . . . . . . . . . . . 237 C[...]

Contents 9 T roubleshooting a Wet Enclosure . . . . . . . . . . . . 255 T roubleshooting a Damaged Enclosure . . . . . . . . . 256 T roubleshooting Enclosure Fan Modules . . . . . . . . 257 T roubleshooting Cooling Problems . . . . . . . . . . . 262 T roubleshooting Sled Components . . . . . . . . . . . 267 Troubleshooting System Memory . . . . . .[...]

10 Contents Configuring the SNMP Traps . . . . . . . . . . . 278 Updating the FCB Firmware . . . . . . . . . . . . 279 Viewing the FCB Firmware Version Information . . . . . . . . . . . . . . . . . . . . 280 Monitoring the External PDU Power Status and Updating the PDU PMC Firmware . . . . . . . . . 280 Before You Begin . . . . . . . . . . . . . . [...]

About the System 11 1 About the Sy stem The P owerEdge C8000 server enclosur e fe atures ten vertically aligned sled bays which support a full sled or a mix ed sled enclosure. A full sled enclosure can include up to five C8220X do uble-wide compute sleds, ten C8220 single-wide compute sleds, or five C8000X D storage sleds. A mixed sled enclosure ca[...]

12 About the System Accessing Sy stem Features During Startup The following keyst rokes provide acc ess to system fe atur es during startup. The SAS/SA T A card or PXE hotk ey suppo rt ar e available only in the BIOS boot mode. Hotkey function is not available in the Unified Extensible F irmware Interface (UEFI) boot mode. Key stroke Description &l[...]

About the System 13 Front-Panel Features and Indicators Figure 1-1. Front-Panel Features and Indicators Item Feature Icon Description 1 - 10 Sled bays 1 to 10 Installs up to five C8220X compute sleds, ten C8220 compute sleds, five C8000XD storage sleds, or a mixture of differing sled types. NOTE: Sled bays 1 and 2 support installation of two C8220 [...]

14 About the System 11 Chassis status indicator Indicates the power and health status of the whole system. 12 Chassis identification indicator Lights blue when the chassis ID signal is generated. 13 Thermal sensor Monitors the inlet ambien t temperatur e. 14 Ethernet connector Embedded 10/100 Mbit NIC connector . 15 NIC link/activity indicator Indi[...]

About the System 15 Back-Panel Features and Indicators Figure 1-2. Back-Panel Features and Indicat ors — Server Enclosure with Internal Power Source Item Feature Icon Description 1 F an modules P rovides cooling solution to the enclosur e. 2 AC power sock ets Connect the power cables to these power sockets. When conn ected to a power source, main[...]

16 About the System Figure 1-3. Back-Panel Features and Indi cators — Server Enclosure with External Power Source 6S e r v i c e m o d e button P ress this button within 4 seconds to enter service mode. 7E x t e r n a l P D U connector Connects to a PDU control connector . 8 BMC management port Dedicated management port. 9C h a s s i s identifica[...]

About the System 17 Item Feature Icon Description 1 F an modules P rovides cooling solution to the enclosur e. 2, 3, 4 F an fault indicators 1 to 6 Indicates the function status of the system fans. 5S e r v i c e m o d e button P ress this button within 4 seconds to enter service mode. 6E x t e r n a l P D U connector Connects to a PDU control con [...]

18 About the System Server Enclosure Indicator Codes The indicators on the front and back of the server enclosure displays operational status of the enclosure, fan modules, and chassis controller boar ds. Figure 1-4. Server Enclosure Front-Panel Indicators Item Indicator Color Status Indicator Code 1 Chassis status indicator Green Solid Indicates a[...]

About the System 19 Figure 1-5. Server Enclosure Back-Panel Indicators Item Indicator Color Status Indicator Code 1P o w e r / e v e n t indicator Green Solid Indicates a valid power source is connected to the server enclosure and that the enclosur e is operational and power is applied to the fan controller boar d. Green Blinking P ower is connecte[...]

20 About the System NIC Indicator Codes Figure 1-6. NIC Indicators (Front-Panel Ethernet Connector) 5 F an 5 and 6 fault indicator Amber Blinking Indicates a fault event occurred in fans 5 and 6. Off Off F ans 5 and 6 are operational. 1 link indicator 2 activity indicator Indicator Status Indicator Code Link indicator Solid amber Linki ng at 10 Mbp[...]

About the System 21 Figure 1-7. NIC Indicators (BMC management port) 1 link indicator 2 activity indicator Indicator Status Indicator Code Link indicator Blinking amber Linking at 10 Mbps port speed Blinking green Linking at 100 Mbps port speed (maximum) Activity indicator Solid green No activity Blinking green T ransmit or receive activity Off Idl[...]

22 About the System Sled Bay Numbering The front of the server enclosure is di vided into ten vertical bays. A C8220 single-wide com pute sled occupies one sled bay in the server enclosure and a C8220X double-wide compute sled or C8000 XD storage sled occupies two sled bays in the server enclosur e. When installing a sled module into the server enc[...]

About the System 23 Fan Bay Numbering The back of the P owerEdge C8000 server enclosure includes three hot- swappable fan modules that provide th e system with a r edundant cooling source. Each fan module contains tw o cooling fans. All three fan modules must be installed at all times to ensure proper cooling. Figure 1-9. Fan Bay Numbering Fan Bay [...]

24 About the System Sled Module Configuration The following illust rations ar e sample sl ed module configurations available on the P o werEdge C8000 server enclosure. Figure 1-10. C8220 Si ngle-Wide Compute Sleds Figure 1-11. C8220X Double-Wide Compute Sleds[...]

About the System 25 Figure 1-12. Mixed Sleds — Server Enclosure with Internal Power Source Figure 1-13. Mixed Sleds — Server En closure with External Power Source[...]

26 About the System Sled Features Compute Sleds The P owerEdge C8000 server enclo sur e holds up to ten single-wide compute sleds or five double-wide compute sleds. Each compute sled is equivalent to a standard server built with a proces sor(s), memory , network interface, baseboard management controller , and local hard- drive storage. Single-Wide[...]

About the System 27 4 Rel ease latch Pr ess to release the sled from the e nclosure. 5P o w e r - o n i n d i c a t o r / power button The power -on indicator lights when the sled power is on. The power -on indicator lights amber when the system critical event occurs. NOTE: The power-on indica tor lights amber according to critical system error log[...]

28 About the System 6 VGA connector Connects a VGA display to the system. 7 Serial connector Connects a serial device to the system. 8 BMC management port Dedicated management port. 9 Ethernet connector 2 Embedded 10/100/1000 Mbit NI C connector . 10 Ethernet connector 1 Embedded 10/100/1000 Mbit NI C connector . 11 Sled identification indicator Li[...]

About the System 29 Double-Wide Compute Sled The C8220X double-wide compute sled in cludes two types of configuration, a double-wide compute sled with fro nt- access 2.5-inch ho t-plug hard-drives and a double-wide co mpute sled with general-pur pose graphics processing unit (GPGPU). Figure 1-15. Sled Features — C8220X D ouble-Wide Compute Sled w[...]

30 About the System 8 Sled release latch P ress to re lease the sled from the enclosure. 9P o w e r - o n i n d i c a t o r / power button The power-on indi cator ligh ts when the sled power is on.The power -on indicator lights amber when the system critical event occurs. NOTE: The power-on indicator lights amber according to critical system error [...]

About the System 31 Figure 1-16. Sled Features — C8220X Double-Wide Compute Sled with GPGPU 12 BMC management port Dedicated management port. 13 Ethernet co nnector 2 Embedded 10/100/1000 Mbit NIC connector . 14 Ethernet co nnector 1 Embedded 10/100/1000 Mbit NIC connector . 15 Sled identificat ion indicator Lights blue to identify a particular s[...]

32 About the System 3 Sled cover/ GPGPU card assembly Installs up to two GPGP U cards when plugged into horizontal GPGPU ca rd risers. 4 Sled release latch P ress to release the sled from the enclosur e. 5P o w e r - o n i n d i c a t o r / power button The power -on indicator lights when the sled power is on.The power -on indicator lights amber wh[...]

About the System 33 8 BMC management port Dedicated management port. 9 Ethernet connector 2 Embedded 10/100/1000 Mbit NIC connector . 10 Ethernet co nnector 1 Embedded 10/100/1000 Mbit NIC connector . 11 Sled identificat ion indicator Lights blue to iden tify a particular sled and system board. 12 Handle Hold to pull the sled from the enclosure. It[...]

34 About the System Storage Sleds The C8000XD storage sled i s a dir ect attached storage for the server enclosur e. The storage sled provides dedi cated data storag e to a C8220X sled or C8220 sled. Each storag e sled supports up to a maximum of 12 x 3.5-inch/ 2.5-inch har d-drives or 24 x 2.5-inch SSD har d-drives. Figure 1-17. Sled Features — [...]

About the System 35 4, 8 Sled power/status indicator The power-on indica tor lights green when the sled power is on and power is applied to the SAS expander boar d . The power -on indicator alternately lights green and blinks amber when a critical event occurs. 5, 9 Sled identification indicator Lights blue to identify a particular mini- SAS connec[...]

36 About the System Power Sleds Y ou can install u p to two hot-swappabl e powe r sleds in the server enclosure that supports internal power source. Each power sled installs up to two 1400 W power supply module s that are capable of delivering 2800 W power to the server enclosure at an input range of 200-240 V . Figure 1-18. Sled Features — Power[...]

About the System 37 Item Indicator , Button, or Connector Icon Description 1 PSU1/3 status indic ator The PSU1/3 status indicator lights gr een indicating that a valid power source i s connected to the power supply and that power supply is operational. The PSU1/3 status indicator lights amber indicating a problem with the PSU module. • PSU module[...]

38 About the System Service T ag The following illust rations provide locati on of the Se rvice T ag number on the server enclosur e, compute sleds, an d storage sl eds. Server Enclosure Figure 1-19. Service T ag Location for Server Enclosure[...]

About the System 39 Sleds Figure 1-20. Service T ag Location fo r C8220 Single-Wide Compute Sled Figure 1-21. Service T ag Location for C8220X Double-Wide Compute Sled with 3.5-inch (4-Drive Bay) Hard-Drives[...]

40 About the System Figure 1-22. Service T ag Location for C822 0X Double-Wide Compute Sled with 2.5-inch (8-Drive Bay) Hard-Drives Figure 1-23. Service T ag Location for C822 0X Double-Wide Compute Sled with GPGPU[...]

About the System 41 Figure 1-24. Service T ag Locati on for C8000XD Storage Sled[...]

42 About the System POST Error Codes Collecting Sy stem Event Log for Investigation Whenever possible, the syste m BIOS will output the current boot progr ess codes on th e video screen. P rog r ess codes are 32-bit quanti ties plus optional data. The 32-bit numbers include class, subclass, and operation information. The class and subclass fie lds [...]

About the System 43 0012h Local Console Output Error Pa u s e V i d e o d e v i c e initialization failed See "T roubleshooting the Video Subsystem" on page 252. If the problem persists, see "Getting Help" on page 289. 0013h ISA IO Controll er Error Pa u s e I S A d e v i c e initialization failed See "T roubleshooting Expa[...]

44 About the System 0019h USB Read Error P ause USB port initialization failed See "T roubleshooting a USB Device" on page 252. If the problem persists, see "Getting Help" on page 289. 001Ah USB W rite Error P ause USB port initialization failed See "T roubleshooting a USB Device" on page 252. If the problem persists, [...]

About the System 45 0020h Keyboar d Stuck Key Error Pa u s e K e y b o a r d k e y stuck Disconnect and reconnect the keyboar d to the compute sled. If the problem persists, see "Getting Help" on page 289. 0021h Keyboar d Locked Error Pa u s e K e y b o a r d locked Disconnect and reconnect the keyboar d to the compute sled. If the proble[...]

46 About the System 0028h PCI IO Read Error Pa u s e P C I d e v i c e initialization failed See "T roubleshooting Expansion Cards" on page 270. If the problem persists, see "Getting Help" on page 289. 0029h PCI IO W rite Error Pa u s e P C I d e v i c e initialization failed See "T roubleshooting Expansion Cards" on p[...]

About the System 47 002Fh No Microcode Be Updated P ause P r ocessor microcode load failed Ensure that your processors match and conform to the type described in the processor technical specifications outlined in your system’s Getting Started Guide. 8012h SA T A 0 Device Not F ound P ause SA T A 0 device not found Check if the SA T A port 0 is en[...]

48 About the System 8016h SA T A 4 Device Not F ound P ause SA T A 4 device not found Check if the SA T A port 4 is enabled. See "SA T A Configuration" on page 95. Install a SA T A device to SA T A port 4. If the problem persists, see "Getting Help" on page 289. 8017h SA T A 5 Device Not F ound P ause SA T A 5 device not found C[...]

About the System 49 8021h CMOS Battery Error P ause No CMOS battery See the compute sled’s documentation for mor e information. 8100h Memory device disabled by BIOS Pa u s e M e m o r y Device Error See "T roubleshooting System Memory" on page 267. If the problem persists, see "Getting Help" on page 289. Error Code Error Messa[...]

50 About the System Sy stem Event Log Processor Error Message: “P rocessor Sensor , IERR er ror , P rocessor 1” T able 1-1. Processor Error Byte Field V alue Description 1 NetF unLun 10h 2 Platform Event Command 02h 3 Generator ID 01h Ge nerated by BIOS 4 Event Message F ormat Ve r s i o n 04h Event Message F ormat Revision. 04h for this specif[...]

About the System 51 Memory Ecc Message: “Memory S ensor , Corr ectable ECC error , SBE warning threshold, CPU1 DIMM_A1” T able 1-2. Memory ECC Byte Field V alue Description 1 NetF unLun 10h 2 Platform Event Command 02h 3 Generator ID 01h Generated by BIOS 4 Event Message F ormat Ve r s i o n 04h Event Message F ormat Revision. 04h for this spec[...]

52 About the System 9 Event Data2 XXh Bit 7:4 0x00: SBE warning thr eshold 0x01: SBE critical th resho ld 0x0F : Unspecifie d Bit 3:0 0x00: CP U1 DIMM A1-8 slots (1~8) 0x01: CP U2 DIMM B1-8 slots (9~16) 0x02: CPU3 DIMM C1-8 slo ts (17~24) 0x03: CP U4 DIMM D1-8 slots (25~32) And so on… 10 Event Data3 XXh DIMM bit-map location of bits Bit 0=1: DIMM[...]

About the System 53 PCIe Error Message: “Critical Interrupt Sensor , PCI PERR, Device#, F unction#, Bus#” T able 1-3. PCIe Error Byte Field V alue Description 1 NetF unLun 10h 2 Platform Event Command 02h 3 Generator ID 01h Generated by BIOS 4 Event Message F ormat Ve r s i o n 04h Event Message F ormat Revision. 04h for this specification 5 Se[...]

54 About the System IOH Core Error Message: “Critical Interrupt Sensor , F atal Error , xxxx bit, QPI[0] Error ” T able 1-4. IOH Core Error Byte Field V alue Description 1 NetF unLun 10h 2 Platform Event Command 02h 3 Generator ID 01h Generated by BIOS 4 Event Message F ormat Ve r s i o n 04h Event Message F ormat Revision. 04h for this specifi[...]

About the System 55 SB Error Message: “Critical Interrupt Sensor , Corr ectable, MCU P arity Error” T able 1-5. SB Error Byte Field V alue Description 1 NetF unLun 10h 2 Platform Event Command 02h 3 Generator ID 01h Generated by BIOS 4 Event Message F ormat Ve r s i o n 04h Event Message F ormat Revision. 04h for this specification 5 Sensor T y[...]

56 About the System POST Start Event Message: “System Event, POST starts with BIOS xx.xx.xx” T able 1-6. POST Start Event Byte Field V alue Description 1 NetF unLun 10h 2 Platform Event Command 02h 3 Generator ID 01h Generated by BIOS 4 Event Message F ormat Ve r s i o n 04h Event Message F ormat Revision. 04h for this specification 5 Sensor T [...]

About the System 57 POST End Event T able 1-7. POST End Event Byte Field V alue Description 1 NetF unLun 10h 2 Platform Event Command 02h 3 Generator ID 01h Generated by BIOS 4 Event Message F ormat Ve r s i o n 04h Event Message F ormat Revision. 04h for this specification 5 Sensor T ype 12h System Event 6 Sensor Number 85h POST End ( depend on pl[...]

58 About the System POST Error Code Event Message: “System F irmware P rog ress, POST error code: UBLBh.” T able 1-8. POST Error Code Event Byte Field V alue Description 1 NetF unLun 10h 2 Platform Event Command 02h 3 Generator ID 01h Generated by BIOS 4 Event Message F ormat Ve r s i o n 04h Event Message F ormat Revision. 04h for this specifi[...]

About the System 59 BIOS Recovery Event ME Fail Even t T able 1-9. BIOS Recovery Event Byte Field V alue Description 1 NetF unLun 10h 2 Platform Event Command 02h 3 Generator ID 01h Generated by BIOS 4 Event Message F ormat Ve r s i o n 04h Event Message F ormat Revision. 04h for this specification 5 Sensor T ype 12h System Event 6 Sensor Number 89[...]

60 About the System SEL Generator ID 7 Event Direction Event T ype 6Fh Bit 7: 0 = Assert Event Bit 6: 0 = Event T ype Code 8 Event Data1 AXh 01h: OEM ME fa il Event 9 Event Data2 XXh 01h:ME fail 10 Event Data3 FFh FFh: Not Present T able 1-11. S EL Generator ID Generator ID BIOS 0x0001 BMC 0x0020 ME 0x002C W indows 2008 0x0137 T able 1-10. BIOS Rec[...]

About the System 61 BMC The following table includes an overview of the system sensors. In the Offset column: • S I = Sensor Initialization •S C = S e n s o r C a p a b i l i t i e s • AM = Assertion Mask • DM = Deassertion Mask • RM = Reading Mask • TM = Settable/Re adable Threshold Mask T able 1-12. Sensor Summary Sensor Number Sensor[...]

62 About the System T able 1-13. S ensor Summary (co ntinued) Sensor Number Sensor Name Sensor T ype Event/Reading T ype Offset 04h CP U ERR2 P rocessor (07h) Sensor-specific (6Fh) SI: 01h SC: 40h AM: 0001h DM: 0000h RM: 0001h 05h 12V Standby V oltage (02h) Threshold (01h) SI: 7Fh SC: 59h AM: 7A95h DM: 7A95h TM: 3F3Fh 06h 5V V oltage (02h) Threshol[...]

About the System 63 T able 1-14. Sensor Summary (continued) Sensor Number Sensor Name Sensor T ype Event/Reading T ype Offset 09h 3.3V Standby V oltage (02h) Threshold (01h) SI: 7Fh SC: 59h AM: 7A95h DM: 7A95h TM: 3F3Fh 0Ah Battery low Battery (29h) Sensor -specific (6Fh) SI: 67h SC: 40h AM: 0001h DM: 0000h RM: 0001h 41h MEZZ1 T EMP T emperatur e ([...]

64 About the System T able 1-15. S ensor Summary (co ntinued) Sensor Number Sensor Name Sensor T ype Event/Reading T ype Offset 43h DIMM ZONE 1 Te m p T emperatur e (01h) Threshold (0 1h) S I: 7Fh SC: 68h AM: 0A80h DM: 0A80h TM: 3838h 44h DIMM ZONE 1 Te m p T emperatur e (01h) Threshold (0 1h) S I: 7Fh SC: 68h AM: 0A80h DM: 0A80h TM: 3838h 45h PCH [...]

About the System 65 T able 1-16. Sensor Summary (continued) Sensor Number Sensor Name Sensor T ype Event/Reading T ype Offset A1h Soft Reset System Boot/ Restart Initiated (1Dh) Sensor -specific (6Fh) SI: 01h SC: 40h AM: 0004h DM: 0000h RM: 0004h A2h AC lost P ower Unit (09h) Sensor-specific (6Fh) SI: 01h SC: 40h AM: 0010h DM: 0000h RM: 0010h A3h P[...]

66 About the System Other Information Y ou May Need WAR NI NG : See the safety and regulatory info rmation that shipped with your sy stem. Warranty information may be included within this document or as a separate document. • The Getting Started Guide provides an overview of rack installation, system features, setting up your system, an d technic[...]

Using the System Setup Program 67 2 Using the Sy stem Setup Program The System Setup program is the BIOS program that enables you to manage your system hardware and specify BIOS-level options. From the System Setup program, you can: • Change the NVR AM settings after you add or remove hardware • View the system hardwar e configuration • Enabl[...]

68 Using the System Setup Program • When chan ging the password or making other changes to the secu rity setup NOTE: Only items in brackets [ ] can be mo dified, Items that are not in brackets are display only. NOTE: PowerEdge C8000 server enclosure is referred to as simply the "server enclosure" or the "chassis" in this manua[...]

Using the System Setup Program 69 General Help In addition to the Item Specific Help window , the Setup Utility also provides a General Help scr een. This scr een can be called up from any menu by pressing <F1>. The General Help screen lists the legend k eys with their corresponding alternates and function s. T o exit the help window , press [...]

70 Using the System Setup Program Enabling and Configuring Console Redirection Via COM1 T o activate console r edirection via CO M1, you must configur e the following settings: 1 Connect the serial cable to the serial port and host system. See "Compute Sleds" on page 26 for the location of the serial port on t he sled. 2 P ress <F2>[...]

Using the System Setup Program 71 5 In the Remote Access Con figuration screen, verify the following settings: • Remote Access: Enabled • Serial port number: COM2 as SOL • Serial P ort Mode: 115200 8, n,1 • Flow Control: None • Redir ection After BIOS POST : Always •T e r m i n a l T y p e : A N S I See "Remote Access Configuration[...]

72 Using the System Setup Program • Serial P ort Mode: 115200 8, n, 1 • Flow Control: None • Redir ection After BIOS POST : Always • T erminal T ype: AN SI See "Remote Access Configuration" on page 113 for details. Make sure the last four options syncs with the host and client. 7 In the Server screen, select BMC LAN Configuration [...]

Using the System Setup Program 73 6 In the Remote Access Con figuration screen, verify the following settings: • Remote Access: Enabled • Serial port number: COM2 • Serial P ort Mode: 115200 8, n, 1 • Flow Control: None • Redir ection After BIOS POST : Always •T e r m i n a l T y p e : A N S I See "Remote Access Configuration"[...]

74 Using the System Setup Program Main Menu The main menu displays information about your system boards and BIOS. Main Screen NOTE: Press <Alt> <H> to enter the BIOS debug mode and reset the BIOS to default settings. NOTE: The options for the System Setup program change based on the system configuration. NOTE: The System Setup program d[...]

Using the System Setup Program 75 Sy stem Settings Option Description System Date Scroll to this item to adjust the date. Use <Enter>, <T ab> or <Shift><T ab> to select a field. Use [+] or [-] to configure system date. System Time Scroll to this item to adjust the time. Use <Enter>, <T ab> or <Shift><T a[...]

76 Using the System Setup Program P rocessor Core Displays the processor core. System Memory Size Displays total memory size installed on the system board. System Memory Speed Displays the maxi mum speed of your system memory . System Memory V oltage Displays the maxi mum voltage of your system memory . Option Description[...]

Using the System Setup Program 77 Advanced Menu The advanced menu displays a table of items that de fines advanced information about your system. Scroll to this item and pr ess <Enter> to view the following screen. CAUTION: Making incorrect settings to it ems on these pages may cause the sy stem to malfunction. Unless you have experience adju[...]

78 Using the System Setup Program Power Manage ment Scroll to this item and press <Ent er> to view the following scr een. Power Management Option Description P ower Management ( OS Control default ) Select a system power management mode. • Maximum P erformance: Sets the system powe r manage ment to maxi mum perfo rmance. • OS Control: All[...]

Using the System Setup Program 79 CPU P o wer Capping ( P- S t a t e 0 default) Select a processor performance state (P -state). Options are [P -State 0], [P -State 1], [P -State 2], [P -State 3], and [P -state 4]. NOTE: This option is enabled when Power Management is set to OS Control mode. Chassis P ower Management P ress <Enter> to set cha[...]

80 Using the System Setup Program Chassis Power Management Scroll to this item and press <Ent er> to view the following scr een. Chassis Power Management Option Description Chassis PSU Configuration P ress <En ter> to configure the chassis power supply . This option provides management and monitoring of the power supplies and the minimu[...]

Using the System Setup Program 81 Emergency T hrottling P ress <Enter> to configure the compute sled and chassis emergency throttle functions. This option sets the policy to take effe ct when the sled detects a system emer gency failur e (such as fan error , chassis critical power events , PSU critical power events, abnormal ambient temperatu[...]

82 Using the System Setup Program Chassis PSU Configuration Scroll to this item and press <Ent er> to view the following scr een. Chassis PSU Configuration Refer to the Boundaries of PSU Conf iguration table on page 83 when changing the configuration of the powe r supplies to load-shared or r edundant power . Option Description Required P owe[...]

Using the System Setup Program 83 Boundaries of PSU Configuration The number of power supplies required for PSU configuratio n is determined by the following form ula: X + N, where X is the required PSU and N is the redunda nt PSU. PSU Number Required PSU (X) Redundant PSU (N) 44 0 31 22 32 1 22 0 11[...]

84 Using the System Setup Program Power Capping Scroll to this item and press <Ent er> to view the following scr eens. Power Capping Option Description P ower Budget Displays the enc losure available power wattage. It is the summary of each PSU’ s capacity (i.e. based on the number of PSUs and the maximum capacity of each PSU). Each PSU sup[...]

Using the System Setup Program 85 Chassis Level Capping ( Disabled default) Set as chassis level or sled level power capping. (The default setting is r eferred from BMC). The system determines the power consumption of the enclosure and sleds, and constantly attempts to maintain the enclosure’s power consumption below the cap. Sled P ower Capping [...]

86 Using the System Setup Program Power Capping Option Description P ower Budget Displays the enc losure available power wattage. It is the summary of each PSU’ s capacity (i.e. based on the number of PSUs and the maximum capacity of each PSU). Each PSU supports a maximum output wattage of 1100 W or 1400 W . P ower budget in the enclosur e must n[...]

Using the System Setup Program 87 Emergency Throttling Scroll to this item and pr ess <Enter> to view the following screen. Emergency Throttling Option Descripti on Sled Le vel P olic y ( Chassis Level default) Select a sled level policy when an emergency throttle event is trig gered. • Chassis Level : Overrides the chassis level policy for[...]

88 Using the System Setup Program CPU Configuration Scroll to this item and press <Ent er> to view the following scr een. Chassis Level P olicy ( Throttling default) Select a chassis level policy when an emer gency throttle event is triggered. This option can be configur ed when the Sled Level P olicy is set to Chassis L evel policy . • Thr[...]

Using the System Setup Program 89 CPU Configuration Option Descripti on Active P rocessor Cores ( All Cores default) Allows you to control the number of enabled cor es in each processor . Options are [1], [2], [4], [6], [8], [10]and [All Cores]. (Option depends on processor cor e.) F requency Ratio ( Aut o default) Sets the frequency multipliers as[...]

90 Using the System Setup Program C7 State ( Enabled default) Enables or disables the processor C7 state. NOTE: T his feature is available when the p rocessor supports C7 state. NOTE: Disable this option at your own risk. When you disable this option, a pop up message appears on the screen and warning appears in the System Setup Help. XD Bit Capabi[...]

Using the System Setup Program 91 Prefetch Configuration Scroll to this item and pr ess <Enter> to view the following screen. Prefetch Configuration Option Descripti on Adjacent Cache Line P refetch ( Enabled default) Enables or disables system optimization for sequential memory access. Ha rdw are Pref et ch er ( Enabled default) Enables or d[...]

92 Using the System Setup Program Memory Configuration Scroll to this item and press <Ent er> to view the following scr een. Memory Configuration DCU IP P refetcher ( Enabled default) Enables or disables DCU IP pr efetcher . NOTE: This feature is availabl e when supported by the processor. Option Descriptio n Memory F requency ( Aut o default[...]

Using the System Setup Program 93 Memory Throttling Mode ( Enabled default) Enables or disables the memo ry to run in closed-loop thermal throttling mode. Memory Operating Mode ( Optimizer Mode default) Select the type of memory operation if a valid memory configuration is installed. • Optimizer Mode: The two memory cont rollers run in parall el [...]

94 Using the System Setup Program Memory Operating V oltage ( Aut o default) If set to Auto , the system sets the voltage to an optimal value based on the capacity of the installed memory modules. Y ou can also set the voltage of the memory module to a higher value (1.5 V) provided that the modules support multiple voltages. Options are [Auto], [1.[...]

Using the System Setup Program 95 SA T A Configuration Scroll to this item and pr ess <Enter> to view the following screen.[...]

96 Using the System Setup Program SA T A Configuration Option Description Embedded SA T A Controller ( AHCI default) Select an operation mode for the onboar d SAT A controller . • Off: Disables the SA T A controller . This tok en applies to the first onboar d SA T A controller . • IDE: Enables the SA T A controller to run in IDE mode. Sets the [...]

Using the System Setup Program 97 SA T A P ort 2 ( Aut o default) When set to off, t urns off the 3r d Serial AT A drive controller . When set to aut o , enables BIOS support for the 3 rd Serial A T A drive controller (enabled if present, POST error if not present). SA T A P ort 3 ( Aut o default) When set to off, t urns off the 4th Serial A T A dr[...]

98 Using the System Setup Program PCI Configuration Scroll to this item and press <Ent er> to view the following scr een. PCI Configuration Option Descriptio n Embedded Network Devices P ress <Enter> to configure available network drives. NIC Enumeration ( Onboard default) Select a LAN boot ROM option. • Onboard: Uses the PXE boot on [...]

Using the System Setup Program 99 PCI Slot Configuration Pr ess <Enter> to configure PCI Express devices. NOTE: When you install a Intel Xeon Phi card in the C8220X sled, BIOS automati cally enables the PCI memory 64-bit decode option. PCIe Generation ( Gen3 default) Select a PCI signaling r ate. • Gen 1: 2.5 GT/s •G e n 2 : 5 G T / s •[...]

100 Using the System Setup Program Embedded Network Devices Scroll to this item and press <Ent er> to view the following scr een. Reboot on WOL (ROW) ( Disabled default) Enables or disables reboot on wake-on-LAN featur e. Reboot On WOL tar gets network controllers when the network controller receives a magic pack et. This option displays when[...]

Using the System Setup Program 101 Embedded Network Devices Option Descriptio n Embedded NIC1 ( Enabled with PXE default) Enables or disables the onboard NIC1 controller . • Enabled with PXE: Allows you to enable the system’s primary embe dded NIC (full fun ction), includ ing its PXE boot-ROM. • Enabled wit hout PXE: Allows you to enable the [...]

102 Using the System Setup Program iSCSI Remote Boot Select iSCSI Remote Boot in the Embedded NIC1/NIC2 option and press <Enter> to view the following screen. iSCSI Remote Boot Option Description iSCSI Initiator Name Displays the worldwide unique name of the initiator . NOTE: Only iqn format is accepted. Enable DHCP ( Disabled default) Enable[...]

Using the System Setup Program 103 Active State Power Management Configuration Scroll to this item and pr ess <Enter> to view the following screen. Active State Power Management Configuration T arget P ort Sets the target p ort. Boot L UN Sets the he xadecimal repr esentation of L U number . CHAP T ype ( None default) Select CHAP type. Op tio[...]

104 Using the System Setup Program PCI Slot Configuration Scroll to this item and press <Ent er> to view the following scr een. Mezzanine Slot ASPM ( Disabled default) Select an ASPM protocol for the mezzanine s lot. NB-SB Link ASPM ( L1 default) Select an ASPM protocol for the northbridge and southbridge chipsets. Option Descriptio n[...]

Using the System Setup Program 105 PCI Slot Configuration USB Configuration Scroll to this item and pr ess <Enter> to view the following screen. Option Description PCIe Slot1 ( Enabled default) Enables or disables the PCIe slot1. Options ar e [Disabled], [Enabled], [Enabled without OPROM]. NOTE: When you install a Intel Xeon Phi card in the C[...]

106 Using the System Setup Program USB Configuration Option Description Embedded USB Controller ( Enabled default) Enables or disables the onboard USB controller at sy stem startup. USB P ort w ith BMC ( Enabled default) Enables or disables internal USB port with BMC support. External USB P or t1 ( Enabled default) Enables or disables the e xternal[...]

Using the System Setup Program 107 Security Menu The security menu enables you to set the security parameters. Scroll to this item and press <Enter> to view the fo llowing screen. Security Settings Option Description Supervisor P assword Indicates whether a supervisor password has been set. If the password has been installed, Installed is dis[...]

108 Using the System Setup Program Change Supervisor Y ou can install a Supe rvisor password, and if you install a supervisor password, you can then install a user password. A user password does not provide access to many of the features in the Setup utility . Note, the Change User P assword option only appears after a Supervisor password has been [...]

Using the System Setup Program 109 Server Menu The server menu enables you to configur e compute sled parameters. Scrol l to this item and press <Enter> to view the following screen. Server Settings Option Description Status of BMC Displays BMC status. IPMI Specification V ers ion Displays the Intelligent Platform Management Interface (IPMI) [...]

110 Using the System Setup Program ACP I S PMI T ab le ( Enabled default) When enabled, BIOS enables Advanced Configuration and P ower Interface (ACPI) Service Processor Management Interface (SPMI) table for IPMI driver installation. When disabled, BIOS disables the A CPI SPMI table for BMC ROM update. Set BMC LAN Configuration P ress <Enter>[...]

Using the System Setup Program 111 Set BMC LAN Configuration Scroll to this item and pr ess <Enter> to view the following screen. Set BMC LAN Configuration Option Descripti on Channel Number Displays the channel number used for BMC LAN. Channel Number Status Displays the BMC channel number status. BMC LAN P ort Configuration ( Shared-NIC defa[...]

112 Using the System Setup Program IPv6 Mode Select Enabled in the IPv6 Mode option and pr ess <Enter> to view the following screen. IPv6 Mode Gateway MAC Addr ess Sets the MAC a ddr ess for the static IP address. BMC NIC MAC Address Sets the MAC address for the BMC management port. IPv6 Mode ( Disabled default) Enables or disables the IPv6 i[...]

Using the System Setup Program 113 Remote Access Configuration Scroll to this item and pr ess <Enter> to view the following screen. Remote Access Configuration IPv6 P refix Length Sets prefix length of the IPv6 address. IPv6 IP Address Set the BMC management port to dedicated or shared NIC port. Options ar e [Dedicated NIC] and [Shared NIC]. [...]

114 Using the System Setup Program Serial port number ( COM1 defau lt) Select a serial port for console redir ection. • COM1: Enables cons ole redirection via COM1. See token D7h. • COM2 as SOL: Enable s console redirect ion via COM2. Serial P ort Address ( 3F8h/2F8h default) Specifies the base I/O port address of the serial port. • 3F8h/2F8h[...]

Using the System Setup Program 115 Vie w Sy s te m L o g Scroll to this item and pr ess <Enter> to view the following screen. View Sy stem Log Option Description View BMC SEL E vent Log View all ev ents in the BMC system event log. Clear BMC SEL Event Log Deletes all records in the BMC system event log.[...]

116 Using the System Setup Program Boot Menu The boot menu enables you to set POST bo ot parameters. Scroll to this item and press <Enter> to view the following screen. Boot Settings Option Descriptio n Quiet Boot ( Enabled default) Enable this item to display the splash or summary screen , rather than the detail of the POST flow . When disab[...]

Using the System Setup Program 117 Boot Mode ( BIOS default) Select a system boot mode. • BIOS : The standard BIOS-level boot interface •U E F I : A n enhanced 64-bit boot interface based on Unified Extensible F irmware Interface (UEFI) specifications that overlays the system BIOS. Boot T ype Order P ress <Enter> to set the pr eferred boo[...]

118 Using the System Setup Program Exit Menu Scroll to this item and press <Ent er> to view the following scr een. Exit Options Option Descriptio n Save Changes and Exit Highlight this item and press <Enter> to save any changes th at you have made in the Setup utili ty and exit the Setup uti lity . When the Save Changes and Exit dialog [...]

Using the System Setup Program 119 Save Changes Select this item and press <Enter> to save ch anges you have made without leaving the setup utility . Discard Changes Select this item and press <Enter> to discar d any changes you have made without leaving the setup utility . Load Optimal Defaults If you highlight this item and pr ess <[...]

120 Using the System Setup Program Command Line Interfaces for Sy stem Setup Options The options in the System Setup menu allows you to control the System Configuration Utility (syscfg). This utility is included in the Dell OpenManage Deployment T oolkit (DTK). See the Deplo yment T oolkit V ersion 1.3 Us er's Guide for additional information [...]

Using the System Setup Program 121 0052 N/A F or the next system boot, set the IPL priority to : hard disk then option ROMs (if the devices ar e available). 0053 N/A F or the next system boot, set the IPL priority to : Network, har d disk, R AID,USB storage, CD/D VD- ROM (if the devices ar e available). 0054 N/A F or the next system boot, set the I[...]

122 Using the System Setup Program 00BB Embedded NIC2 Enables the onboard NIC2 controller , but disables the NIC associated PXE or RPL boot-ROM. 00BC Embedded NIC2 Enables the onboard NIC2 controller (full-function), including its PXE boot-ROM. 00BF Remote Access Disables serial console redirection. 00C0 Serial port number Enables console redir e c[...]

Using the System Setup Program 123 011B SA T A P ort2 T urns off the 3rd Serial A T A drive controller . 011C SA T A P ort2 Enables BIOS s upport for the 3r d Serial A T A drive controller (enabled if presen t, POST error appears if not present). 011D SA T A P ort3 T urns off the 4th Serial A T A drive controller . 011E SA T A P ort3 Enables BIOS s[...]

124 Using the System Setup Program 013F Memory Remapping (3GB~4GB) When enabled, memory remapping relocates memory space (3GB - 4 GB) to the space above 4 GB. 0140 Execute-Disable (XD) Bit Capability When disabled, the Intel processors supporting the XD featur e reports th e support to the operating system. 0141 Execute-Disable (XD) Bit Capability [...]

Using the System Setup Program 125 0171 Adjacent Cache Line Prefetch Disables system optimization for sequential memory access. The processor fetc hes the cache line that contains the data it cu rrently r equires. 0172 Adjacent Cache Line Prefetch Enables system optimization for sequential memory access. The processor fetches the adjacent cache lin[...]

126 Using the System Setup Program 01CF I/O AT DMA Engine Enables the I/O Acceleration T echnology (I/OA T) DMA Engine feature. Set to enabled only if the ha rdw are an d s of tw are su pp or t I /OA T . 01D0 I/OA T DMA Engine Disables the I/OA T DMA Engine feature. This option should be disabled only if the har dware and software support I/OA T . [...]

Using the System Setup Program 127 0224 Embedded Video Controller Enables the onboard video controller as the primary video device. 0225 Embedded Video Controller Disables th e onboar d video controller . 022D Boot Mode Enables booting to Unified Extensible F irmware Interface (UEFI) capable operating systems. 022E Boot Mode Enables booting to lega[...]

128 Using the System Setup Program 0257 2F8h/3F8h Sets the back serial port addr ess to 0x2F8 and internal serial port address to 0x3F8. 025D Optimizer Mode Selects optimizer mode as the memory operating mode. 025E Spare Mode Selects spare mode as the memory operating mode. 025F Mirror Mode Selects mirror mode as the memory operating mode. 0260 Adv[...]

Using the System Setup Program 129 02A1 C1E State Enables the processor Enhanced Halt (C1E) state. (default) 02A2 C1E State Disables the processor C1-E state. Do at your own risk. When you disable this option, a warning appears in the BIOS Setup help text and a pop up message appears when this option is changing. 02A9 DRAM P refetcher Disables DRAM[...]

130 Using the System Setup Program 02C7 Data Reuse Optimi zation Sets to enable for HPC applications. (default) 02C8 Data Reuse Optimi zation Sets to disable for ener gy efficiency . 02C9 QPI Bandwidth Pr i or i t y Sets to compute for computation-intensive applications. (default) 02CA QPI Bandwidth Pr i or i t y Sets to I/O for I/O-intensive appli[...]

Using the System Setup Program 131 4026 Manufacturing Mode Enables the manufacturing mode to bypass POST tasks/memory tests and F1 /F2 prompts on specific error messages. Used by manufacturers only and is not for general use. 4027 Manufacturing Mode Disables the manufacturing mode to bypass POST tasks/memory tests and F1 /F2 prompts on specific err[...]

132 Using the System Setup Program 480A C6 State Disables the processor C6 state. Do at your own risk. When you disable this option, a warning appears in the BIOS Setup help text and a pop up message appears when this option is changing. 480B C6 State Enables the processor C6 state. (default) 480C L3 Cache P ower Contro l Disable the clock stop for[...]

Using the System Setup Program 133 4821 Memory T urbo Mode Enables memory turbo mode. 4822 NUMA Support Enables the node interleave option for SLES11. This applies to NUMA systems that allow memory interleaving across all processor nodes. 4823 Memory Fr e q u e n c y Detects the memory running speed from H/W designed (SPD, memory population). 4824 [...]

134 Using the System Setup Program 482D Demand Scrubbing Enables Demand scrubbing to write corrected data back to the memory once a correctable error is detected on a r e ad transacti on. 482E P atr ol Scrubbing Disables P atrol scrubbing to proactively search the system memory , repairing corr ectable errors. 482F P atrol Scrubbing Enables P atrol[...]

Using the System Setup Program 135 4845 PCIe Slot ASPM Controls the level of ASPM supported on the given PCI Express Link of port. L0s entry downstream and L1 enabled 4846 Onboard LAN ASPM Controls the level of ASPM supported to onboard LAN. All entry disabled. 4847 Onboard LAN ASPM Controls the level of ASPM supported to onboard LAN. L0s entry ena[...]

136 Using the System Setup Program 4854 Maximum Pa y l o a d S i z e Auto detects the PCIe maximum payload size. 4855 Maximum Pa y l o a d S i z e Sets the PCIe maximum payload size to 128 Bytes. 4856 Maximum Pa y l o a d S i z e Sets the PCIe maximum payload size to 256 Bytes. 4857 WHEA Support Disables W indows Hardwar e Error Architecture. 4858 [...]

Using the System Setup Program 137 4861 USB PORT with BMC Allow the users to electrical ly enable the internal USB port which contacts to BMC. 4870 F orce PXE Boot only Disables PXE to be the boot device only . 4871 F orce PXE Boot only Enables PXE to be the boot device only . The system retrying to bo ot from PXE device. 4873 Active Processor Core[...]

138 Using the System Setup Program 4888 2nd Boot Device Sets a USB storage device as the 2nd boot device. 4889 2nd Boot Device Sets the CD/D VD ROM as the 2nd boot device. 488A 3rd Boot Device Sets the network device as the 3rd boot device. 488B 3rd Boot Device Sets the har d-drive as the 3rd boot device. 488C 3r d Boot Device Sets R AID as the 3rd[...]

Using the System Setup Program 139 48A5 BMC NIC IP Source Sets BMC LAN to get LAN IP from DHCP mode. 48A6 IPv6 Mode Disables IPv6 internet protocol support. 48A7 IPv6 Mode Enables IPv6 internet protocol suppo rt. 48A8 IPv6 AutoConfig Disables IPv6 auto configuration. 48A9 IPv6 AutoConfig Enables IPv6 auto configuration. 48AA Serial P ort Mode Sets [...]

140 Using the System Setup Program 48B5 Memory Operating V oltage Indicates all DIMMs in the sy stem ar e operating at 1.25 volts. 48C0 F requency Ratio Sets frequenc y multiplier as maximum level. 48C1 Fr equency Ratio Downgrades frequency multiplier one le vel. 48C2 Fr equency Ratio Downgrades frequency multiplier two le vels. 48C3 Fr equency Rat[...]

Using the System Setup Program 141 48DA Save Customized Defaults Saves current settings to customized defaults of SETUP on next boot. 48DB N/A Requests maximum performance settings of SETUP values on the next boot. 48DC N/A Requests a ener gy efficiency settings of SETUP values on the nex t boot. 48DD N/A Requests HPCC efficiency settings of SETUP [...]

142 Using the System Setup Program 48E9 N/A Use HDD4 as the 1st HDD boot device on the next boot. 48EA N/A Use HDD5 as the 1st HDD boot device on the ne xt boot. 48EB N/A Use HDD6 as the 1st HDD boot device on the next boot. 48EC N/A Use RAID HDD1as the 1st R AID boot device on the next boot. 48ED N/A Use RAID HDD2 as the 1st RAID bo ot device on t[...]

Using the System Setup Program 143 48F9 N/A Use R AID HDD14 as the 1st R AID boot device on the next boot. 48F A N/A Use RA ID HDD15 as the 1st R AID boot device on the next boot. 48FB N/A Use RA ID HDD16 as the 1st R AID boot device on the next boot. 48FC N/A Use HDD7 as the 1st boot device o n the ne xt boot. 48FD N/A Use HDD8 as the 1st boot dev[...]

144 Using the System Setup Program 4916 Chassis L evel Po l i c y Selects throttling as the chassis level policy when an emergency throttling event is trigger ed. (default) 4917 Chassis L evel Po l i c y Selects power off as the cha ssis level policy when an emergency throttling event is triggere d. 4918 N/A Disables clock spread spectrum. (default[...]

Using the System Setup Program 145 IPMI Command List The following tables include all co mmands defined in the IPMI v2.0 specifications. All mandatory commands and some optional functions are supported. Special functions beyond the scope of IPMI v2.0 are implemented as original equipment manufacturer (OEM) commands. In the O/M column: • M = Manda[...]

146 Using the System Setup Program T able 2-2. IPMI Device Global Commands (Ne tFn: 0x06H) (continued) Command NetFn Code IPMI 2.0 BMC Get Configurable Commands App 0x0C O Y es Get Configurable Command Sub-functions App 0x0Dh O Y es Set Command Enables App 0x60h O Y es Get Command Enables App 0x61h O Y es Set Command Sub-function Enable s App 0x62h[...]

Using the System Setup Program 147 T able 2-5. BMC Device and Messagi ng Commands (NetFn: 0x 06H) (continued) Command NetFn Code IPMI2.0 BMC Get BT Interface Capabilities App 0x36h M No Get System GUID App 0x37h M Y es Set System Info P arameters App 0x58h O Y es Get System Info P arameters App 0x59h O Y es Get Channel Authentication Capabilities A[...]

148 Using the System Setup Program T able 2-5. BMC Device and Messagi ng Commands (NetFn: 0x 06H) (continued) Command NetFn Code IPMI2.0 BMC Get Channel P ayload V ersion App 0x4Fh O Y es Get Channel OEM P ayload Info App 0x50h O Y es Master W rite-Read I2C App 0x52h M Y es Get Channel Cipher Suites App 0x54h O Y es Suspend/Resume P ayload Encrypti[...]

Using the System Setup Program 149 T able 2-7. Event Commands (NetFn: 0x04H) Command NetFn Code IPMI2.0 BMC Set Event Receiver S/E 0x00h M Y es Get Event Receiver S/E 0x01h M Y es Platform Event S/E 0x02h M Y es T able 2-8. PEF/PET Alerting Commands (NetFn: 0x04H) Command NetFn Code IPMI2.0 BMC Get PEF Capabilities S/E 0x10h M Y es Arm PEF P os tpo[...]

150 Using the System Setup Program T able 2-10. S ensory Device Comma nds (NetFn: 0x04H) (continued) Command NetFn Code IPMI2.0 BMC Get Sensor Event Enable S/E 0x29h O Y es Set Sensor Reading and Event Status S/E 0x30h O Y es Re-arm Sensor Events S/E 0x2Ah O Y es Get Sensor Event Status S/E 0x2Bh O Y es Get Sensor Reading S/E 0x2Dh M Y es Set Senso[...]

Using the System Setup Program 151 * Support for Partial Add SEL is not requi red when Add SEL is supported. T able 2-12. SDR Repository Commands (NetFn: 0x0AH) (continued) Command NetFn Code IPMI2.0 BMC Set SDR Repository Time Storage 0x29h O Y es Enter SDR Repository Update Mode Storage 0x2Ah O No Exit SDR Repository Update Mode Storage 0x2Bh O N[...]

152 Using the System Setup Program T able 2-14. L AN Device Commands (NetFn: 0x0CH) Command NetFn Code IPMI2.0 BMC Set LAN Configuration P arameters ( Note: P arameter 9 and 25 are not supported.) T ransport 0x01h M Y es Get LAN Configuration P arameters ( Note: P arameter 9 and 25 are not supported.) T ransport 0x02h M Y es Suspend BMC ARP T ransp[...]

Using the System Setup Program 153 T able 2-16. Command Forwarding Commands (NetFn: 0x0CH) Command NetFn Code IPMI2.0 BMC F orwarded Command T ransport 0x30h O Y es Set F orwarded Commands T ransport 0x31h O Y es Get F orwarded Commands T ransport 0x32h O Y es Enable F orwarded Commands T ransport 0x33h O Y es T able 2-17. Firmware Update Commands [...]

154 Using the System Setup Program Power Management Settings The system BIOS provides various options fo r power settings to help you save energy , maximize system performance. The follo wing table provides a guide for power management settings. T able 2-20. P ower Management Settings Sy stem Setup Menu Setting M aximum Performance (48DB) Energy Ef[...]

Using the System Setup Program 155 Memory Configuration Memory F requency Auto 4823 800 MHz 4824 Memory T urbo Mode Enabled 4821 Disabled 4820 Memory Throttling Mode Disabled 4828 Enabled 4829 Memory O perating Vo l t a g e 1.5 V 02B6 1.35V/ 1.25V 02B7/ 48B5 SA T A Configuration Embedded SA T A Link State Auto 4834 1.5 Gbps 4835 P ower Saving F eat[...]

156 Using the System Setup Program SNMP The Simple Network Management P rotoc ol (SNMP) is an application layer protocol that facilitates the monitoring and management of server enclosure and the PDU device. About MIB and T raps A Management Information Base (M IB) is a collection of manag ed information that is organized hierarch ically . Manage d[...]

Using the System Setup Program 157 After FCB resets, all network and configur ation settings restor e back to their default values. FCB is conf igured with the follow ing default network se ttings. • IP address: 192.168.0.120 • Subnet mask: 255.255.255.0 When the reset to default button is pr esse d, the FCB status and identification indicator [...]

158 Using the System Setup Program By default, the FCB controller us es DHCP to acquir e an IP address. T he system MUST follow the same DHCP r etry mechanism that exists in the BMCs (any parameter needed for this MU ST be stored in the configura tion file). DHCP client MUST r etry forever . FCB Firmware Behavior The following table list s th e FCB[...]

Using the System Setup Program 159 Server enclosure with compute sleds • FCB firmware stays in safe boot mode and waits for BMC to update firm ware. • FCB firmwar e detects sled module s during init ializatio n only . When you r eplace a compute sled, the FC B controller needs to r eset to detect the new sled. • The rese t to defaul t button [...]

160 Using the System Setup Program MIB T ree Diagram for FCB[...]

Using the System Setup Program 161 FCB SNMP MIB T able 2-22. FCB SNMP MIB Category O bject Name Read/Wr ite Value T ype Oper ation FW Safe Boot FW Note Common Status read-o nly values: ok, error , safeBoot vv F i r m w a r e S t a t u s FW V ersion r ea d-only string v Firmwar e V ersion (OP code) Safe Ima ge FW V ersion read -only string v v F irm[...]

162 Using the System Setup Program FCB Control fc Initiate Upload rea d- wri te va lue s: FC/CPLD/ NetConfig vv I n i t i a t e u p l o a d power Consumption read-only Integer v Power consumption fcpsu Configuration rea d- wri te va lue s: x1n1, x2n0 v PSU Configuration , X1n1: X+N=1+1 X2n0: X+N=2+0 enable Manual F an Control read-write values: 1/0[...]

Using the System Setup Program 163 FCB Internal PSU T a ble psu Status read-only values: ok, error , na, acloss vP S U S t a t u s psu P ower Consumption rea d- onl y in te ger v PS U Powe r Consumption psu Max Po w e r rea d- onl y in te ger v PS U M ax P o we r FCB- T r ap trap Fr esh Air Enabled W ith All Storag eSled Tr a p f o r F r e s h A i [...]

164 Using the System Setup Program trap F an1 Speed W aring Clear ed T rap for F AN 1 S peed Wa r n i n g C l e a r e d trap F an2 Speed W aring Clear ed T rap for F AN 2 S peed Wa r n i n g C l e a r e d trap F an3 Speed W aring Clear ed T rap for F AN 3 S peed Wa r n i n g C l e a r e d trap F an4 Speed W aring Clear ed T rap for F AN 4 S peed Wa[...]

Using the System Setup Program 165 FCB- T rap trap F an1 Speed Pr ob le m Cleared Tr a p f o r F A N 1 S p e e d Pr ob le m Cl ea re d trap F an2 Speed Pr ob le m Cleared Tr a p f o r F A N 2 S p e e d Pr ob le m Cl ea re d trap F an3 Speed Pr ob le m Cleared Tr a p f o r F A N 3 S p e e d Pr ob le m Cl ea re d trap F an4 Speed Pr ob le m Cleared T[...]

166 Using the System Setup Program NOTE: In the Common category, both FC and PMC provides common OID. FCB- T rap trap Internal PSU2 AC Loss Cleared T rap for Intern al PSU2 AC Lost Cleared trap Internal PSU3 AC Loss Cleared T rap for Intern al PSU3 AC Lost Cleared trap Internal PSU4 AC Loss Cleared T rap for Intern al PSU4 AC Lost Cleared trap Inte[...]

Using the System Setup Program 167 SNMP Support for the External PDU Power Ma nagement Controller Board The P owerEdge C8000 server enclosur e is primarily connected to an external PDU. The external PDU includes a power management controller (PMC) board that allows you to monitor the PDU powe r supply modules over the network. When an error occurs [...]

168 Using the System Setup Program PMC Configuration Information The PMC configuration information is stored in the PMC boar d's internal EEPROM. Y ou must use TFTP server to retrieve the configuration data and then use Notepad or a text editor to view or change the configuration data. F or example, a configuration data sh ould have the follow[...]

Using the System Setup Program 169 PMC Firmware Behavior The following table lists th e PMC firmware behavior . T able 2-23. PMC Firmware Behavior Safe Boot Code Firmware Behavior Operational Code Fi rmware Behavior • P MC firmware enables network/SNMP service • PMC firmwar e update is done by TFTP via SNMP set obj ect property • The reset to[...]

170 Using the System Setup Program MIB T ree Diagram for PMC[...]

Using the System Setup Program 171 PMC SNMP MIB T able 2-24. PMC SNMP MIB Category O bject Name Read/Write Value T ype Operation FW Safe Boot FW Note Common Status r ead-only values: ok, error , safeBoot vv F i r m w a r e S t a t u s FW V ersion r ead-only string v Firmwar e V ersion (OP code) Safe Ima ge FW V ersion read-only string v v F irmware[...]

172 Using the System Setup Program Common lastUpdateSta tus read-only V alues: na, successfully , error , imageError , start, downloadIn Progr ess, download Successfully , downloadF ai led, upgradeInP r ogresspduUp gradeSucces sfully , psuUpgrade Successfully , pduUpgrade Fa i l e d , psuUpgrade Fa i l e d pduUpgrade Successfully , psuUpgrade Succe[...]

Using the System Setup Program 173 PMC PDU Fi r m w a re Ve r s i o n rea d- onl y s tri ng v P DU fi rmw are ve rsi on PDU Serial Number read-only string v PDU serial number , only supports when PDU version is 6.00.05 or later PDU State read-only values: ok, error , bootLoader vP D U s t a t e PDU P ower State rea d- wri te v alu es : on/off vP D [...]

174 Using the System Setup Program PSUs Ta b l e Number Of Ps u s read-only integer v Number of PSU PSUIndex not- accessible integer v PSU inde x PSUStatus read-only values: ok, error , na, acloss, bootLoader vP S U s t a t u s PSU Fi r m w a re Ve r s i o n rea d-o nl y s tri ng v PS U f ir mwa re v er sio n PSU Serial Number read-only string v PS[...]

Using the System Setup Program 175 AC Sockets Ta b l e Number Of AC So cket s read-only integer v Number of AC sock et AC So cket Index not- accessible integer v AC sock et inde x AC So cket Po w e r S t a t e rea d- wri te v alu es : on/off v AC sock et power state AC So cket Default P ower State rea d- wri te v alu es : on/off vA C s o c k e t d [...]

176 Using the System Setup Program PMC - Tr a p s trap PSU3 Under Vo l t a g e Clear ed V T rap for PSU3 under voltage cleared trap PSU4 Under Vo l t a g e Clear ed V T rap for PSU4 under voltage cleared trap PSU5 Under Vo l t a g e Clear ed V T rap for PSU5 under voltage cleared trap PSU6 Under Vo l t a g e Clear ed V T rap for PSU6 under voltage [...]

Using the System Setup Program 177 PMC - Tr a p s trap PSU3 Over V oltage Cleared V T rap for PSU3 over voltage cleared trap PSU4 Over V oltage Cleared V T rap for PSU4 over voltage cleared trap PSU5 Over V oltage Cleared V T rap for PSU5 over voltage cleared trap PSU6 Over V oltage Cleared V T rap for PSU6 over voltage cleared trap PSU1 Over Curre[...]

178 Using the System Setup Program PMC - Tr a p s trap PSU4 Over Current Clear ed VT r a p f o r P S U 4 o v e r current cleared trap PSU5 Over Current Clear ed VT r a p f o r P S U 5 o v e r current cleared trap PSU6 Over Current Clear ed VT r a p f o r P S U 6 o v e r current cleared trap PSU1 Over Te m p e r a t u r e Wa r n i n g VT r a p f o r[...]

Using the System Setup Program 179 PMC - Tr a p s trap PSU1 Over Te m p e r a t u r e Wa r n i n g Cleared V T rap for PSU1 over temperature warning cleared trap PSU2 Over Te m p e r a t u r e Wa r n i n g Cleared V T rap for PSU2 over temperature warning cleared trap PSU3 Over Te m p e r a t u r e Wa r n i n g Cleared V T rap for PSU3 over tempera[...]

180 Using the System Setup Program PMC - Tr a p s trap PSU3 Over Te m p e r a t u r e VT r a p f o r P S U 3 o v e r temperature trap PSU4 Over Te m p e r a t u r e VT r a p f o r P S U 4 o v e r temperature trap PSU5 Over Te m p e r a t u r e VT r a p f o r P S U 5 o v e r temperature trap PSU6 Over Te m p e r a t u r e VT r a p f o r P S U 6 o v [...]

Using the System Setup Program 181 PMC - Tr a p s trap PSU1 Under F an Speed V T rap for PSU1 under FA N s p e e d trap PSU2 Under F an Speed V T rap for PSU2 under FA N s p e e d trap PSU3 Under F an Speed V T rap for PSU3 under FA N s p e e d trap PSU4 Under F an Speed V T rap for PSU4 under FA N s p e e d trap PSU5 Under F an Speed V T rap for P[...]

182 Using the System Setup Program PMC - Tr a p s trap PSU5 Under F an Speed Clear ed V T rap for PSU5 under F AN spee d cleared trap PSU6 Under F an Speed Clear ed V T rap for PSU6 under F AN spee d cleared Tr a p P S U 1 Fa i l u re V T rap for PSU1 fa ilur e Tr a p P S U 2 Fa i l u re V T rap for PSU2 fa ilur e Tr a p P S U 3 Fa i l u re V T rap[...]

Using the System Setup Program 183 PMC - Tr a p s Tr a p P S U Mismatch V A m ismatch between PSU X+N configuration a nd populated PSU Tr a p P S U 1 Pr es ence Removed V T rap for PSU1 Pr esence Removed Tr a p P S U 2 Pr es ence Removed V T rap for PSU2 Pr esence Removed Tr a p P S U 3 Pr es ence Removed V T rap for PSU3 Pr esence Removed Tr a p P[...]

184 Using the System Setup Program PMC - Tr a p s Tr a p P S U 5 Fa i l u re Clear ed V T rap for PSU5 Failure Cleared Tr a p P S U 6 Fa i l u re Clear ed V T rap for PSU6 Failure Cleared Tr a p P S U 1 A c Back VT r a p f o r P S U 1 A C Back Tr a p P S U 2 A c Back VT r a p f o r P S U 2 A C Back Tr a p P S U 3 A c Back VT r a p f o r P S U 3 A C[...]

Using the System Setup Program 185[...]

186 Using the System Setup Program[...]

Installing System Components 187 3 Installing Sy stem Components Safety Instructions WAR NI NG : W orking on sy stems that are st ill connected to a power su pply can be extremely dangerous. CAUTION: Sy stem components and electronic circuit boards can be damaged by discharge of static electricity . CAUTION: Many repairs may only be done by a certi[...]

188 Installing System Components • Some cab les have a connector with locking tabs; if you are disconnecting this type of ca ble, press in on the locking tabs before you disconnect the cable. As you pull connectors apart, keep them evenly aligned to avoid bending any connector pins. A lso , before you connect a cable, ensure that both connectors [...]

Installing System Components 189 Inside the Sy stem CAUTION: Many repairs may only be done by a certified service technician. Y ou should only perform troublesho oting and simple re pairs as authorized in your product documentation, or as directed by the on line or telephone service and support team. Damage due to servicing that is not authorized i[...]

190 Installing System Components Sled Blank CAUTION: T o ensure proper airflow in the sy stem, if a module is removed it should be immediately replaced w ith another sled or sled blank. Removing a Double-Wide Sled Blank Squeeze and hold the r elease latches and slide the blank out of the enclosur e. See F igure 3-2. Figure 3-2. Removing and Install[...]

Installing System Components 191 Removing a Single-Wid e Sled Blank 1 P ull up on the sled blank latch at the bottom of the sled to disengage the sled from the server enclosure. See F igure 3-3. 2 Using t he handl e, slide t he sled ou t of the enclosur e. See F igure 3-3. Figure 3-3. Removing and Installing a Sing le-Wide Sled Blank Installing a S[...]

192 Installing System Components Compute Sleds Removing a Compute Sled CAUTION: Many repairs may only be done by a certified service technician. Y ou should only perform troubleshooting and si mple repairs as authorized in your product documentation, or as directed by the online or telephone service and support team. Damage due to servicing that is[...]

Installing System Components 193 Figure 3-4. Removing and Installing a C8220 Compute Sled Figure 3-5. Removing and Installing a C8220X Compute Sled 1 release latch 2 handle 1 release latch 2 handle 1 2 2 1[...]

194 Installing System Components Installing a Compute Sled CAUTION: Many repairs may only be done by a certified service technician. Y ou should only perform troubleshooting and si mple repairs as authorized in your product documentation, or as directed by the online or telephone service and support team. Damage due to servicing that is not authori[...]

Installing System Components 195 Figure 3-6. Removing and Installing a C8000XD Storage Sled Installing a Storage Sled CAUTION: Many repairs may only be done by a certified service technician. Y ou should only perform troublesho oting and simple re pairs as authorized in your product documentation, or as directed by the on line or telephone service [...]

196 Installing System Components Power Sled NOTE: This section applies to Power Edge C8 000 server enclosure with internal power source. Enclosure Power Guidelines Observe the following guidelines when connecting power to the enclosur e: • Alwa ys connect the enclosure’s A C power sockets to a single power source, switch, or PDU. • Make sur e[...]

Installing System Components 197 a. In a 2+0 PSU configuration, a power sled bl ank or a C8220 compute sled must be inst alled in the adjacent unoc cupied bay to maintai n proper coo ling airflow i n the enclosure. T able 3-1. PSU and Power Sled Support Matrix PSU Config Max. Power Redundant Power Sled Shutdown Maintenance Conditions 4+0 5600 W Not[...]

198 Installing System Components Inside a Power Sled Figure 3-7. Inside a Power Sled Removing a Power Sled CAUTION: Many repairs may only be done by a certified service technician. Y ou should only perform troubleshooting and si mple repairs as authorized in your product documentation, or as directed by the online or telephone service and support t[...]

Installing System Components 199 WAR NI NG : The PSU modules in the power sled may produce high voltages and energy hazards, which can cause bodily harm. Only trained service technicians are authorized to remove any components inside the power sled. WAR NI NG : T o reduce the risk of personal inju ry from hot surfaces, observe the thermal labels on[...]

200 Installing System Components Figure 3-8. Removing and Installing a Power Sled Installing a Power Sled CAUTION: Many repairs may only be done by a certified service technician. Y ou should only perform troubleshooting and si mple repairs as authorized in your product documentation, or as directed by the online or telephone service and support te[...]

Installing System Components 201 Removing the PSU1/3 Module Assembly CAUTION: Many repairs may only be done by a certified service technician. Y ou should only perform troublesho oting and simple re pairs as authorized in your product documentation, or as directed by the on line or telephone service and support team. Damage due to servicing that is[...]

202 Installing System Components Figure 3-10. Cable Routing for PSU1/3 Module Assembly 1 PSU power cable 2 PSU1 /3 module assembly 3 thumbscrews (2) 4 air baffle 1 PSU1/3 status indicator 2 P SU2/4 status indicator 3 power connector on PSU2/4 module 4 power connector on PSU1/3 module 5 power cable 6 PSU LED connector o n power interposer board 7 PS[...]

Installing System Components 203 Installing the PSU1/3 Module Assembly CAUTION: Many repairs may only be done by a certified service technician. Y ou should only perform troublesho oting and simple re pairs as authorized in your product documentation, or as directed by the on line or telephone service and support team. Damage due to servicing that [...]

204 Installing System Components 4 Lift the module assembly from the sled tray and then disconnect the power cable from the power supply . See F igure 3-11. 5 Remove the module assembly from the sled tray . See F igure 3-11. Figure 3-11. Removing and Instal ling a PSU2/4 Module Assembly Installing the PSU2/4 Module Assembly CAUTION: Many repairs ma[...]

Installing System Components 205 3 Slide the module assembly forwar d until the metal guides engage into the slots on the PSU bracket and ensur e that the module as sembly is fully seated into the front power distribution boar d. NOTE: Make sure the air baffle is properly seated and the power cable is neatly tucked into place. See Figure 3-11. 4 Re[...]

206 Installing System Components Figure 3-12. Removing and Installing a PSU Module Installing the PSU Mo dule CAUTION: Many repairs may only be done by a certified service technician. Y ou should only perform troubleshooting and si mple repairs as authorized in your product documentation, or as directed by the online or telephone service and suppor[...]

Installing System Components 207 Fan Modules The P owerEdge C8 000 server enclosure includes three pairs of hot-swappable fan modules that provi de the system wi th redundant cooling source. Each fan module contains two sepa rate cooling fans. All th r ee fan modules must be installed at all times t o ensur e proper cooling. NOTE: If a fan module i[...]

208 Installing System Components Figure 3-13. Removing and Installing the Fan Module Installing a Fan Module CAUTION: Many repairs may only be done by a certified service technician. Y ou should only perform troubleshooting and si mple repairs as authorized in your product documentation, or as directed by the online or telephone service and support[...]

Installing System Components 209 Front Panel Board Removing the Front Panel Board CAUTION: Many repairs may only be done by a certified service technician. Y ou should only perform troublesho oting and simple re pairs as authorized in your product documentation, or as directed by the on line or telephone service and support team. Damage due to serv[...]

210 Installing System Components 3 Disconnect the front panel board cable. See F igure 3-15. 4 Remove the front panel board from the enclosur e. See F igure 3-15. Figure 3-15. Removing and Inst alling the Front Panel Board Installing the Front Pa nel Board CAUTION: Many repairs may only be done by a certified service technician. Y ou should only pe[...]

Installing System Components 211 Fan Controller Board Removing the Fan C ontroller Board CAUTION: Many repairs may only be done by a certified service technician. Y ou should only perform troublesho oting and simple re pairs as authorized in your product documentation, or as directed by the on line or telephone service and support team. Damage due [...]

212 Installing System Components Installing the Fan Controller Board CAUTION: Many repairs may only be done by a certified service technician. Y ou should only perform troubleshooting and si mple repairs as authorized in your product documentation, or as directed by the online or telephone service and support team. Damage due to servicing that is n[...]

Installing System Components 213 3 Remove the four screws securing the fan bay cage and pull it out of the server enclosure. See F i gur e 3-17. Figure 3-17. Removing and Installing the Fan Bay Cage 1 screws (4) 2 fan bay cage 2 1[...]

214 Installing System Components 4 Open the front panel board cable reta ining clip and disconnect the cable from the power management board. See F igure 3-18. F or server enclosur e with external power source, see F igure 3-19. 5 Disconnect the fan cable from the power management boar d. See F igure 3-18. F or server enclosure with external power [...]

Installing System Components 215 Figure 3-19. Removing and Installing Sy stem Cables in Server Encl osure with External Power Source 1 fan cable 2 front panel board cable 3 cable retaining clip 4 front panel board connector 1 2 3 4[...]

216 Installing System Components 6 Remove the twenty screws securing th e backplane cage and pull it out of the server enclosure. See F igure 3-20. Figure 3-20. Removing and Installing the Backplane Cage Installing the Back plane/Fan Bay Cage CAUTION: Many repairs may only be done by a certified service technician. Y ou should only perform troubles[...]

Installing System Components 217 3 Connect the front panel board cable to the power management board and secure the cable in the r etaining clip . See F igure 3-18. F or server enclosure with external power source, see F igure 3-19. 4 Connect the fan cable to the power management boar d. See F igure 3-18. F or server enclosure with external power s[...]

218 Installing System Components 1 Locate the failed power supply module. If a po wer supply module is faulty the status indicator lights up amber . 2 Disconnect the power cable from the power supp ly module. See F igure 3-21. 3 Grasp the power su pply handle and press the release latch. See F igure 3-21. 4 Slide the power supply module out of it?[...]

Installing System Components 219 Installing a P DU Power Supply CAUTION: Many repairs may only be done by a certified service technician. Y ou should only perform troublesho oting and simple re pairs as authorized in your product documentation, or as directed by the on line or telephone service and support team. Damage due to servicing that is not [...]

220 Installing System Components[...]

Rack Mount Configuration 221 4 Rack Mount Configuration Y our P owerEdge C8000 server enclos ure can be mounted in a four-post rack cabinet. Installation Guidelines Use the following safety guidelines to help ensur e you r own personal safety and to help protect your system an d working environment from potential damage. See additional safety infor[...]

222 Rack Mount Configuration Recommended T ools Before you begin the installation tasks, ensure that you have the following items: • #1 Phil lips screwdriver • #2 Phil lips screwdriver • W rist grounding strap connected to ground • Antistatic mat or antistatic foam Installation T asks T o install the rail and system into the rack, you need [...]

Rack Mount Configuration 223 Installing the T ool-Less Rail Solution in the Rack NOTE: The rack rails are marked LEFT and RIGHT. The rail marked "LEFT" attaches to the left rack posts and the rail marked "RIGHT" attaches to the right rack posts when facing the front of the rack. NOTE: The rail pegs must be flush with the rack po[...]

224 Rack Mount Configuration Figure 4-1. Installing the Front End of the Rail e Pr ess and hold the rail release butto n to open the latch on the back end of the rail. See F igure 4-2. f Align the three pegs with the mounti ng holes on the back r ack post. See F igure 4-2. g Release the button when it engages to the back rack post. See F igure 4-2.[...]

Rack Mount Configuration 225 Figure 4-2. Installing the Back End of the Rail 1 rail release button 2 rail pegs (3) 3 rack post 1 2 3[...]

226 Rack Mount Configuration h Install one cage nut to the front ra ck post and two cage nuts to the back rack post. See F igure 4-3. Figure 4-3. Installing the Cage Nuts 1, 2 cage nuts (3) 1 2[...]

Rack Mount Configuration 227 i Align the stopping bracket to the ba ck rack post and secu re with the three 10 -32 screws. Apply 35 in-l bs o f torque to the screws. See F igure 4-4. Figure 4-4. Installing the Stopping Bracket 4 Attach the right rail and st opping bracket to the rack. Use the same procedure to install the ri ght rail and stopping b[...]

228 Rack Mount Configuration Removing Sled Modules from the Server Enclosure Befor e you install a P owerEdge C8000 se rver enclosur e into a rack, it is recommen ded that you remo ve all sled modules from the enclosur e to reduce system weight and avoid injury . F or instructions on removing components from the server enclosure, r e fer to the fol[...]

Rack Mount Configuration 229 1 W ith assistance, align the server enclos ure with the rails and push it fully into the rack. See F igure 4-5. Figure 4-5. Installing the Server Enclosure 1 PowerEdge C8000 server enclosure 2 tool-less rails (2) 1 2[...]

230 Rack Mount Configuration 2 Secure the front of the enclosure to the rack posts with four 10-32 screws. See F igure 4-6. Figure 4-6. Securing the Enclosure Replacing Sled Modules in the Server Enclosure F or instructions on replacing sled module s in the server enclosure, r efer to the following sections. • "Insta lling a Double- W ide Sl[...]

Rack Mount Configuration 231 Installing the External PDU into the Rack WAR NI NG : Whenever you need to lift the sy stem , get others to assist you. T o avoid injury , do not attempt to lift the sy stem by yourself. NOTE: The PDU device illustrations are provided as reference only. See PDU device documentation for more information about the PDU dev[...]

232 Rack Mount Configuration b Disconnect the PDU from the power source. 2 Remove the power cable interface box (PCIB) module. a Remove the two screws se curing the PCIB module. b Grasp the PCIB han dle and pull it out of it’s bay . Figure 4-8. Removing the PCIB Module 1 PDU device 2 breaker switches (3) 1 PDU device 2 PCIB module 3 screw (2) 1 2[...]

Rack Mount Configuration 233 3 Attach the mounting brackets to the sides of the PDU. a Affix the ten screws to the left and righ t sides of the PDU. See F igure 4-9. b P osition the left mounting brack et ma rked "L" to align the scr ew holes with the screws on the PDU and sl ide the mounting bracket toward the back of the PDU until it lo[...]

234 Rack Mount Configuration 4 Install the snorkel to the PDU. a Remove the air duct from the snorkel. b Align the air duct with the fron t of the PDU. See F igure 4-10. c Secure the air duct to the front of the PDU with the two scr ews. See F igure 4-10. Figure 4-10. Installing the Snorkel Air Duct to the PDU 1 snorkel air duct 2 screws (2) 3 PDU [...]

Rack Mount Configuration 235 d Align the snorkel with the rack posts. See F igure 4-11. e Secure the snork el to the rack pos ts with the four screws. See F igure 4-11. Figure 4-11. Installing the Snorkel 1 screws (4) FRONT 1[...]

236 Rack Mount Configuration 5 W ith assistance, slide the air duct into the bay and secur e the back of the PDU to the rack posts with four screws. See F igure 4-12. Figure 4-12. Installing the PDU 1 snorkel 2 air duct 3 PDU device 4 screws (4) FRONT 4 2 1 3[...]

Rack Mount Configuration 237 Connecting the Power Cables This section includes ins tructions on how to connect the server enclosur e with internal or e xternal powe r source to an external PDU. Connecting the P ower Cables to the Server Enclosure with Internal Power Source 1 On the back of the server enclosure, connect the power cables to the AC po[...]

238 Rack Mount Configuration Connecting the Power Cable to the Server En closure with External Power Source WAR NI NG : Make sure power is turned off on all devices before making connections. 1 On the back of the server enclosure, connect the powe r cable to the DC power socket. See F igure 4-14. 2 Tighten the two center scr ews on th e cable to se[...]

Rack Mount Configuration 239 Connecting the Server Encl osure to a Rack PDU WAR NI NG : Do not connect or disconnect power c ables to the PDU device while the PDU is energized. T urn off the PDU breaker swit ches to avoid potentially serious or fatal electrical shock. Move the PDU A, B, and C breaker switches to the "OFF" position. 1 Unlo[...]

240 Rack Mount Configuration 4 Attach the server enclosure(s) powe r cables to the PDU power bus bar . NOTE: The PDU device supports a maximum of five PowerEdge C8000 server enclosures depending on the system configuration and power budget. a Secure the three black power cable lugs to t he top power bus bar (GND) with thr ee screws. See F igure 4-1[...]

Rack Mount Configuration 241 Figure 4-17. Connecting Multiple Se rver Enclosures to the PDU 5 Close the cable cover and secure to the PDU. See F igure 4-15. 1 screws (12) 2 power bus bar (GND) 3 power bus bar (12 V) 4 PDU device 5 server enclosure 1 6 server enclosure 2 7 server enclosure 2 yello w power cables (3) 8 server enclosure 1 yellow power[...]

242 Rack Mount Configuration Connecting a Network Switch to a Rack PDU CAUTION: The PDU device’ s A, B, and C power sockets are for network switches only . Do not connect server enclosur e( s) or server(s) to these sockets. WAR NI NG : Exceeding 3 amps per outlet could cause sudden rack level power loss. Connect the network switch power cable to [...]

Rack Mount Configuration 243 Connecting the PDU to the Network 1 Install the power management cont roller (PMC) board into the PDU. a Unpack the PMC kit. b Slide the PMC board into the PMC tray . See F igure 4-19. c Secure the PMC bo ard to the PMC tray with the four screws. See F igure 4-19. Figure 4-19. Installing the Power Management Controller [...]

244 Rack Mount Configuration 2 Insert the PMC assembly into its enclosure bay . See F igure 4-20. 3 Secure the PMC assembly to the PDU with the two thumbscr ews. See F igure 4-20. Figure 4-20. Installing the PMC Assembly 1 thumbscrews (2) 2 PMC assembly 3 PDU device 1 2 3[...]

Rack Mount Configuration 245 4 Connect the network cable to the NIC port 1. See F igure 4-21. Figure 4-21. Connecting the Network Cable 1 NIC port 1 2 network cable 1 2[...]

246 Rack Mount Configuration Powering Up the Sy stems 1 Install the PCIB module into the PDU. a Insert the PCIB module into the PCIB bay . See F igure 4-22. b Secure the PCIB module to the PDU with the two screws. See F igure 4-22. Figure 4-22. Installing the PCIB Module c Connect the PDU to the power source. 1 PDU device 2 PCIB module 3 screws (2)[...]

Rack Mount Configuration 247 2 T urn on the PDU br ea k er swi tches by moving the A, B, and C break er switches to the "ON" position. See F ig ur e 4-23. Figure 4-23. T urning on the PDU Breaker Switches NOTE: The PMC board and PDU device illustrations used in this manual are provided as reference only. See PDU dev ice documentation for [...]

248 Rack Mount Configuration 3 T o enable monitoring of the PDU de vice over the network, turn on the PMC board by pressing the power button, located on the PMC board. The two indicators located on the front of the PMC board alerts you to the condition of the PDU power supply module, PMC board and managed sled modules. The following table lists the[...]

Rack Mount Configuration 249 NOTE: When connected to a power source, main power is automatically distributed to the PowerEdge C8000 server enclosure. After the server enclosure is powered up the power/event indicator on the front of the enclosure will light up green and main power is applied to all sleds in the enclosure. 4 T urn on the sleds in th[...]

250 Rack Mount Configuration[...]

Troubleshooting 251 5 T roubleshooting Safety First—For Y ou and Y our Sy stem WAR NI NG : Whenever you need to lift the sy stem , get others to assist you. T o avoid injury , do not attempt to lift the sy stem by yourself. WAR NI NG : Before removing the sy stem cov er , disconnect all power , then unplug the AC power cord, and then disconnect a[...]

252 Troubleshooting • If the system does not power on, chec k the LED display . If the power LED is not on, you may not be receiving A C power . Check the A C power cord to make sur e that it is securely connec ted. T roubleshooting Sy stem Startup Failure If your system halts during startup, especia lly after installing an operating system or re[...]

Troubleshooting 253 5 If another sled is installed, con nect the USB device to the sled. If the USB device works with a different sled, th e first sled may be faulty . If the problem is resolved, replace the faulty keyboar d/mouse. If the problem is not resolved, pr oceed to the next step to begin troubleshooting the other USB devices attached to t[...]

254 Troubleshooting T roubleshooting a NIC 1 Restart the compute sled and check for any system mess ages pertaining to the NIC controller . 2 Check the appropriate indicator on th e NIC connector . See "NIC Indicator Codes" on page 20. • If the link indicator does not light, check all cabl e connections. • If the activity indicator do[...]

Troubleshooting 255 T roubleshooting a W et Enclosure CAUTION: Many repairs may only be done by a certified service technician. Y ou should only perform troublesho oting and simple re pairs as authorized in your product documentation, or as directed by the on line or telephone service and support team. Damage due to servicing that is not authorized[...]

256 Troubleshooting 14 Reconnect the enclosure to the el ectrical outlet or the PDU. 15 T urn on the sleds and attached peripherals. 16 If the system fails to start, see "Getting Help" on page 289. T roubleshooting a Damaged Enclosure CAUTION: Many repairs may only be done by a certified service technician. Y ou should only perform troubl[...]

Troubleshooting 257 T roubleshooting Enclosure Fan Modules CAUTION: Many repairs may only be done by a certified service technician. Y ou should only perform troublesho oting and simple re pairs as authorized in your product documentation, or as directed by the on line or telephone service and support team. Damage due to servicing that is not autho[...]

258 Troubleshooting a. Open loop (curve A) is fan sp eed control (FSC) curve with default mode. b. Refer to the Fan Contr oller Firmware Response secti on for more information. c. Open loop (curve B) is FSC curve with emergen cy mode. d. Open loop (curve C) is FSC curve with fan fail ure mode. Fan Controller Firmware Response Refer to the tables be[...]

Troubleshooting 259 T able 5-3 lists the FC firmwar e responses in case sce nario 2: • Interval 1 — If the calculated value of the PWM is higher than 100%, the FC firmware will send a signal to th e fan to operate at 100% duty cycle and trigger sled throttling. • Interval 2 — If the calculated value of the PWM duty cycle is less than or equ[...]

260 Troubleshooting • Interval 2 — If the calculated value of the PWM duty cycle is less than or equal to 100%, th e FC firmware will send a signal to the fan to operate at the set duty cycle. • Interval 3 — If the calculated value of the PWM duty cycle is less than or equal to 100%, th e FC firmware will send a signal to the fan to operate[...]

Troubleshooting 261 • Interval 3 — If the calculated value of the PWM duty cycle is less than or equal to 100%, the FC firmware will sen d a signal to the fan to operate at the set duty cycle. • Interval 4 — If the calculated value of the PWM duty cycle is higher than 100%, the FC firmware will send a s ignal to the fan to operate at 100% d[...]

262 Troubleshooting T roubleshooting Cooling Problems P owerEdge C8000 server encl osure supports chiller -less fresh air cooling that enables th e enclosure to operate at room temperature and tolerate temperature spik es up to 45 °C (1 13 °F). F resh air cool ing controls temperature in the enclosure through fan speed. Outside air is drawn and c[...]

Troubleshooting 263 T o dis able fr esh air cooling in the enclosure: 1 Enter the following command: ipmitool -I lanpl us -P <passwor d> -U <username> -H <BMC IP address> raw <command> where -I lanplus is the LAN plus interfac e that uses the Remote Management Control P rotocol+ (RMCP+) protocol to communicate with the BMC o[...]

264 Troubleshooting <command> is the command for configuring the fresh air mode F or example, the command line should have the following format: ipmitool –I lanplus –P root -U r oot –H 192.168.70.58 raw 0x30 0x43 0x01 0x01 2 Y ou can do either of the following co mmands to view the server enclosure fresh air status: – T o view the ser[...]

Troubleshooting 265 Air Inlet T emperature Threshold Settings The table below lists the enclosur e’s ai r inlet temperature thr e sholds and the different fan controller firmware actions for each threshold. T able 5-6. Enclosure Air Inlet T emperature Threshold Settings Enclosure Inlet Condition Threshold Setting Ambient Te m p Threshold Level Ac[...]

266 Troubleshooting Fr e s h a i r mode Upper non-recoverable 52 °C (125.6 °F) Extremely high F an controller (FC) firmware shuts down the system. NOTE: The firmware re ads inlet temperatur e every 5 secs. If the inlet temp erature reach es non-recover able threshold, the firmware will star t to check the power status for each sled and initiate t[...]

Troubleshooting 267 T roubleshooting Sled Components The following procedures describe how to troubleshoot the following compute sled component s: •M e m o r y •H a r d - d r i v e s •E x p a n s i o n c a r d s • P rocessors • System board • Battery T roubleshooting Sy stem Memory CAUTION: Many repairs may only be done by a certified s[...]

268 Troubleshooting 5 Remove the sled from the enclosure. See "Removing a Compute Sle d" on page 192. See the compute sled’s documentation for more information. 6 Check the memory channels and ensure that they are populated corr ectly . 7 Reseat the memory modules in their sockets. See the compute sled’s documentation for more informa[...]

Troubleshooting 269 T roubleshooting a Hard- Drive CAUTION: Many repairs may only be done by a certified service technician. Y ou should only perform troublesho oting and simple re pairs as authorized in your product documentation, or as directed by the on line or telephone service and support team. Damage due to servicing that is not authorized by[...]

270 Troubleshooting T roubleshooting Ex pansion Cards CAUTION: Many repairs may only be done by a certified service technician. Y ou should only perform troubleshooting and si mple repairs as authorized in your product documentation, or as directed by the online or telephone service and support team. Damage due to servicing that is not authorized b[...]

Troubleshooting 271 7 Ensur e that each processor is properly installed. 8 Replace the cooling shroud. 9 Reinstall the sled in to the enclosur e . 10 T urn on the sled and attached peri pherals. 11 If the problem persists, turn off the sled and a ttached peripherals. 12 Remove the sled from the enclosure. 13 Remove the cooling shroud. 14 Remove pro[...]

272 Troubleshooting 3 Remove the mezzanine cards. See the compute sled’s documentation for more information. 4 Locate the NVRAM clear jumper on the system board. 5 Clear th e NVR AM. 6 Close the sled. 7 If there is still a problem with the compute sled, remove and reinstall the sled. If the problem persists, see "Getting Help" on page 2[...]

Troubleshooting 273 IRQ Assignment Conflicts Most PCI devices can share an IRQ with another device, but they cannot use an IRQ simultaneo usly . T o avoid this t y pe of conflict, see the documentation for each PCI device for specifi c IRQ requi rements. PCI IRQ pool definition is the BIOS code assig ned at run time. IRQ Line Assignment IRQ Line As[...]

274 Troubleshooting[...]

Updating Firmware Images and Monitoring the PDU Power Status 275 6 Updating Firmware Images and Monitoring the PDU Power Status V erifying and Updating the Fan Controller Board Firmware Vi a the Compute Sled Vi ewing the Fan Con troller Board Firmware V ersion Information 1 R un the command line interface. 2 Enter the following command line: cmd &g[...]

276 Updating Firmware Images and Moni toring the PDU Power Status Sample output: 3 After the process is completed, the new firmware and fan table versions display on the screen. V erifying and Updating t he Fan Controller Board Firmware V ia SNMP NOTE: The following procedure applies only when there are no compute sleds installed in the server encl[...]

Updating Firmware Images and Monitoring the PDU Power Status 277 2 Install a T rivial F ile T ransfer P rotocol (TFTP) server softwar e on your computer . TFTP is a simplifie d form of the FTP . It is used with the SNMP v2c command line interfaces to transfer files to and from the FCB, update the FCB firmware and modify the FCB confi guration infor[...]

278 Updating Firmware Images and Moni toring the PDU Power Status Viewing or Changing the FC B Configuration Information The FCB configuration inform ation is stored in the FCB board’s internal EEPROM. The F CB configuration file i s a te xt (TXT) file. Y ou must use TFTP server to r etrieve the configuratio n data and then use Notepad or a te xt[...]

Updating Firmware Images and Monitoring the PDU Power Status 279 Updating the FCB Firmware NOTE: The following procedure uses NET-SNMP, a free SNMP tool for Linux systems, available at www.net -snmp.org, as an example. NOTE: The snmpset community property command depends on the community string data in the FCB Configuration In formation. The defaul[...]

280 Updating Firmware Images and Moni toring the PDU Power Status Viewing the FCB Firmware V ersion Information NOTE: The following procedure uses NET-SNMP, a free SNMP tool for Linux systems, available at www.net-snmp.org, as an example. 1 Launch the NET -SNMP utility . 2 Use the snmpset command to view firmware version information. snmpget -v 2c [...]

Updating Firmware Images and Monitoring the PDU Power Status 281 Checking PDU Indicators The PMC power/s tatus and id entification indicators lights to indicate an error condition. • P ower/status indi cator blinks amber (about 1 Hz) to indicate an error condition. • Identifi cation indicator blinks blue (about 1 Hz). Resetting the PDU Network [...]

282 Updating Firmware Images and Moni toring the PDU Power Status Viewing or Changing the PM C Configuration Information The PMC configuration information is stored in the PDU PMC boar d’s internal EEPROM. The PMC co nfiguration file is a text (TX T) file. Y ou must use TFTP server to retrieve the configur ation data and then use Notepad or a tex[...]

Updating Firmware Images and Monitoring the PDU Power Status 283 Updating the PMC Firmware NOTE: The following procedure uses NET-SNMP, a free SNMP tool for Linux systems, available at www.net-snmp.org , as an example. 1 Use the TFTP server to upload th e PMC firmwar e image into the PMC EEPROM. 2 Launch the NET -SNMP utility . 3 Use the snmpset co[...]

284 Updating Firmware Images and Moni toring the PDU Power Status Viewing the PMC Firmware V ersion Information NOTE: The following procedure uses NET-SNMP, a free SNMP tool for Linux systems, available at www.net-snmp.org, as an example. 1 Launch the NET -SNMP utility . 2 Use the snmpset command to view firmware version information. snmpget -v 2c [...]

Jumpers and Connectors 285 7 Jumpers and Connectors This section describes the connectors on the various boards in the server enclosure. Server Enclosure Boards The server enclosu r e has three system boards that make up its building block. • Front P anel Board • F an Controller Board • P ower Manageme nt Boar d Front Panel Board Co nnectors [...]

286 Jumpers and Connectors Fan Controller Bo ard Connectors Figure 7-2. Fan Controller Board Connectors 1 power/event LED 2 system identification LED 3 thermal sensor 4 front panel connector 5 10/100 Mbit NIC LAN port 6 LAN activity LED 1 fan 3 fault LED 2 fan 2 fault LED 3 fan 1 fault LED 4 Service mode button 5 PDU PMBus connector 6 10/100 Mbit N[...]

Jumpers and Connectors 287 Power Manageme nt Board Connectors Figure 7-3. Front View of the Power Management Board Figure 7-4. Back View of the Power Management Board 1 front panel board connector 2 power bus bar 3 system fan connector 4 power connector (debug-use only) 5 power bus bar 6 fan controller board connector 1 node power distribution boa [...]

288 Jumpers and Connectors[...]

Getting Help 289 8 Getting Help Contacting Dell NOTE: If you do not have an active Inte rnet connection, you can find contact information on your purchase invoice, packi ng slip, bill, or Dell product catalog. Dell provides several online and telepho ne-based support and service options. Availability varies by co untry and product, and some service[...]

290 Getting Help[...]

FILE LOCATION: D:ProjectsUser GuideServerDellOOB HOMHardware Owners ManualChassisC8000 C8000_HOM_bk0IX.fm Index 291 Index A about the system, 11 B backplane cage installing, 2 1 6 re mo vi n g, 2 1 2 C command line interfaces, 120 compute sled installing, 1 9 4 re mo vi n g, 1 9 2 connectors fan controller boar d, 2 8 6 front panel board,[...]

FILE LOCATION: D:ProjectsUser GuideServ erDellOOBHOMHardware O wners ManualChassis C8000C8000_HOM_bk0IX.fm 292 Index front panel boar d connectors, 2 8 5 installing, 2 1 0 rem ov in g, 2 0 9 I indicator back-panel chassis identi fication, 1 9 back-panel fan 1/2 fault, 1 9 back-panel fan 3/4 fault, 1 9 back-panel fan 5/6 fault, 2 0 back-pa[...]

FILE LOCATION: D:ProjectsUser GuideServerDellOOB HOMHardware Owners ManualChassisC8000 C8000_HOM_bk0IX.fm Index 293 PDU power supply indicator code, 2 1 7 installing, 2 1 9 re mo vi n g, 2 1 7 POST error codes, 42 power managemen t boar d connectors, 2 8 7 power management settings, 154 power sled installing, 2 0 0 r e m o v i n g , 198, [...]

FILE LOCATION: D:ProjectsUser GuideServerDellOOB HOMHardware Owners ManualChassisC8000 C8000_HOM_bk0IX.fm Index 294 sled featur es, 26 double-wide comput e sled, 2 9 power sled, 3 6 single-wide compute sled , 2 6 storage sled, 3 4 sled module configuration, 24 SNMP , 156 FCB firmware behavior , 1 5 8 P M C f i r mw a r e b e h a v i o r ,[...]

FILE LOCATION: D:ProjectsUser GuideServerDellOOB HOMHardware Owners ManualChassisC8000 C8000_HOM_bk0IX.fm Index 295 T troubleshooting damaged enclosure, 2 5 6 enclosure components, 2 5 7 expansion car ds, 2 7 0 external connections, 2 5 2 fan module s, 2 5 7 hard-drive, 2 6 9 memory , 2 6 7 N I C , 254 processors, 2 7 0 serial device, 2 5[...]