SUPER MICRO Computer 6016GT-TF manual

S UPER S UPER S ER VER 6016XT -TF S UPER S ER VER 6016GT -TF S UPER S ER VER 6016GT -TF-TM2 S UPER S ER VER 6016GT -TF-TC2 ® USER’S MANUAL Revision 1.0c[...]

The information in this User ’s Manual has been carefully reviewed and is believed to be accurate. The vendor assumes no responsibility for any inaccuracies that may be contained in this document, makes no commitment to update or to keep current the information in this manual, or to notify any person or organization of the updates. Please Note: F[...]

Preface About This Manual This manual is written for professional system integrators and PC technicians. It provides information for the installation and use of the SuperServer 6016XT - TF/6016GT -TF/6016GT -TF-TM2/6016GT -TF-TC2. Installation and maintenance should be performed by experienced technicians only . The SuperServer 6016XT -TF/6016GT -T[...]

S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual iv Chapter 5: Advanced Serverboard Setup Chapter 5 provides detailed information on the X8DTG-DF serverboard, including the locations and functions of connectors, headers and jumpers. Refer to this chap- ter when adding or removing processors or main memory and when recon fi gur[...]

v Preface Notes[...]

vi T able of Contents Chapter 1 Introduction 1-1 Overview ......................................................................................................... 1-1 1-2 Serverboard Features ..................................................................................... 1-2 Processors ........................................................[...]

vii T able of Contents Installing the Server into a T elco Rack ........................................................... 2-9 2-5 Checking the Serverboard Setup .................................................................. 2-10 2-6 Checking the Drive Bay Setup .......................................................................2-1 1 Chapt[...]

viii Connecting the Control Panel ......................................................................... 5-3 5-4 I/O Ports .......................................................................................................... 5-4 5-5 Installing the Processor and Heatsink ............................................................ 5-5 Instal[...]

Chapter 1 Introduction 1-1 Overview The 6016XT -TF/6016GT -TF/6016GT -TF-TM2/6016GT -TF-TC2 is a GPU-optimized supercomputing server comprised of the SC818GTQ-1400B chassis and the X8DTG-DF serverboard. Please refer to our web site for information on operating systems that have been certi fi ed for use with the system (www .supermicro.com). Note :[...]

1-2 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual 1-2 Serverboard Features At the heart of the SuperServer 6016XT -TF/6016GT -TF/6016GT -TF-TM2/6016GT - TF-TC2 lies the X8DTG-DF , a dual processor serverboard based on the Intel 5520 chipset. Below are the main features of the X8DTG-DF . (See Figure 1-1 for a block diagram of[...]

1-3 Chapter 1: Introduction IPMI IPMI (Intelligent Platform Management Interface) is a hardware-level interface speci- fi cation that provides remote access, monitoring and administration for Supermicro server platforms. IPMI allows server administrators to view a server ’s hardware status remotely , receive an alarm automatically if a failure o[...]

1-4 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual GPU Speci fi cations Server Model GPU Subsystem 6016XT -TF Riser cards included for PCI expansion (see note below) 6016GT -TF 2x Gen 2.0 PCI-E x16 slots for double-width GPUs (GPUs not included) 6016GT -TF-TM2 2x Nvidia T esla M1060 GPUs (preinstalled) 6016GT -TF-TC2 2x Nvid[...]

1-5 Chapter 1: Introduction Figure 1-1. Intel 5520 Chipset: System Block Diagram Note: This is a general block diagram. Please see Chapter 5 for details. CPU #2 CPU #1 QPI #1 #1 #1 #2 DDR3 DIMM #2 #2 DDR3 DIMM #1 #1 #1 DDR3 DIMM #2 #2 #2 DDR3 DIMM C C A A B B D D E E F F Intel 5520 IOH36D Link1 ICH10R ESI PE 4-1 PE 5 Winbond BMC/VGA VGA CONN DDR II[...]

1-6 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual 1-5 Contacting Supermicro Headquarters Address: Super Micro Computer , Inc. 980 Rock Ave. San Jose, CA 95131 U.S.A. T el: +1 (408) 503-8000 Fax: +1 (408) 503-8008 Email: marketing@supermicro.com (General Information) support@supermicro.com (T echnical Support) Web Site: www .[...]

Chapter 2: Server Installation 2-1 Chapter 2 Server Installation 2-1 Overview This chapter provides a quick setup checklist to get your SuperServer up and running. Following these steps in the order given should enable you to have the system operational within a minimum amount of time. This quick setup assumes that your system has come to you with [...]

2-2 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual • This product is not suitable for use with visual display work place devices acccording to §2 of the the German Ordinance for Work with V isual Display Units. 2-4 W arnings and Precautions Rack Precautions • Ensure that the leveling jacks on the bottom of the rack are f[...]

Chapter 2: Server Installation 2-3 Rack Mounting Considerations Ambient Operating T emperature If installed in a closed or multi-unit rack assembly , the ambient operating tempera- ture of the rack environment may be greater than the ambient temperature of the room. Therefore, consideration should be given to installing the equipment in an environm[...]

2-4 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual 2-4 Installing the System into a Rack This section provides information on installing the SC818G chassis into a rack unit with the rails provided. There are a variety of rack units on the market, which may mean that the assembly procedure will differ slightly . Y ou should al[...]

Chapter 2: Server Installation 2-5 Figure 2-2. Installing the Inner Rails 1 1 1 2 1 3 Installing the Inner Rail Extensions The SC818G chassis includes a set of inner rack rails in two sections: inner rails (A) and inner rail extensions (B). The inner rails are preattached and do not interfere with normal use of the chassis if you decide not to inst[...]

2-6 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual Figure 2-3. Assembling the Outer Rails Assembling the Outer Rails Each outer rail is in two sections that must be assembled before mounting on to the rack. Assembling the Outer Rails 1. Identify the left and right outer rails by examining the ends, which bend outward. 2. Slid[...]

Chapter 2: Server Installation 2-7 Figure 2-4. Installing the Outer Rails to the Rack Installing the Outer Rails onto the Rack Outer Rail Installation 1. Adjust the outer rails to the proper length so that the outer rail fi ts snugly within the rack. 2. Align the holes on the front of the outer rail, with the holes on the front of the rack (C) and[...]

2-8 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual Figure 2-5. Installing the Server into a Rack Installing the Chassis into a Rack (Figure 2-5) 1. Con fi rm that chassis includes the inner rails and rail extensions . Also, con fi rm that the outer rails are installed on the rack. 2. Line chassis rails with the front of the[...]

Chapter 2: Server Installation 2-9 Installing the Server into a T elco Rack Optional brackets (p/n MCP-290-00016-0N) are needed to install the server to a telco (open type) rack. T o install the server into a T elco type rack, use the two L-shaped brackets on either side of the chassis (four total). First, determine how far follow the server will e[...]

2-10 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual 2-5 Checking the Serverboard Setup After you install the server in the rack, you will need to open the unit to make sure the serverboard is properly installed and all the connections have been made. Removing the Chassis Cover (Figure 2-7) 1. Remove the three screws securing [...]

Chapter 2: Server Installation 2-1 1 Checking the Components 1. Y ou may have processors already installed to the serverboard. Each proces- sor needs its own heatsink. See Chapter 5 for instructions on processor and heatsink installation. 2. Y our server system may have come with system memory already installed. Make sure all DIMMs are fully seated[...]

2-12 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual Providing Power 1. The last thing you must do is to provide input power to the system. Plug the power cord from the power supply unit into a high-quality power strip that of- fers protection from electrical noise and power surges. It is recommended that you use an uninterrup[...]

Chapter 3: System Interface 3-1 Power The main power button is used to apply or remove power from the power supply to the server system. T urning off system power with this button removes the main power but keeps standby power supplied to the system. Chapter 3 System Interface 3-1 Overview There are several LEDs on the control panel as well as othe[...]

3-2 SUPERSERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual Figure 3-1. Universal Information LED States Note: deactivating the UID LED must be performed in the same way it was activated. (If the UID LED was activated via IPMI, you can only turn the LED off via IPMI and not with the UID button.) Universal Information LED States State Ind[...]

Chapter 3: System Interface 3-3 1 3-4 SA T A Drive Carrier LEDs • Green: Eac h S er i al A T A dr i ve c ar r i e r has a g re en L ED. Wh en i llu mi nate d, th is gre en LE D ( on t he f ro nt of th e SA T A d ri ve ca r ri er) indi c ates d ri ve act iv it y . A c onn ec ti on to t he SA T A ba ck pla ne en abl es t his LE D to bli nk on and o[...]

3-4 SUPERSERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual Notes[...]

4-1 Chapter 4: W arning Statements for AC Systems Chapter 4 Standardized W arning Statements for AC Systems 4-1 About Standardized W arning Statements The following statements are industry standard warnings, provided to warn the user of situations which have the potential for bodily injury . Should you have questions or experience difficulty , cont[...]

4-2 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual W arnung WICHTIGE SICHERHEITSHINWEISE Dieses W arnsymbol bedeutet Gefahr . Sie be fi nden sich in einer Situation, die zu V erletzungen führen kann. Machen Sie sich vor der Arbeit mit Geräten mit den Gefahren elektrischer Schaltungen und den üblichen V erfahren zur V orbe[...]

4-3 W arning Statements for AC Systems 안전을 위한 주의사항 경고! 이 경고 기호는 위험이 있음을 알려 줍니다. 작업자의 신체에 부상을 야기 할 수 있는 상태에 있게 됩니다. 모든 장비에 대한 작업을 수행하기 전에 전기회로와 관련된 위험요소들을 확인하시고 사전에 사고[...]

4-4 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual Installation Instructions W arning! Read the installation instructions before connecting the system to the power source. W arnung V or dem Anschließen des Systems an die Stromquelle die Installationsanweisungen lesen. ¡Advertencia! Lea las instrucciones de instalación ante[...]

4-5 Chapter 4: W arning Statements for AC Systems Circuit Breaker W arning! This product relies on the building's installation for short-circuit (overcurrent) protection. Ensure that the protective device is rated not greater than: 250 V , 20 A. サーキ ッ ト ・ ブ レ ーカー この 製 品 は 、 短絡 （過電流 ） 保護装置[...]

4-6 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual Power Disconnection W arning 電源切断の警告 システムコン ポ ー ネン トの 取り 付 けまた は 取り 外し の た め に 、 シ ャ ー シー内部に ア ク セ ス する に は 、 シ ステムの 電 源 は す べ てのソースから 切[...]

4-7 Chapter 4: W arning Statements for AC Systems ¡Advertencia! El sistema debe ser disconnected de todas las fuentes de energía y del cable eléctrico quitado de los módulos de fuente de alimentación antes de tener acceso el interior del chasis para instalar o para quitar componentes de sistema. Attention Le système doit être débranché de [...]

4-8 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual Equipment Installation 機器の設置 ト レ ーニ ン グを受け認 定 さ れた人だけが こ の装 置 の設 置 、 交換 、 ま たはサー ビ スを許 可 されて いま す 。 W arning! Only trained and quali fi ed personnel should be allowed to ins[...]

4-9 Chapter 4: W arning Statements for AC Systems ア ク セ ス 制限区域 この ユ ニッ ト は 、 ア ク セ ス 制限区域に 設置 さ れ る こ と を 想定 し て い ま す 。 ア ク セ ス 制限区域は 、 特別な ツ ール 、 鍵と 錠 前 、 その他の セキ ュ リ テ ィ の手段 を用い て の み[...]

4-10 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual Battery Handling W arning! There is the danger of explosion if the battery is replaced incorrectly . Replace the battery only with the same or equivalent type recommended by the manufacturer . Dispose of used batteries according to the manufacturer's instructions תלב[...]

4-1 1 Chapter 4: W arning Statements for AC Systems W arnung Bei Einsetzen einer falschen Batterie besteht Explosionsgefahr . Ersetzen Sie die Batterie nur durch den gleichen oder vom Hersteller empfohlenen Batterietyp. Entsorgen Sie die benutzten Batterien nach den Anweisungen des Herstellers. Attention Danger d'explosion si la pile n'es[...]

4-12 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual W arnung Dieses Gerät kann mehr als eine Stromzufuhr haben. Um sicherzustellen, dass der Einheit kein trom zugeführt wird, müssen alle V erbindungen entfernt werden. ¡Advertencia! Puede que esta unidad tenga más de una conexión para fuentes de alimentación. Para corta[...]

4-13 Chapter 4: W arning Statements for AC Systems Backplane V oltage バ ッ ク プ レー ンの電圧 シ ス テ ムの稼働 中は危 険な電圧 ま た は電 力が、 バッ ク プレ ーン 上 にか かっ ていま す 。 修理す る 際に は注意 く だ さ い 。 警告 当系统正在进行时，背板上有很危险的?[...]

4-14 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual Comply with Local and National Electrical Codes W arning! Installation of the equipment must comply with local and national electrical codes. 地方お よ び国 の電気規格に 準拠 機器の取 り 付け は そ の地方 お よ び国の電気規格に 準拠 す [...]

4-15 Chapter 4: W arning Statements for AC Systems Product Disposal W arning! Ultimate disposal of this product should be handled according to all national laws and regulations. יצראה למשחה יקוח םואית ! הרהזא תנקתה םייצראהו םיימוקמה למשחה יקוחל תמאות תוי הל תבייח דויצה . ﺕ[...]

4-16 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual W aarschuwing De uiteindelijke verwijdering van dit product dient te geschieden in overeenstemming met alle nationale wetten en reglementen. ¡Advertencia! Al deshacerse por completo de este producto debe seguir todas las leyes y reglamentos nacionales. Attention La mise au [...]

4-17 Chapter 4: W arning Statements for AC Systems W arnung Die Lüfter drehen sich u. U. noch, wenn die Lüfterbaugruppe aus dem Chassis genommen wird. Halten Sie Finger , Schraubendreher und andere Gegenstände von den Öffnungen des Lüftergehäuses entfernt. ¡Advertencia! Los ventiladores podran dar vuelta cuando usted quite ell montaje del ve[...]

4-18 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual W arning! When installing the product, use the provided or designated connection cables, power cables and AC adaptors. Using any other cables and adaptors could cause a malfunction or a fi re. Electrical Appliance and Material Safety Law prohibits the use of UL or CSA -cert[...]

4-19 Chapter 4: W arning Statements for AC Systems Attention Lors de l'installation du produit, utilisez les bables de connection fournis ou désigné. L'utilisation d'autres cables et adaptateurs peut provoquer un dysfonctionnement ou un incendie. Appareils électroménagers et de loi sur la sécurité Matériel interdit l'util[...]

4-20 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual Notes[...]

Chapter 5: Advanced Serverboard Setup 5-1 Chapter 5 Advanced Serverboard Setup This chapter covers the steps required to install the X8DTG-DF serverboard into the chassis, connect the data and power cables and install add-on cards. All serverboard jumpers and connections are also described. A layout and quick reference chart are included in this ch[...]

5-2 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual Unpacking The serverboard is shipped in antistatic packaging to avoid electrical static dis- charge. When unpacking the board, make sure the person handling it is static protected. 5-2 Serverboard Installation This section explains the fi rst step of physically mounting the [...]

Chapter 5: Advanced Serverboard Setup 5-3 5-3 Connecting Cables Now that the serverboard is installed, the next step is to connect the cables to the board. These include the data (ribbon) cables for the peripherals and control panel and the power cables. Connecting Data Cables The ribbon cables used to transfer data from the peripheral devices have[...]

5-4 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual 1 8 7 5 6 4 3 2 IO Ports 1 USB Port 0 5 LAN Port 2 2 USB Port 1 6 COM Port 3 IPMI Dedicated LAN 7 VGA Port 4 LAN Port 1 8 UID Button 5-4 I/O Ports The I/O ports are color coded in conformance with the PC 99 speci fi cation. See Figure 5-2 below for the colors and locations o[...]

Chapter 5: Advanced Serverboard Setup 5-5 5-5 Installing the Processor and Heatsink W arning! Avoid placing direct pressure to the top of the processor package. Always remove the power cord fi rst before adding, removing or changing any hardware com- ponents. Notes: • Always connect the power cord last and always remove it before adding, re- mov[...]

5-6 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual 1. After removing the plastic cap, use your thumb and the index fi nger to hold the CPU at the north and south center edges. 2. Align the CPU key (the semi-circle cutout) with the socket key (the notch below the gold color dot on the side of the socket). 3. Once the CPU and [...]

Chapter 5: Advanced Serverboard Setup 5-7 1. Remove power from the system and unplug the AC power cord from the power supply . 2. Do not apply any thermal grease to the heatsink or the CPU die; the required amount has already been applied. 3. Place the heatsink on top of the CPU so that the four mounting holes are aligned with those on the (preinst[...]

5-8 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual Memory Support The X8DTG-DF supports up to 192 GB of registered ECC or up to 48 GB of unbuf- fered ECC/non-ECC DDR3-1333/1066/800 MHz SDRAM in 12 DIMM slots. See the following table for memory installation. Notes: With unbuffered ECC/non-ECC memory , 2 GB is the maximum DIMM [...]

Chapter 5: Advanced Serverboard Setup 5-9 DIMM Population T able DIMM Slots per Channel DIMMs Populated per Channel DIMM T ype (Reg.= Registered) Speeds (in MHz) Ranks per DIMM (any combination; SR=Single Rank, DR=Dual Rank, QR=Quad Rank) 2 1 Reg. DDR3 ECC 800,1066,1333 SR or DR 2 1 Reg. DDR3 ECC 800,1066 QR 2 2 Reg. DDR3 ECC 800,1066 Mixing SR, DR[...]

5-10 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual 5-6 Adding PCI Add-On Cards The 6016XT -TF (without GPUs installed) can support four full size PCI-E x8 cards in the x16 slots and (with a riser card) one low-pro fi le PCI-E x4 card in a x16 slot. The 6016GT series servers can (in addition to two NVIDIA T esla GPU cards) s[...]

Chapter 5: Advanced Serverboard Setup 5-1 1 Figure 5-5. X8DTG-DF Layout (not drawn to scale) 5-7 Serverboard Details Notes Jumpers not indicated are for test purposes only . " " indicates the location of Pin 1. When the LE1 LED is on, power is present on the board. Make sure to unplug the AC power cord before removing or installing compon[...]

5-12 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual X8DTG-DF Quick Reference Jumper Description Default Setting JBMC1* BMC (Baseboard Management CTRL) Enable Pins 1-2 (Enabled) JBT1 CMOS Clear (See Section 5-9) JPG1 VGA Enable Pins 1-2 (Enabled) JPL1 LAN1/2 Enable Pins 1-2 (Enabled) J_UID_OW Red LED OW (Pins 7/8 of JF1) Off ([...]

Chapter 5: Advanced Serverboard Setup 5-13 Power Button Connector The PW_ON connector is on pins 1 and 2 of JF1. Momentarily contacting both pins will power on/off the system. This button can also be con fi gured to function as a suspend button (with a setting in the BIOS - see Chapter 4). T o turn off the power when set to suspend mode, press the[...]

5-14 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual NIC2 LED Pin De fi nitions (JF1) Pin# De fi nition 9 Vcc 10 Ground NIC2 (JLAN2) LED The LED connections for JLAN2 are on pins 9 and 10 of JF1. Attach an LED cable to display network activity . See the table on the right for pin de fi nitions. NIC1 LED Pin De fi nitions ([...]

Chapter 5: Advanced Serverboard Setup 5-15 HDD/FP UID Button The HDD/UID button connections are located on pins 13/14 of JF1. Attach a hard-drive LED cable to display HDD or SA T A activity . This connection can also be used for the front panel UID (Unit Identi- fi er) button. (The UID LED on pin 7 of JF1 works in conjunction with the UID button.)[...]

5-16 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual LAN1/2 (Ethernet Ports) T wo Ethernet ports (designated LAN1 and LAN2) are located beside the VGA port on the I/O backplane. These ports accept RJ45 type cables. Serial Port A serial port is included on the I/O back- panel. See the table on the right for pin de fi nitions. [...]

Chapter 5: Advanced Serverboard Setup 5-17 IPMB A System Management Bus header for the IPMI is located at IPMB. Connect the ap- propriate cable here to use the IPMB I 2 C connection on your system. IPMB Header Pin De fi nitions Pin# De fi nition 1 Data 2 Ground 3 Clock 4 No Connection PWR I 2 C Connector This System Management Bus (I 2 C) con- ne[...]

5-18 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual Internal Speaker Attach a speaker to the JSPK1 pins to provide audible alarms for the beep codes. See the table on the right for pin de fi nitions. Internal Speaker Pin De fi nitions Pin# De fi nitions Pin 1 Pos. (+) Beep In Pin 2 Neg. (-) Alarm Speaker T rusted Platform [...]

Chapter 5: Advanced Serverboard Setup 5-19 5-9 Jumper Settings Explanation of Jumpers T o modify the operation of the serverboard, jumpers can be used to choose between optional settings. Jumpers create shorts between two pins to change the function of the con- nector . Pin 1 is identi fi ed with a square solder pad on the printed circuit board. S[...]

5-20 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual LAN1/2 Enable/Disable Change the setting of jumper JPL1 to en- able or disable the LAN1/LAN2 Ethernet ports on the serverboard. See the table on the right for jumper settings. The default setting is enabled. LAN1/2 Enable/Disable Jumper Settings Jumper Setting De fi nition [...]

Chapter 5: Advanced Serverboard Setup 5-21 5-10 Onboard Indicators LAN1/2 LEDs The Ethernet ports have two LEDs. On each port, one LED indicates activity while the other LED may be green, amber or off to indicate the speed of the connec- tion. See the table on the right for the functions associated with the connection speed LED. Note: the dedicated[...]

5-22 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual 5-1 1 SA T A Ports SA T A Ports There are no jumpers to con fi gure the onboard SA T A connectors. See the table on the right for pin de fi nitions. SA T A Port Pin De fi nitions Pin # De fi nition 1 Ground 2 TXP 3 TXN 4 Ground 5 RXN 6 RXP 7 Ground[...]

Chapter 5: Advanced Serverboard Setup 5-23 5-12 Installing Software After the hardware has been installed, you should fi rst install the operating system and then the drivers. The necessary drivers are all included on the Supermicro CDs that came packaged with your system. Driver/T ool Installation Display Screen Note: Click the icons showing a ha[...]

5-24 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual Supero Doctor III The Supero Doctor III program is a web-based management tool that supports remote management capability . It includes Remote and Local Management tools. The local management is called SD III Client. The Supero Doctor III program in- cluded on the CD-ROM tha[...]

Chapter 5: Advanced Serverboard Setup 5-25 Note: SD III Software Revision 1.0 can be downloaded from our Web Site at: ftp:// ftp.supermicro.com/utility/Supero_Doctor_III/. Y ou can also download the SDIII User's Guide at: http://www .supermicro.com/manuals/other/SDIII_User_Guide.pdf. For Linux, we will recommend using Supero Doctor II. Supero [...]

5-26 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual Notes[...]

Chapter 6: Advanced Chassis Setup 6-1 Chapter 6 Advanced Chassis Setup This chapter covers the steps required to install components and perform mainte- nance on the SC818GTQ chassis. For component installation, follow the steps in the order given to eliminate the most common problems encountered. If some steps are unnecessary , skip ahead to the ne[...]

6-2 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual Figure 6-1. Chassis: Front and Rear Views 6-2 Control Panel The control panel (located on the front of the chassis) must be connected to the JF1 connector on the serverboard to provide you with system status indications. A ribbon cable has bundled these wires together to simp[...]

Chapter 6: Advanced Chassis Setup 6-3 System Fan Failure Fan speed is controlled by system temperature via a BIOS setting. If a fan fails, the remaining fans will ramp up to full speed. Replace any failed fan at your earli- est convenience with the same type and model (the system can continue to run with a failed fan). Replacing a System Fan (Figur[...]

6-4 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual 6-4 Drive Bay Installation/Removal Accessing the Drive Bays Hard Drives: Because of their hotswap capability , you do not need to access the inside of the chassis or power down the system to install or replace hard drives. Proceed to the next section for instructions. Periphe[...]

Chapter 6: Advanced Chassis Setup 6-5 Figure 6-3. Removing a Hard Drive Carrier W arning: Except for short periods of time (swapping hard drives), do not operate the server with the hard drive carriers removed. 1 1 1 2[...]

6-6 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual Installing a Hard Drive to the Hard Drive Carrier 1. Remove the two screws securing the dummy drive to the carrier . 2. Remove the dummy drive from the carrier . 3. Install a new drive into the carrier with the printed circuit board side facing downward so that the mounting h[...]

Chapter 6: Advanced Chassis Setup 6-7 Note: When installing the hard drive carrier that is next to the power supply , the power supply handle must be lifted before extending the hard drive carrier handle, or before inserting the hard drive carrier into the drive bay . Figure 6-5. Installing/Removing the Carrier Next to the Power Supply Peripheral D[...]

6-8 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual 6-5 Installing the Air Shroud Air shrouds concentrate air fl ow to maximize fan ef fi ciency . The air shroud for the SC818GTQ chassis does not require screws to set up. Installing the Air Shroud 1. Position the air shroud in the chassis as illustrated above. 2. Align the n[...]

Chapter 6: Advanced Chassis Setup 6-9 6-6 Power Supply The system includes a single 1400 watt power supply , which is auto-switching capa- ble. Power must be removed from the system when replacing the power supply . Power Supply Failure If the power supply module fails, the system will shut down and you will need to replace the module. Replacements[...]

6-10 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual Notes[...]

Chapter 7: BIOS 7-1 Chapter 7 BIOS 7-1 Introduction This chapter describes the AMI BIOS Setup Utility for the X8DTG-DF . The AMI ROM BIOS is stored in a Flash EEPROM and can be easily updated. This chapter describes the basic navigation of the AMI BIOS Setup Utility setup screens. Starting BIOS Setup Utility T o enter the AMI BIOS Setup Utility scr[...]

7-2 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual Starting the Setup Utility Normally , the only visible Power-On Self-T est (POST) routine is the memory test. As the memory is being tested, press the <Delete> key to enter the main menu of the AMI BIOS Setup Utility . From the main menu, you can access the other setup [...]

Chapter 7: BIOS 7-3 Supermicro X8DTG-DF • BIOS Build V ersion : This item displays the BIOS revision used in your sys- tem. • BIOS Build Date : This item displays the date when this BIOS was completed. • AMI BIOS Core V ersion : This item displays the revision number of the AMI BIOS Core upon which your BIOS was built. Processor The AMI BIOS [...]

7-4 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual 7-3 Advanced Setup Con fi gurations Use the arrow keys to select Boot Setup and hit <Enter> to access the submenu items:  BOOT Features Quick Boot If Enabled, this option will skip certain tests during POST to reduce the time needed for system boot. The options are [...]

Chapter 7: BIOS 7-5 Hit 'Del' Message Display Th is feat ure d isp lays " Pre ss D EL to r un S etup" d ur ing P OST . The options are Enabled and Disabled. Interrupt 19 Capture Interrupt 19 is the software interrupt that handles the boot disk function. When this item is set to Enabled, the ROM BIOS of the host adaptors will &qu[...]

7-6 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual C1E Support Select Enabled to use the feature of Enhanced Halt State. C1E signi fi cantly reduces the CPU's power consumption by reducing the CPU's clock cycle and voltage during a "Halt State." The options are Disabled and Enabled . Hardware Prefetcher ([...]

Chapter 7: BIOS 7-7 tion and heat dissipation. Please refer to Intel’ s web site for detailed information. The options are Disable (Disable GV3) and Enable (Enable GV3) . Intel® T urboMode T echnology Select Enabled to use the T urbo Mode to boost system performance. The options are Enabled and Disabled. Intel® C-ST A TE T ech If enabled, C-Sta[...]

7-8 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual QPI L0s and L1 This enables the QPI power state to low power. L0s and L1 are automatically selected by the motherboard. The options are Disabled and Enabled. Memory Frequency This feature forces a DDR3 frequency slower than what the system has detected. The available options [...]

Chapter 7: BIOS 7-9 Guardband T emperature This is the temperature which applies to the DIMM temperature threshold. Each step is in 0.5 o C increment. The default is [006] . Press "+" or "-" on your keyboard to change this value. Inlet T emperature This is the temperature detected at the chassis inlet. Each step is in 0.5 o C in[...]

7-10 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual Intel VT -d Select Enabled to enable Intel's Virtualization T echnology support for Direct I/O VT -d by reporting the I/O device assignments to VMM through the DMAR ACPI T ables. This feature offers fully-protected I/O resource-sharing across the Intel platforms, provid[...]

Chapter 7: BIOS 7-1 1 Hand-Off support. When enabled, the EHCI Interface will be changed from the BIOS- controlled to the OS-controlled. The options are Disabled and Enabled .  IDE/SA T A/Floppy Con fi guration When this submenu is selected, the AMI BIOS automatically detects the presence of the IDE devices and displays the following items: SA [...]

7-12 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual Primary IDE Master/Slave, Secondary IDE Master/Slave, Third IDE Master , and Fourth IDE Master These settings allow the user to set the parameters of Primary IDE Master/Slave, Secondary IDE Master/Slave, Third and Fourth IDE Master slots. Hit <Enter> to activate the fo[...]

Chapter 7: BIOS 7-13 Select 4 to allow the AMI BIOS to use PIO mode 4. It has a data transfer band- width of 32-Bits. Select Enabled to enable 32-Bit data transfer . DMA Mode Select Auto to allow the BIOS to automatically detect IDE DMA mode when the IDE disk drive support cannot be determined. Select SWDMA0 to allow the BIOS to use Single Word DMA[...]

7-14 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual the S.M.A.R.T . Select Enabled to allow the AMI BIOS to use the S.M.A.R.T . to support hard drive disk. The options are Disabled, Enabled, and Auto . 32Bit Data T ransfer Select Enable to enable the function of 32-bit IDE data transfer . The options are Enabled and Disabled.[...]

Chapter 7: BIOS 7-15 as its I/O port address and IRQ 4 for the interrupt address. The options for Serial Port1 are Disabled, 3F8/IRQ4 , 3E8/IRQ4, 2E8/IRQ3. The options for Serial Port2 are Disabled, 2F8/IRQ3 , 3E8/IRQ4, and 2E8/IRQ3.  Remote Access Con fi guration Remote Access This allows the user to enable the Remote Access feature. The optio[...]

7-16 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual  Hardware Health Monitor This feature allows the user to monitor system health and review the status of each item as displayed. CPU Overheat Alarm This option allows the user to select the CPU Overheat Alarm setting which de- termines when the CPU OH alarm will be activat[...]

Chapter 7: BIOS 7-17 Supermicro has leveraged this feature by assigning a temperature status to certain thermal conditions in the processor (Low , Medium and High). This makes it easier for the user to understand the CPU’s temperature status, rather than by just simply seeing a temperature reading (i.e., 25 o C). The CPU T emperature feature will[...]

7-18 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual Fan1 ~ Fan 4 Reading This feature displays the fan speed readings from fan interfaces Fan1 through Fan5. CPU1 Vcore, CPU2 Vcore, +5Vin, +12Vcc (V), VP1 DIMM, VP2 DIMM, 3.3Vcc (V), and Battery V oltage  ACPI Con fi guration Use this feature to con fi gure Advanced Con ?[...]

Chapter 7: BIOS 7-19 Status of BMC Baseboard Management Controller (BMC) manages the interface between system management software and platform hardware. This is an informational feature which returns the status code of the BMC micro controller .  View BMC System Event Log Th is f e at ur e d i s p lays t he B M C S ys te m Event Lo g (SEL). It s[...]

7-20 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual • T otal Number of Entries • SEL Entry Number • SEL Record ID • SEL Record T ype • T imestamp, Generator ID • Event Message Format User • Event Sensor T ype • Event Sensor Number , • Event Dir T ype • Event Data. Clear BMC System Event Log Clear BMC Syste[...]

Chapter 7: BIOS 7-21 Channel Number - Enter the channel number for the SET LAN Con fi g com- mand. This is initially set to [1] . Press "+" or "-" on your keyboard to change the Channel Number . Channel Number Status - This feature returns the channel status for the Channel Number selected above: "Channel Number is OK"[...]

7-22 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual Parameter Selector Use this feature to select the parameter of your IP Address con fi guration. IP Address The BIOS will automatically enter the IP address of this machine; however it may be over-ridden. IP addresses are 6 two-digit hexadecimal numbers (Base 16, 0 ~ 9, A, B[...]

Chapter 7: BIOS 7-23  SEL PEF Con fi guration Set PEF Con fi guration Set this feature to con fi gure the Platform Event Filter (PEF). PEF interprets BMC events and performs actions based on pre-determined settings or 'traps' under IPMI 1.5 speci fi cations. For example, powering the system down or sending an alert when a triggerin[...]

7-24 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual Event Message for PEF Action - This enables of disables Event Messages for PEF action. Refer to T able 24.6 of the IPMI 1.5 Speci fi cation for more informa- tion at www .intel.com. The options are Disabled and Enabled. BMC W atch Dog Timer Action Allows the BMC to reset or[...]

Chapter 7: BIOS 7-25 7-4 Security Settings The AMI BIOS provides a Supervisor and a User password. If you use both pass- words, the Supervisor password must be set fi rst. Supervisor Password This item indicates if a Supervisor password has been entered for the system. "Not Installed" means a Supervisor password has not been used. User P[...]

7-26 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual Clear User Password (A vailable only when User Password has been set) This item allows you to clear a user password after it has been entered. Password Check This item allows you to check a password after it has been entered. The options are Setup and Always. Boot Sector Vir[...]

Chapter 7: BIOS 7-27  Hard Disk Drives This feature allows the user to specify the boot sequence from all available hard disk drives. The settings are Disabled and a list of all hard disk drives that have been detected (i.e., 1st Drive, 2nd Drive, 3rd Drive, etc). • 1st Drive - [SA T A: XXXXXXXXX]  Removable Drives This feature allows the u[...]

7-28 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual Save Changes and Exit When you have completed the system con fi guration changes, select this option to leave the BIOS Setup Utility and reboot the computer , so the new system con- fi guration parameters can take ef fect. Select Save Changes and Exit from the Exit menu an[...]

A-1 Appendix A: BIOS Error Beep Codes Appendix A BIOS Error Beep Codes During the POST (Power-On Self-T est) routines, which are performed each time the system is powered on, errors may occur . Non-fatal errors are those which, in most cases, allow the system to continue the boot-up process. The error messages normally appear on the screen. Fatal e[...]

A-2 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual Notes[...]

Appendix B: Installing Windows B-1 Appendix B Installing Windows After all hardware components have been installed, you must fi rst con fi gure Intel South Bridge RAID Settings before you install the Windows OS and other software drivers. T o con fi gure RAID settings, please refer to RAID Con fi guration User Guides posted on our web site at w[...]

B-2 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual B-2 Installing Windows for a Non-RAID System 1. Insert Microsoft's Windows 7/XP/Windows 2003 setup CD in the CD drive and the system will start booting up from the CD. 2. Continue with the OS installation. The Windows OS Setup screen will display . 3. From the Windows se[...]

C-1 Appendix C: System Speci fi cations Appendix C System Speci fi cations Processors T wo Intel Xeon 5600/5500 series processors Note: Please refer to our web site for a complete listing of supported processors. Chipset Intel 5520 + ICH10R BIOS 32 Mb AM IBIO S ® S P I Fla sh RO M Memory Capacity T welve DIMM sockets supporting up to 192 GB of r[...]

C-2 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual 6016GT -TF-TC2: one low-pro fi le PCI-E x4 card Serverboard X8DTG-DF (proprietary A TX form factor) Dimensions: 16.64" x 7.74" (423 x 197 mm) Chassis SC818GTQ-1400B (1U rackmount) Dimensions: (WxHxD) 17.2 x 1.7 x 28.2 in. (437 x 43 x 716 mm) Weight Gross (Bare Bone[...]

C-3 Appendix C: System Speci fi cations Electromagnetic Immunity: EN 55024/CISPR 24, (EN 61000-4-2, EN 61000-4- 3, EN 61000-4-4, EN 61000-4-5, EN 61000-4-6, EN 61000-4-8, EN 61000-4- 11 ) Safety: CSA/EN/IEC/UL 60950-1 Compliant, UL or CSA Listed (USA and Canada), CE Marking (Europe) California Best Management Practices Regulations for Perchlorate [...]

C-4 S UPER S ERVER 6016XT -TF/6016GT -TF/TF-TM2/TF-TC2 User's Manual (continued from front) The products sold by Supermicro are not intended for and will not be used in life support systems, medical equipment, nuclear facilities or systems, aircraft, aircraft devices, aircraft/emergency com- munication devices or other critical systems whose f[...]